Speaker

Aswin A

Aswin A

IBM, Staff Engineer

Kochi, India

Actions

Aswin A is a passionate software developer with expertise in Kubernetes, cloud-native technologies, and distributed systems. Currently working on cutting-edge solutions for deploying and managing Kafka clusters across Kubernetes, Aswin specializes in designing scalable and resilient architectures. Dedicated to continuous learning and open-source contributions, Aswin actively engages with the community through projects and discussions around Kubernetes Operators and Kafka management.

Area of Expertise

  • Information & Communications Technology
  • Physical & Life Sciences

Topics

  • Kafka
  • Apache Kafka
  • Apache Flink
  • Kubernetes

Stretching Strimzi: Exploring Multi-Cluster Kafka for High Availability

As organizations increasingly rely on Apache Kafka for mission-critical workloads, ensuring high availability across Kubernetes clusters is a key challenge. What if Strimzi could support Kafka deployments that span multiple clusters, improving fault tolerance and resilience?

In this talk, we’ll explore the concept of Stretch Clusters, a proposed enhancement to Strimzi that enables Kafka brokers to be distributed across Kubernetes clusters while maintaining a unified deployment model.

We’ll discuss:

- The motivation behind Stretch Clusters and real world scenarios where they could be beneficial.
- The current prototype and how it leverages Cloud Native Network solutions like Submariner, Cilium.
- The technical challenges, including state consistency, networking, and failover handling.
- Key considerations for the Strimzi community, what it would take to make this a viable feature in Strimzi.

This session is not just about a feature proposal. it’s an opportunity to spark discussion within the community about how Strimzi could evolve to support multi cluster Kafka deployments. Whether you’re a Strimzi contributor, Kafka operator, or cloud-native architect, join us to share your thoughts and help shape the future of Strimzi!

Breaking the Kubernetes Barrier: Deploying Kafka Across Clusters

The growing adoption of Kubernetes and Kafka for distributed systems presents exciting opportunities alongside unique challenges for enhancing the availability and resilience of Kafka deployments. While Kubernetes offers powerful orchestration capabilities, deploying a Kafka cluster within a single Kubernetes cluster can expose organizations to limitations. A Kubernetes cluster outage may render the entire Kafka system unavailable, disrupting applications and clients. To overcome this, many organizations including us are working to achieve scalable, distributed, multi-zone Kafka clusters where the Kafka nodes span across multiple Kubernetes clusters in nearby availability zones.

This multi-cluster approach provides several key benefits. It ensures high availability by preventing single-cluster outages, supports migration efforts by allowing Kafka nodes to be deployed across clusters with minimal disruption, and optimizes resource usage by leveraging the combined capacity of multiple Kubernetes environments. However, implementing such deployments introduces significant challenges, including managing increased network complexity and costs, ensuring low-latency connectivity for performance, and maintaining data consistency in latency-sensitive environments.

This session explores practical methodologies and principles for deploying Kafka across Kubernetes clusters, focusing on broker and controller distribution, fault tolerance, scalability, cross-cluster communication, and resource synchronization. Attendees will gain insights into challenges associated with distributing Kafka across Kubernetes clusters and explore potential solutions within the Operator framework. Tailored for developers and operators, this talk provides actionable takeaways for enhancing Kafka’s resilience, scalability, and flexibility on Kubernetes, including best practices for resource integration, configuration management, and performance tuning.

StrimziCon 2025 Sessionize Event

June 2025

Current Bengaluru 2025 Sessionize Event

March 2025 Bengaluru, India

Aswin A

IBM, Staff Engineer

Kochi, India

Actions

Please note that Sessionize is not responsible for the accuracy or validity of the data provided by speakers. If you suspect this profile to be fake or spam, please let us know.

Jump to top