Session
Kafka: Evolved. Introducing True Queuing with KIP-932
Kafka excels at streaming data, but what happens when you need workers to share a task queue? Traditionally, this meant choosing between complex/costly workarounds or running separate message queue systems alongside Kafka—until now.
KIP-932 introduces native message queuing to Kafka through a simple yet powerful concept called Share Groups. Instead of telling you how it works, we'll show you. Through live demonstrations and clear visualizations, you'll see exactly how multiple workers can pull from the same task pool, how messages are safely distributed without duplication, and what happens when things go wrong.
We'll start with a working demo—watching tasks flow between workers in real-time—then pull back the curtain to show you the protocol mechanics that make it all possible. No mysterious black boxes: you'll see the message leasing, acknowledgments, and recovery processes in action. We'll explore real use cases from order processing to background jobs, and demonstrate how this changes the game for building resilient distributed systems.
Whether you're tired of managing multiple messaging systems, curious about Kafka's evolution, or just want to see some cool distributed systems concepts in action, this talk will give you a clear picture of what's possible.
No deep Kafka internals knowledge required—just bring your curiosity! By the end, the mystery of distributed task queuing will be completely demystified, and you'll understand exactly when and how to use Kafka's newest superpower.
The visual part of my talk about KIP-714 in Current London seemed to be very well received, I want to leverage the same . § https://docs.google.com/presentation/d/1OTs-zOAU01CN3XUSoBiBt9SKA25J_DKefhdQdQFObNM (a big part of the talk was a live demo)
Please note that Sessionize is not responsible for the accuracy or validity of the data provided by speakers. If you suspect this profile to be fake or spam, please let us know.
Jump to top