Apache Kafka® is great at joining different software systems and processing their data in real time. But while event-based approaches like Kafka are growing in popularity, it can still be hard to see how a whole system fits together. Let’s fix that by exploring a complete Kafka application. One that combines two domains that no one ever expected to be integrated: Electronic music and the London Underground.

We’ll explore the use of Kafka Connect to make sourcing London’s transport data trivial. We’ll use Kafka Streams to live-manipulate that data into a form we want to present. And to get away from the usual charts and maps web tier, we’ll send our data out to a more exotic data source - a group of synthesizers that represent a well-running system by playing in harmony (and represent a broken one with something more discordant!)

You’ll see—and hear—how the whole thing fits together and get a better sense of what a complete Kafka solution looks like. You could use the same recipe as the backbone for a more traditional business dashboard, or maybe the next time there’s a crisis at work, you could have it accompanied by its own live backing track…

This session includes music, so I'll need some extra help from the PA team.