The year is 2025. You've heard of AI, the transformative technology empowering numerous applications across industries. Equally crucial, though, is the complex data management system it necessitates, as we are looking for seamless collection, storage, processing, and analysis of data, all in real-time. But what does building an effective data pipeline like that entail?

We will start with real-time data ingestion. We'll cover what challenges one can face and how to overcome them using Apache Pulsar, a potent cloud-native event streaming platform. Then, we shift our focus downstream to perform analysis using online Machine Learning techniques & a stateful cloud-native stream processing engine (such as Bytewax or RisingWave).

This demo session will cover the data management landscape and provide insightful details on why and how to implement each component for real-time ML & AI application support.