Session

Building a User-facing Analytics Dashboard with Airbyte, Apache Pinot, and Streamlit

When you hear "decision-maker," it's natural to think of "C-suite" or "executive."

But these days, we're all decision-makers. Restaurant owners, bloggers, big-box shoppers, and diners have important decisions and need instant actionable insights. Businesses need access to fast, fresh analytics to provide these insights to end-users like us.

In this session, we will learn how to build our own real-time analytics application on top of a streaming data source using Apache Kafka, Apache Pinot, and Streamlit. Kafka is a distributed, open-source pub-sub messaging and streaming platform for real-time workloads; Pinot is an OLAP database designed for ultra-low latency analytics. Streamlit is a Python-based tool that makes it easy to build data-driven apps.

After introducing these tools, we'll use Airbyte to build an ETL pipeline that captures MySQL database changes and moves them to Apache Pinot for further analysis. Once we've done that, we'll bring everything together with an auto-refreshing Streamlit dashboard that queries Apache Pinot to generate a beautiful dashboard.

Dunith Dhanushka

Senior Developer Advocate at Redpanda

Manchester, United Kingdom

Actions

Please note that Sessionize is not responsible for the accuracy or validity of the data provided by speakers. If you suspect this profile to be fake or spam, please let us know.

Jump to top