In this presentation, we will explore the dbt-Flink adapter, a project we developed at GetInData and we open-sourced. On one one side brings the power of dbt's best data engineering standards to Apache Flink and its community. On the other , it enables dbt users to run their SQL-based data transformations in streaming, real-time. As cherry on the top we will show how Flink with dbt can be used as a generic real-time and batch end-to-end ETL system.
Our focus will be on the technical aspects and practical applications of this integration. We will delve into the details of how the adapter works, its benefits, and real-world use cases. Join us to learn how to leverage Apache Flink and streaming in your existing dbt projects, and how to raise the quality of your SQL-based Flink pipelines with dbt.