Popular for many years, especially among data monsters with Python knowledge, Apache Airflow is now also part of the Azure Data Factory family, and this in a managed version! We take a look at how the DAGs can be used in the Data Factory, how it is about integration and scaling in the ADF. Of course, we also draw a comparison to orchestration with classic pipelines.

Introducing Apache Airflow Integration in Azure Data Factory