The Building an End-to-End Azure Databricks Data Pipeline presentation by Adriano da Silva is a demo-rich presentation designed as an introduction to the different Databricks technologies that can be integrated with Azure. This session provides value to attendees with little or no knowledge of the subject but wants to learn and/or consolidate their conceptual know-how by attending a practical presentation where concepts are used and demonstrated in a clear and practical manner.

 Topics Covered:

• Lakehouse Architecture
• Unit Catalog
• Medallion Architecture
• Lakeflow Connect
• Azure Data Factory
• Notebooks (PySpark, Spark SQL)
• Delta Tables
• Azure Data Lake Storage (ADLS) Gen2
• Exam DP-750: Some concepts are covered
• Power BI (Bonus - if time allows)

We will cover the building of an end-to-end data pipeline using Azure Databricks — from raw files in Azure Data Lake to clean, transformed, analytics ready tables that can be used by a reporting solution, like Power BI. We’ll explore the Medallion Architecture, Unity Catalog, ingest data the modern way with Lakeflow Connect, orchestrate everything with Azure Data Factory, and transform data using both PySpark and Spark SQL (Don’t worry — it’s friendlier than you think).

Whether you're a SQL pro curious about Databricks, a data engineer looking to modernize your stack, or someone preparing for the DP-750 Azure Databricks Data Engineer Associate exam, this session will give you the patterns, tools, and confidence to build pipelines.

Expect practical guidance, real demos, and a few laughs along the way. And if time allows, we’ll plug the whole thing into Power BI for a polished finish.

Come learn how SQL skills translate beautifully into the Lakehouse world — and walk away with a foundation for your future explorations.