Azure Databricks is a category-defining, cloud-native Unified Analytics Platform that provides a one-stop shop to address all analytics needs within a enterprise, from Data Engineering (Batch/Real-time) to Data Science. Spark is core of the platform, where one could easily combine it with third-party libraries for ETL workloads, and popular machine learning / deep learning frameworks for predictive & prescriptive analytics. Enterprise Security is baked in as a first class citizen, providing cloud-native integrations for Data Protection, IAM/Auth and Networking Setup.

In this session, we'll provide an overview of Azure Databricks integration points, and how it could be used with ADLS Gen 2 & Azure SQL to implement a end-to-end data pipeline.