Session
Building Enterprise Data Platforms with Azure Databricks and Microsoft Fabric
Modern enterprises need scalable, reliable, and cost-effective data platforms to transform raw data into trusted business insights. Building these platforms requires more than selecting cloud services; it involves designing effective architectures, implementing robust data pipelines, maintaining data quality, and establishing appropriate governance.
In this session, I will discuss practical approaches to building enterprise data platforms using Microsoft Azure, Azure Databricks, and Microsoft Fabric. We will explore data ingestion, transformation, lakehouse architecture, the medallion architecture pattern, data quality validation, and governance considerations.
Drawing on my experience in cloud data engineering and financial services, I will share practical engineering lessons, architectural trade-offs, and approaches to building maintainable data pipelines for enterprise analytics.
The conversation will also examine how organisations can improve pipeline reliability, manage data transformations effectively, and establish a foundation for trustworthy analytics and AI.
Key Discussion Points
Designing scalable cloud-native data architectures.
Implementing Bronze, Silver, and Gold data layers.
Using Azure Databricks, PySpark, and Delta Lake for data transformation.
Applying data quality checks and validation practices.
Managing data governance, security, and traceability.
Preparing enterprise data platforms for analytics and AI.
Please note that Sessionize is not responsible for the accuracy or validity of the data provided by speakers. If you suspect this profile to be fake or spam, please let us know.
Jump to top