Session

Building Enterprise Data Platforms with Azure Databricks and Microsoft Fabric

Modern enterprises need scalable, reliable, and cost-effective data platforms to transform raw data into trusted business insights. Building these platforms requires more than selecting cloud services; it involves designing effective architectures, implementing robust data pipelines, maintaining data quality, and establishing appropriate governance.

In this session, I will discuss practical approaches to building enterprise data platforms using Microsoft Azure, Azure Databricks, and Microsoft Fabric. We will explore data ingestion, transformation, lakehouse architecture, the medallion architecture pattern, data quality validation, and governance considerations.

Drawing on my experience in cloud data engineering and financial services, I will share practical engineering lessons, architectural trade-offs, and approaches to building maintainable data pipelines for enterprise analytics.

The conversation will also examine how organisations can improve pipeline reliability, manage data transformations effectively, and establish a foundation for trustworthy analytics and AI.

Key Discussion Points

Designing scalable cloud-native data architectures.

Implementing Bronze, Silver, and Gold data layers.

Using Azure Databricks, PySpark, and Delta Lake for data transformation.

Applying data quality checks and validation practices.

Managing data governance, security, and traceability.

Preparing enterprise data platforms for analytics and AI.

Sunilkumar Reddy

Barclays - Data Engineer

London, United Kingdom

Actions

Please note that Sessionize is not responsible for the accuracy or validity of the data provided by speakers. If you suspect this profile to be fake or spam, please let us know.

Jump to top