Building a Metadata driven ELT Framework in Azure Synapse Analytics
A metadata-driven ELT framework in Azure Synapse Analytics is a way of organizing and managing data pipelines that involves using metadata to define and control the flow of data from source to destination. This can be useful for organizations that have a large number of data pipelines and want to have more control over how data is processed and moved between systems.
In this session, we will discuss the benefits of using a metadata-driven approach to managing data pipelines in Azure Synapse Analytics. We will cover the key components of a metadata-driven ELT framework, including the metadata repository and the processes for managing and maintaining metadata. We will also provide practical examples and best practices for implementing a metadata-driven ELT framework in your organization.
The session is intended for data engineers and other technical professionals who are interested in using Azure Synapse Analytics to manage and optimize data pipelines.
Erwin de Kreuk
Lead Data and AI | Data Platform MVP | Public Speaker | InSpark | Innovate to Accelerate
Rotterdam, NetherlandsView Speaker Profile