How to use and create Data Lineage in Microsoft Purview?
The use of data Lineage is a hot topic for many organizations.
Many organizations struggle with answers to the following questions:
• I want to adjust a measure, but where do I have to adjust it and where does the data come from?
• What will be the effect on my data if I rename this column in the source?
• Can I visually overview my Data Estate including how the data has been transformed?
As you can see, data lineage is used for different kinds of backward-looking scenarios, such as troubleshooting, root cause discovery in data pipelines, and debugging. Lineage is also used for data quality analysis, compliance and 'what if' scenarios, often referred to as impact analysis.
How can Microsoft Purview help us to create these visual overviews to better understand our Data Estate.
During this session I will take you through guidelines how you can enable Data Lineage with Microsoft Purview, Azure Synapse Analytics and how to use Custom Lineage components for unsupported data sources with Apache Atlas.
Erwin de Kreuk
Lead Data and AI | Data Platform MVP | Public Speaker | InSpark | Innovate to Accelerate
Rotterdam, NetherlandsView Speaker Profile