Business Intelligence Data Warehousing Data Integration ETL Azure Data Platform Azure Data Factory Microsoft Data Platform SQL Server Integration Services SSIS Biml BimlScript SQL Server SQL
Azure Data Factory v2 came with many new capabilities and improvements. One of the biggest game-changers was the Data Flows feature, allowing you to transform and prepare data at scale - without having to write a single line of code!
First came the Mapping Data Flows, built for data transformation and known-schema to known-schema mapping. Then came the Wrangling Data Flows, built for data preparation and exploration. After that came ALL the questions :) What is the difference between the two types of Data Flows? How are they different from Power BI dataflows? Who should use Mapping, and who should use Wrangling, and when, and why, and how?
In this session, we will go through the capabilities and use cases for both Mapping and Wrangling Data Flows. For Mapping Data Flows, we will dig deeper into the various transformations available, as well as the expression language and how to use the visual expression builder. Finally, we will look at how to debug, monitor, and optimize our data transformations.
Session Level: 200 / Intermediate
Session Length: 45-75 minutes
Prerequisites: Attendees should be familiar with Data Integration and/or ETL scenarios. Experience building solutions in SQL Server Integration Services (SSIS) and/or Azure Data Factory (ADF) can be helpful, but not required.
Cathrine loves data and coding, as well as teaching and sharing knowledge :) She is based in Norway and works as a Senior Business Intelligence Consultant in Inmeta, focusing on Data Integration and Data Warehousing. Her core skills are Azure Data Factory, Azure Synapse, SSIS, Biml and T-SQL development, but she enjoys everything from programming to data visualization. Outside of work she’s active in the Azure and Microsoft Data communities as a Microsoft Data Platform MVP, international speaker, blogger, organizer, and chronic volunteer.
Cathrine is based in Norway, but loves traveling and speaking internationally.