Session

Building Incremental Data Pipelines Using Azure Data Factory

One of the most common and challenging problems in Data Engineering is how to efficiently and accurately detect changed data. In the cloud, relying on a full load pattern can be both time consuming and costly. In this session we will look at some common design patterns for detecting and loading new and updated data using Azure Data Factory. Along the way we will also explore some common techniques to make pipelines more dynamic and add additional auditing and logging.

Jason Horner

Global Thought Leader and International Man of Leisure

Denver, Colorado, United States

Actions

Please note that Sessionize is not responsible for the accuracy or validity of the data provided by speakers. If you suspect this profile to be fake or spam, please let us know.

Jump to top