Speaker

Andy Leonard

Andy Leonard

Data Philosopher and Engineer

Farmville, Virginia, United States

Andy Leonard is a husband, dad, and grandfather; creator of – and Data Philosopher at – DILM (Data Integration Lifecycle Management) Suite; a blogger, founder and Chief Data Engineer at Enterprise Data & Analytics; an SSIS and Azure Data Factory trainer, consultant, and developer; a SQL Server database and data warehouse developer; an author, mentor, engineer, and farmer.

Area of Expertise

  • Information & Communications Technology

Topics

  • Data Engineering
  • Microsoft Data Platform
  • SSIS
  • Data Integration
  • Azure DevOps
  • DevOps & Automation
  • Testing

Getting Started with the Azure Data Factory REST API

Azure Data Factory - ADF - is a cloud data engineering solution. While the ADF GUI and properties surface lots of cool and useful functionality, some functionality is encapsulated in the ADF REST API. In this session, I demonstrate using the ADF REST API to save money when using Azure-SSIS integration runtimes and stopping a Foreach activity on a failure (not native functionality).

A Day of Azure Data Factory

In this session we provision an Azure Data Factory (ADF) and demonstrate many uses for ADF in the modern data enterprise, including:
- Editing ADF pipeline JSON
- Version control integration
- Copying data with the copy data activity
- Parameters and use cases for parameterization (dynamic property values and expressions)
- Design patterns for the hybrid data estate
- Loading data from an on-premises data source
- Survey newer activities
- Debugging and troubleshooting ADF pipelines
- Looping, iteration, and conditionals
- Monitoring
- Execution automation (triggers + )
- ADF REST API
- security required to interact with Azure Blob Storage, Azure SQL DB, REST API, integration runtimes, git, and on-premises (plus Key Vault)
- Provisioning and using integration runtimes

Introduction to Azure Data Factory

Azure Data Factory - ADF - is a cloud data engineering solution. ADF version 2 sports a snappy web GUI (graphical user interface) and supports the SSIS Integration Runtime (IR) - or "SSIS in the Cloud." Attend this session to learn:
- One way to provision a Data Factory
- How to build your first ADF pipeline
- How to deploy and execute an ADF pipeline

Using Azure Data Factory with Git

Data Integration Lifecycle Management - or DILM - is challenging regardless of your chosen data integration platform. In this session, Andy Leonard discusses and demonstrates configuring a basic git repository on github.com, and then connecting the repo to Azure Data Factory (ADF).

Moving Data with Azure Data Factory

Azure Data Factory (ADF) is a cloud data engineering service. ADF version 2 sports a snappy web GUI (graphical user interface) and supports the SSIS Integration Runtime (IR) - or "SSIS in the Cloud."

Andy Leonard

Data Philosopher and Engineer

Farmville, Virginia, United States