Paul Andrew

Information & Communications Technology

Azure Data Platform

Derby, England, United Kingdom

Using Azure DevOps for Azure Data Factory

DevOps as a process is here to stay and is typically a must have requirement for any data platform solution. But how does the concept translate to the technology when implemented? Sadly, the answer isn’t always straight forward. In this short session I’ll introduce how we can continuously integrate and deliver our cloud orchestration resource Azure Data Factory (ADF). We’ll discuss three options for getting our service JSON deployed to production using the popular Azure DevOps environment, previously known as VSTS, and think about the suitability of the Microsoft provided ARM templates for our highly dynamic orchestrator. Does the ADF portal UI really support the DevOps methodology? Can we confidently publish our pipelines? How should we handle the branching of our source code for ADF developers? The answers to all these questions and more in this lightning session. All based on real world experience with the products.

Paul Andrew

Principal Consultant & Solution Architect, Data Platform MVP

Principal consultant and architect specialising in big data solutions on the Microsoft Azure cloud platform.
Data engineering competencies include Azure Data Factory, Data Lake, Databricks, Stream Analytics, Event Hub, IoT Hub, Functions, Automation, Logic Apps and of course the complete SQL Server business intelligence stack.
Many years’ experience working within healthcare, retail and gaming verticals delivering analytics using industry leading methods and technical design patterns.
STEM ambassador and very active member of the data platform community delivering training and technical sessions at conferences both nationally and internationally.
Father, husband, swimmer, cyclist, runner, blood donor, geek, Lego and Star Wars fan!

Paul's full speaker profile