Paul Andrew

Information & Communications Technology

Azure Data Platform

Derby, England, United Kingdom

Beyond IoT - How to Handle Streaming Data in Azure

The desire and expectation to use real-time data is constantly growing, businesses need to react to market trends instantly. In the new data driven age a daily ETL load/processing window is not enough. We need a constant stream of information and analytics achieved in real-time. In this session will look at how that can be achieved using Azure Stream Analytics. Building streaming jobs that can blend and aggregate data as it arrives to drive live Power BI dashboards. Plus, we will consider options for using Stream Analytics in production and what other tools could be used in the ever-growing list of Azure services. Lastly, we will explore the theory behind a complete Lambda architecture where we combine streaming and batch data together and how this different from the Databricks Delta architecture.

Paul Andrew

Principal Consultant & Solution Architect, Data Platform MVP

Principal consultant and architect specialising in big data solutions on the Microsoft Azure cloud platform.
Data engineering competencies include Azure Data Factory, Data Lake, Databricks, Stream Analytics, Event Hub, IoT Hub, Functions, Automation, Logic Apps and of course the complete SQL Server business intelligence stack.
Many years’ experience working within healthcare, retail and gaming verticals delivering analytics using industry leading methods and technical design patterns.
STEM ambassador and very active member of the data platform community delivering training and technical sessions at conferences both nationally and internationally.
Father, husband, swimmer, cyclist, runner, blood donor, geek, Lego and Star Wars fan!

Paul's full speaker profile