Dustin Vannoy
Azure Data Engineer - Consultant and Trainer
San Diego, California, United States
Dustin Vannoy is a Data Engineering Consultant with 15 years experience solving business problems with analytics and big data solutions. He is passionate about all aspects of data engineering, especially building data platforms and streaming data pipelines. He currently focuses on building data lakes and data pipelines in Azure with Apache Spark, Kafka, Python, and Scala. Dustin is a technical leader in San Diego and the co-founder of Data Engineering San Diego group. He encourages others to grow their data skills by making tutorials and speaking, particularly around Southern California and Baja California.
Links
Area of Expertise
Topics
Stream Processing in Azure
Many data pipelines still default to processing data nightly, but information is created all the time and should be available much sooner than once a day. While the move to stream processing adds complexity, the tools we have available make it achievable for teams of any size.
This session introduces beginners and experienced tech professionals to techniques for real-time stream processing using Azure. We'll cover popular options to build streaming data pipelines and dive into demos of Azure Databricks and Azure Stream Analytics.
Azure Data Engineer Skills for Success
Data Engineer is an exciting and rewarding role. However, many are not sure what a data engineer does and which skills are needed. This session will describe a data engineer's responsibilities and give an overview of the skills needed to be an Azure Data Engineer. You will learn about a reference architecture for data engineering in Azure and see demos of key tools an Azure Data Engineer uses. The focus will be on real-world data engineer skills, but you will also highlight which skills are tested in the Azure Data Engineer Associate certification.
Dustin Vannoy
Azure Data Engineer - Consultant and Trainer
San Diego, California, United States