You’ve decided to build your first Azure Databricks solution, or perhaps you have already built out a proof of concept. Maybe you already have a significant background using spark on-premises and are looking to migrate. How can you ensure that the solution you deliver will be easy to evolve and maintain as well as efficient and secure? In this session we will look at many of the best practices for designing robust production data pipelines in Azure Databricks. Along the way, we'll cover operational areas like DevOps, alerting and monitoring, performance tuning, and managing costs.