Azure Databricks is expensive. Running a cluster can cost thousands, if not 10s of thousands of Euros per month. Therefore, Databricks is only suitable for the biggest of datasets. Seems to be common knowledge… right?

Let’s be honest, it doesn’t need to be this way. With some tips and tricks, Azure Databricks can be suitable for processing any kind of dataset. Without breaking the bank.

Not convinced? During this talk, I will show you how. Together, we follow several scenarios that unnecessarily increase your monthly spend. By understanding what these scenarios are, and how to solve them, we will get a grip on that Azure bill.

By the end of this talk, you will be able to:
- Understand the concept of “DBU”
- Create an Azure Databricks cluster in a cost-effective manner
- Stream data and run batch jobs in a way that doesn’t break the bank
- Use the Azure cost-calculator effectively
- Set budgets and alerts on your Azure subscriptions