The evolution of spark over the last decade has been incredible, and it's showing no signs of slowing down. The latest generation of Databricks workspace has a whole raft of features that add quality of life to the spark user, whether you're a data engineer, scientist or analyst, there are goodies just for you.

This session with dive into the nuts & bolts of those features, looking at the new Delta Engine which provides lightning fast data processing, coupled with the optimisations that Spark 3.0 brings to the table. We'll talk MLFlow and the machine learning model hosting options that now come bundled inside Databricks, as well as the Next Generation Data Science Project experience. Finally, we'll look at the SQL surface, how analysts can interact directly with the lake and build rich visuals, directly from the browser, or integrate with their favourite BI tools.