In this demo-centric session we will run through the tips, tricks and best practices when using Spark at scale.

In this session we will cover:
- Different ways to configure and manage your Spark Environments, including cluster sizing, libraries and configuration properties
- Tips for performance profiling and optimisation
- Different options for complex orchestration patterns that minimize cluster start-up time
- Using MSSparkUtils to the fullest to orchestrate end-to-end scenarios
- Ways to use an eventhouse to monitor your Spark Jobs and find performance regression.

This session is targeted at people who are either:
1 - looking to start a Fabric project in the near term with extensive use of Spark and Lakehouses; or
2 - those current using Fabric Spark who are wanting to take their skills to the next level.