Session

Demystifying Spark Profile Optimizations in Microsoft Fabric

Optimizing Spark workloads in Microsoft Fabric can be a complex endeavor, given the array of available configurations and techniques. Terms like V-Order, Z-Order, and considerations for read-heavy versus write-heavy profiles often add to the confusion. In this session, we'll bring clarity to these concepts, offering a structured overview of each optimization strategy and how it impacts performance on the table level of a Delta Lake table

Through practical examples and performance considerations, attendees will gain insights into how to fit these optimizations into their data architecture, whether dealing with read-intensive analytics or write-heavy data ingestion processes. By the end of this talk, you'll be equipped with the knowledge to make informed decisions, turning the complexity of Spark optimizations in Microsoft Fabric into a strategic advantage

Thibauld Croonenborghs

Data Architect at AE

Brugge, Belgium

Actions

Please note that Sessionize is not responsible for the accuracy or validity of the data provided by speakers. If you suspect this profile to be fake or spam, please let us know.

Jump to top