Session
Scalable Data Engineering and Analysis with PySpark in Microsoft Fabric
In this session, you’ll discover how to use PySpark in Microsoft Fabric to build scalable, Python-based data transformation pipelines while staying within the familiar Microsoft analytics ecosystem. You'll learn how PySpark integrates with OneLake and Fabric Lakehouses, and how to use notebooks to clean, transform, join, and enrich data from multiple sources. We’ll also explore how to leverage Spark SQL and the Pandas API on Spark to work efficiently with large datasets, and how to write your results back to the Lakehouse for use with tools like Power BI.
This session is ideal for data engineers and analysts ready to expand beyond traditional SQL workflows and tap into the full power of Python in Microsoft Fabric. No Spark experience is needed, just a curiosity to scale your data skills.
Eric Boyd
Founder & CEO, responsiveX, Azure & AI MVP, Microsoft RD
Chicago, Illinois, United States
Links
Please note that Sessionize is not responsible for the accuracy or validity of the data provided by speakers. If you suspect this profile to be fake or spam, please let us know.
Jump to top