Session

The Nearly No-Code Medallion: Fabric MLV Meets Shortcut Transformations

Discover how Microsoft Fabric revolutionizes medallion architecture implementation by combining two powerful low-code features: Materialized Lake Views (MLV) and Shortcut Transformations.

This session demonstrates how to build production-ready bronze-to-gold pipelines with minimal coding while maximizing efficiency and data quality.

Shortcut Transformations automate your bronze layer by continuously syncing raw files (CSV, JSON, Parquet) from external sources into Delta tables—checking for changes every 2 minutes.

Say goodbye to complex ingestion pipelines: simply point to your data source, configure transformations, and watch your bronze layer stay automatically synchronized.

Materialized Lake Views then take over, transforming this raw data through declarative SQL statements that automatically manage your silver and gold layers. MLVs provide intelligent refresh strategies (incremental, full, or skip), built-in data quality constraints, and automatic dependency management—turning what used to require complex orchestration into simple SQL definitions.

Together, these features create a nearly no-code medallion architecture where:

- Bronze ingestion happens automatically via shortcuts with file transformations
- Silver cleansing and enrichment uses MLV with SQL-based validations
- Gold aggregations leverage MLV lineage for correct execution order
- The entire pipeline self-orchestrates based on data changes

You'll learn the internals of both features, understand their limitations and ideal use cases, and see live demonstrations of building a complete medallion architecture. Walk away with practical patterns for combining shortcuts and MLVs to modernize your data engineering workflows while reducing development time by up to 70%.

Key Takeaways:

- Set up automated bronze layer ingestion using shortcut transformations
- Build declarative silver/gold transformations with Materialized Lake Views
- Implement data quality rules directly in your transformation logic
- Understand when to use MLV vs. traditional notebooks
- Optimize refresh strategies for cost and performance
- Navigate limitations and combine both features for maximum impact

Dennes Torres

Data Platform MVP (2020-2023)

Luqa, Malta

Actions

Please note that Sessionize is not responsible for the accuracy or validity of the data provided by speakers. If you suspect this profile to be fake or spam, please let us know.

Jump to top