• Ásgeir Gunnarsson
• Just Blindbæk

Monitoring Fabric, make do, buy or build

Monitoring Fabric, make do, buy or build

In the ever-evolving landscape of Fabric tenant management, obtaining a holistic overview is of paramount importance.

There are several ways you can monitor the content of your Fabric tenant and the activities of your users. Microsoft has some things out of the box such as the Monitoring Hub and the Capacity Metrics app. You can also buy ready-made solutions from different vendors, or you can build your own solution.

What you choose depends on many factors but most importantly what do you want to get out of the solution.

In the first part of this session, we will cover what the built-in capabilities cover, we will talk about why you might buy a ready-made solution (we will not compare different solutions on the market) and then we will talk about how you can build your own solution.

The second part of the session will focus on what you need to build your own solution and how you can take advantage of things the community has created. We will look at solutions build in Fabric Data Factory as well as coded solutions build in Fabric Spark. This part will be demo heavy with examples of how to get different data out of the system and store it for further use. We will also cover some ways to use the data such as creating an artifact inventory or implementation support.

At the end of the session the audience will understand how to be sure if the built-in capabilities are enough, if buying is right for them or if they should build their own solution. They will also know what it takes to build your own solution and how to jumpstart the process by using solutions the community has made publicly available for free.

Slide deck etc

Material.zip

• Erwin de Kreuk
• Marc Lelijveld

Embark on a transformative journey into building an end-to-end solution within the Microsoft Fabric.

As a newcomer, you’re about to dive into the fascinating process of data extraction and report creation.

This session will guide you through the essential steps to kickstart your data extraction endeavors. You’ll gain a deep understanding of diverse data sources and learn to navigate through powerful connectors within Microsoft Fabric, setting up a solid foundation for your data journey from all the lessons we have learned.

Immerse yourself in the realm of Data Factory, where you’ll craft seamless data pipelines and Notebooks that effortlessly shuttle information between sources.

But the journey doesn't stop there. You'll also learn to take full advantage of on demand loading and (near-) real-time reporting capabilities by using Direct Lake connectivity to Power BI.

And the last part of the journey, whilst we're working in the era of AI, we take full advantage of services like Co-pilot to support our development process throughout the entire journey up to data visualization.

This session is more than just an introduction to Microsoft Fabric. It’s a comprehensive guide designed to equip you with the knowledge and confidence to navigate the landscape of data extraction and report creation.

So, get ready to unravel the mysteries of data extraction and chart your course towards building insightful reports. Welcome to your immersive Fabric initiation.

Slide deck etc

04-10-2024_Building end to end solution with Fabric.pdf

• Brian Bønk

Gain Real(time) insights in a day with Kusto And Power BI

Microsoft has released the next big visualization tool in the portfolio - Real-Time Dashboards. But how and where does it fit with the current Power BI tool and how do you use it at its best.

This training day/precon is for you who would like to be on top of the newest technology within visualization when working with Real-Time Analytics. Perhaps you need near-real-time reports (more often than PowerBI can deliver) or are curious about the new visualization platform from Microsoft.

In this full day training I will guide you from the very beginning of Real-Time Analytics to end with a fully functioning Real-Time dashboard, with comparison and work with Power BI, to find the different use cases and know when to use what tool.

The day will kick off with an introduction to the Real-Time analytics environment in both Fabric and as a standalone service in Azure, history of the service and an open discussion on where the service fits in the current world of analytics.

We will cover elements as ingestion, querying, data manipulation, intro to data science mechanisms - all based on the Kusto database. Work with Power BI when reading data from the Kusto database and how to build a fully functioning real-time dashboard.

Every attendee will end the day with knowledge of the difference between Power BI and the RTA dashboards, a fully functioning dashboard and be able to work with the RTA service for further learning and improvement.

Come and join along in a day packed with learning, a cozy and relaxed environment and a learning curve for everyone to tap into.

Topics that will be covered:
- Kusto engine
- Eventstream
- KQL language
- Data science in KQL
- Real-Time Dashboards vs Power BI

Slide deck etc

Gain Real-Time insights in a day with Kusto and Power BI.pdf

• Heini Ilmarinen

Reaching for Data with Microsoft Fabric

Microsoft Fabric is the newest kid on the block for creating a data platform solution; for a data platform we need data. Most likely data that is in a secured network and maybe not reachable over the public network. So what is the right method to reach them!

This session is aimed to understand typical scenarios of bringing in data to Fabric from secured data sources. We will go through how does a private endpoint affect our environment, when and how can we use shortcuts with network secured data. How about the familiar on-prem and virtual network gateways from the PowerBI side. On the way we will also go through the most necessary core concepts regarding networking and DNS, so it will be easier to understand networking in general. After this session you will be able to connect to your data sources without a hiccup!

• Gabi Münster
• Sarath Sasidharan

Govern your Data on Fabric and Beyond : A Pre-Conference Exploration

In the ever-evolving landscape of governance, where agility, transparency, and efficiency are paramount, the integration of cutting-edge technology becomes imperative. Enter Microsoft Fabric – a transformative platform designed to revolutionize data democratization. This pre-conference session serves as an immersive exploration into the governance capabilities within Microsoft Fabric.

Throughout this session, participants will delve into the multifaceted dimensions of governance, understanding its complexities and challenges in contemporary contexts. By leveraging the power of Microsoft Fabric and Microsoft Purview, attendees will uncover innovative strategies to streamline decision-making processes, enhance compliance frameworks, and foster greater accountability.

Key highlights of the pre-conference session include:

Introduction to Governance within Microsoft Fabric: Gain comprehensive insights into the foundational principles and governance functionalities of Microsoft Fabric.

Navigating Governance Challenges: Analyze prevalent governance challenges across industries and jurisdictions, and discover how Microsoft Fabric and Microsoft Purview offers bespoke solutions to address these obstacles effectively.

Best Practices: Learn from Microsoft PMs who have developed the platform to drive tangible outcomes and achieve organizational objectives.

Interactive Workshops and Demonstrations: Engage in hands-on workshops and live demonstrations to gain practical experience for setting up Governance on Microsoft Fabric within your organization. Harness the platform's features to develop customized governance frameworks tailored to your specific needs.

Future Trends and Possibilities: Anticipate the future trajectory of governance and technological advancements, exploring how Microsoft Fabric is poised to evolve in tandem with emerging trends.

By the end of this pre-conference session, participants will emerge equipped with a comprehensive understanding of how Microsoft Fabric can serve as a cornerstone for analytical practices. Whether you're a policymaker, regulatory authority, or industry practitioner, join us on this transformative journey to unlock the full potential of governing your Microsoft Fabric estate.

• Sam Debruyn

Medallion for Data Mesh: Exploring Workspace, Capacity, and Domain Design in Microsoft Fabric

Designing a medallion architecture is more than just setting up a few Lakehouses and Data Warehouses. In this session, data architects and engineers learn how to design a medallion architecture with Fabric Workspaces, Capacities, and Domains. We’ll cover the segregation of responsibilities, granular access control, and how to pick and choose the right Capacities for every workload. By the end of this talk, you’ll be ready to design a scalable and secure data platform with Microsoft Fabric.

• Prathyusha(Prathy) Kamasani

Powering Up Your Power BI Development Workflow with Microsoft Fabric Notebooks

Are you excited about Microsoft Fabric and its Notebooks feature, but also feel overwhelmed by the different languages it supports, this session is for you. You will learn the basics of Python and Spark, and how to use Notebooks to write and run code. You will also discover how to leverage tools like CoPilot to assist you with code suggestions and corrections. Moreover, you will see how to use libraries like SemPy to enrich your Power BI development with advanced analytics. Join Prathy in this session and get ready to explore the possibilities of Notebooks in Microsoft Fabric.

• Laura de Bruin

Empowering your data platform with AI

In this session, you will gain insights into the world of artificial intelligence, discovering how it can propel your data platform to extraordinary heights.

I will showcase the opportunities for integrating artificial intelligence into your existing data infrastructure. Explore how AI can enhance data processing, analysis, and decision-making capabilities, unveiling a myriad of potential benefits.

Delve into a diverse array of AI services, ranging from the conversational abilities of ChatGPT chatbot to the strategic insights of CoPilot, the predictive power of Machine Learning, and the cognitive abilities of specialized services. Each offering presents an opportunity to enhance the overall value of your data assets.

However, this exploration is not without its challenges. Throughout the session, I will navigate considerations of security, privacy, and data accuracy, providing a comprehensive understanding of potential risks. Gain practical insights into the optimal ways to kickstart your AI journey, striking a balance between opportunities and the practicalities of seamlessly integrating AI into your organizational landscape.

The session includes a hands-on demonstration, enabling you to interactively explore AI tools and applications.

Join for an insightful adventure into the world of AI!

• Just Blindbæk

Demystifying the Data Lakehouse in Fabric

Are you a Classic BI and Data Warehouse (DWH) developer eager to understand the Data Lakehouse concept that's taking the data world by storm? This session is tailored just for you.

Delve into key questions: What exactly is a Data Lakehouse, and why are terms like bronze, silver, and gold gaining popularity? Should you embrace Python or can you rely on trusty SQL?

Discover the power of decoupling storage and compute, where storage is cheap, compute is expensive, and you can easily scale compute for specific tasks. Learn about OneLake and Delta Lake and why mastering PySpark makes sense for tasks like data cleaning, handling semi-structured data, and integrating with API-based sources like event streams.

But don't forget, SQL is still cool. It's an excellent practice for defining business logic and simplifies porting logic between platforms. With Spark SQL, it's not far from what you know. Plus, explore how to leverage Spark notebooks with mark-up for documentation.

Join us to unravel the Data Lakehouse in Fabric and learn how to make the right choices for your data development journey.

Slide deck etc

Demystifying the Data Lakehouse in Fabric.pdf

• Wolfgang Strasser

From Azure Purview to Microsoft Purview - Unified Data Governance in Shape

Several years ago, Microsoft introduced Azure Purview, a comprehensive data catalog solution designed to map your hybrid data estate. Recently, the solution has evolved into Microsoft Purview, reflecting a broader focus on unified data governance. This evolution has brought significant updates and enhancements, integrating critical business aspects of data governance into the data catalog solution.

This session will provide an in-depth exploration of the Microsoft Purview Data Catalog, including its Business Domains and Objectives and Key Results (OKRs). Additionally, we will discuss how data quality is seamlessly integrated into the overall solution, offering a holistic approach to data governance.

Join this session to gain valuable insights into leveraging Microsoft Purview for effective data management and governance, ensuring your organization’s data assets are well-governed, high-quality, and strategically aligned with business goals.

Slide deck etc

From Azure Purview to Microsoft Purview_WolfgangStrasser_DataSatHolland2024.pdf

• Gianluca Sartori

Time Series with SQL Server 2022

The last few years have seen the rise of time series databases, specialized for storing and analyzing data change over time.
These databases are great for IoT projects and for telemetry data in general, but their behavior and feature set are different from what we have in relational databases.
SQL Server 2022 introduces new time series capabilities, that will allow us to to work with time series data in the same database that we use for all the rest of the data.
Join me to see what SQL Server 2022 brings to the table for time series data, how to use the new features and what are the opportunities and the limitations. Are you working with IOT telemetry data or performance metrics? This is the session for you!

• Brian Bønk

The second visualization tool from Microsoft - is it actually better than PowerBI?

When working with reporting and analytics, the end user sometimes has demands for very frequent updates and expects almost zero latency.

With the release of Real-Time dashboards in Fabric we now have the ability to deliver to these needs.

Join me on a trip into the next-gen visualization tool from Microsoft which maybe can be a better choice than Power BI.

This level 100-200 session is meant to the developer who wants to be on top of the game in analytics and visualization and get to know the new Real-Time dashboards feature in Microsoft Fabric.

We will start of with a short introduction to the Real-Time analytics area if Fabric and quickly dive into the dashboard feature of the service.
With near-real-time insights to data arriving in the database, features like cross filtering and easy user interaction we end with a fully working dashboard and get to see the live data streaming in and made available to the end user.

Topics:
- KQL script language
- Eventstream
- Real-Time dashboards
- Live reporting

Slide deck etc

The second visualization tool from Microsoft.pdf

• Nicky van Vroenhoven
• Daan Humblé

Optimizing Your Power BI Workflow with Project Files, Source Control, and TMDL

Imagine you're part of a dynamic analytics team at a rapidly growing tech company. Your team relies heavily on Power BI to create insightful reports and dashboards that drive key business decisions. However, as the volume of data increases and more team members contribute to the projects, you start encountering challenges: messy project files, difficulty in tracking changes, and complex data models that are hard to manage.
One day, your team lead calls a meeting. She shares a story about another department that faced similar issues but managed to turn things around. Their secret? Implementing a structured approach to managing Power BI project files, using source control to track every change, and leveraging Tabular Model Definition Language (TMDL) to handle their complex data models. Inspired, your team decides to adopt these practices.
Fast forward a few months, and your team's workflow has transformed. Projects are well-organized, changes are easily tracked, and data models are efficiently managed. Reports are more accurate, collaboration is smoother, and your team's productivity has soared. This presentation will guide you through these strategies, showing you how to replicate this success in your own Power BI projects.

In this session, I will guide you through these strategies, demonstrating how to replicate this success in your own Power BI projects.
By the end of this session, you will be equipped with practical knowledge and tools to optimize their Power BI workflows, ensuring their data analytics projects are well-organized, versioned, and scalable.
We will start with a regular PBIX-file and gradually transform it into an organized, versioned model. Using Visual Studio Code, we will set up source control in Azure DevOps with the PBIP-format, apply TMDL and eventually integrate Git into the workspace.
Note: This session assumes a basic understanding of Power BI. Fundamentals of source control and branching will not be covered.

Slide deck etc

Optimizing Your Power BI Workflow - Nicky van Vroenhoven - Daan Humble.pdf

• Alex de Groot

LLMs on (Guard)Rails

In this talk, we explore advanced techniques to ensure Large Language Models (LLM) and Retrieval-Augmented Generation (RAG) applications produce responsible and accurate outputs. We'll delve into methods for minimizing hallucinations and maintaining fidelity to factual data. The session will feature a comparative analysis of approaches from leading cloud and tech vendors, including Microsoft, AWS, Elastic, and NVIDIA.
Attendees will gain insights into best practices for developing reliable AI applications, enhancing user trust, and leveraging the strengths of each vendor's solutions in real-world scenarios. Join us to elevate your AI implementation and learn from real life experience.

Slide deck etc

LLMs on (Guard)Rails - Data Saturday.pdf

• Cláudio Silva

X-Raying Schema Operations: Adding and Removing Columns

As database developers and/or administrators, we often encounter the need to make schema changes to tables. These changes involve various operations, such as adding or removing columns.

Understanding the inner workings of these operations may be crucial. Why are some changes quick and seamless, while others can significantly impact system performance?

In this session, we'll delve into SQL Server internals to explore the processes involved in adding and removing columns. We'll examine the intricacies of these operations, including their utilization of the transaction log, the locking system, and space management. This exploration will unravel their impact (or lack thereof) on system resources and performance.

Is adding a new column always a slow and a blocking operation? And what about dropping a column? Will this single action immediately reclaim the used space? Let's explore these and other questions together.

By gaining insight into these specific examples, you will be better equipped to manage similar schema changes effectively in your database environments.

Slide deck etc

X-Raying Metadata Operations.zip

• Ásgeir Gunnarsson

Microsoft Fabric architecture

Many people have heard about the Medallion architecture (gold, silver and bronze). When you start working with Microsoft Fabric is that really all you need to know about how to architecture your solution? The short answer is maybe, the long answer is probably not as there are many things to consider.

In this session we take an outset in the Medallion architecture and from there talk about different challenges and how to overcome them.

We will talk about how to organize us in Fabric. What workspace strategy you choose in Fabric will impact how you build your Medallion architecture and how you work with Fabric.

We will talk about DevOps. How you work with DevOps will impact how you build your Medallion architecture and how you work with Fabric.

We will talk about migration of older data warehouses and how that might impact the way you architect your solution. This includes how you address new opportunities that come with going from a relational data warehouse to a lakehouse.

At the end of this session the audience will understand better what architectural challenges there are in Fabric and what possible solutions there are. There is no such thing as one size fits all but adapting a thoroughly tested framework is often the most efficient solution.

Slide deck etc

FabricArchitecureAsgeirGunnarsson.pdf

• Enrico van de Laar

Data privacy for data professionals

We live in an exciting time where data is everywhere and available to everyone. A large portion of this data consists of privacy sensitive data. And as someone that works in a role that deals with data every day, we are pretty sure you have seen your fair portion of sensitive data in the environments you work in.

In the last couple of years there is a clear growth in privacy awareness among the individuals of whom you are processing privacy sensitive data, together with an increase in legislation. This not only means data privacy protection is more important than ever, but also that there are huge new opportunities for your organization to differentiate itself from its competitors.

In this session we are going to explore why data privacy is so important and what you – as a data professional – can do to protect it. Because ultimately, you are in the perfect position to understand what the impact data privacy protection can have on the data and its usage. Don’t worry, we are keeping the legal bits to a minimum and instead focus on practical examples and use-cases you can directly implement inside your environment.

• Grant Fritchey

SQL Server Query Performance: Common Problems, Possible Solutions

Identifying which queries are running the slowest, or using the most resources is relatively well documented. However, once you identify the query you need to fix, what are you supposed to do next? This session will walk through a bunch of the most common performance problems and how you go about identifying those problems. From there, we'll discuss some possible solutions for those problems as a way to move you more quickly to a more highly performing database.

• Kay Cordewener

Harnessing Microsoft Purview for Data-Driven Success: A Deep Dive into Governance, Risk & Compliance

Are you struggling to unlock the full potential of your organization's data? Join us for a comprehensive exploration of Microsoft Purview and discover how it can revolutionize your data management strategy.

In the Sogeti hosted session, Kay Cordewener delves into the Microsoft Purview Data Catalog and its powerful capabilities for:
Data Governance: Establish clear policies, standards, and controls to ensure data quality, consistency, and compliance.

Data Mesh or Hub-spoke: Enable a decentralized approach to data management, driving agility and innovation across your organization.
Data Security and Risk Management: Protect sensitive information, mitigate risks, and comply with industry regulations.
Why attend this session?

Gain actionable insights: Learn practical strategies to optimize your data management processes and drive better business outcomes.
Discover the latest trends: Stay ahead of the curve with the latest advancements in data governance, security, and compliance.
Network with industry experts: Connect with like-minded professionals and share best practices.

Don't miss this opportunity to learn how Microsoft Purview can help your organization achieve its goals and maximize the value of your data.

• Marjolein Opsteegh

6 tips to build an End-User friendly dashboard

In this session, I will give you 6 tips to build a dashboard "they won't ignore".

Even if you have built such a beautiful dashboard, if your users ignore it, or if the users don’t know what hidden functionalities it contains, it won’t be a success.

During end-user workshops, I‘ve seen huge differences in the speed of adaptation. One clicks around as if he built it himself while the other needs to be taken by the hand and a manual for later.

It is very important to build your dashboard in a structured and predictable way, clutter-free, so the user experience is positive.

In this interactive session, we look at the various options that you have, as a dashboard builder, to make the use of the dashboard easier for all end-users.

This session is intended for dashboard builders and is suitable for all skill levels.

Think about,

✔ The critical importance of alignment in design

✔ How to maintain consistency in color and fonts for a polished look

✔ Effective use of blank buttons for seamless page navigation

✔ Leveraging tooltips to provide user guidance

✔ The significance of adding a homepage to enhance dashboard accessibility

Don't miss out and take your dashboard projects to the next level!

Slide deck etc

Data Saturday - 6 tips to build an End-User friendly dashboard.pdf

• Alexander Arvidsson

Knee-Deep In Tech Live @ DataSat Holland

We'd like to record an episode of Knee-Deep in Tech live at Data Saturday Holland! The episode is ~ 45 minutes and recorded in front of a live audience. The audience will get to be part of the episode in several ways, and the hosts will take questions that will be discussed in the episode.

• Erwin de Kreuk

Mastering Data Efficiency with Nitrogen Control Center for Microsoft Fabric

In today’s data-driven world, effective data processing is crucial for ensuring data quality, compliance, and security. Join us for an in-depth session on the Nitrogen Control Center for Microsoft Fabric, presented by InSpark. This session will explore how the Nitrogen Control Center empowers organizations to seamlessly manage and govern their data across the Microsoft Fabric ecosystem.
Discover how the Nitrogen Control Center streamlines data processing, providing real-time insight into your data streams and saving up to 80% of your development time. With a reduced emphasis on data integration and an increased focus on business value, this tool is seamlessly integrated with Microsoft Fabric to enhance your data management capabilities.

• Mark Streutker

Unseen Failures: Adventures in Data Pipeline Testing

In today’s data-driven landscape, ensuring the reliability of data pipelines is a complex challenge. This presentation will give a brief overview of Test-Driven Development (TDD) and Behavior Driven Development (BDD) methodologies as key approaches to enhancing code quality and ensuring alignment with business requirements. Furthermore, the presentation will cover the growing importance of Data Observability, highlighting how it plays a crucial role in proactively monitoring and validating data flows. We will demonstrate the use of tools like pytest, behave, and Great Expectations to implement effective data testing and monitoring solutions.
Join this session to gain actionable insights and practical strategies to enhance the reliability of your data pipelines in the face of unpredictable data challenges.

Slide deck etc

Data Saturday - Unseen Failures - 2024-10-05.pdf

• Mathias Halkjaer

Advanced Power BI refresh in Fabric

Want to refresh your Power BI Datasets in ways the service doesn't allow you to, out of the box? There are a few reasons why the UI in Power BI isn't sufficient for optimal dataset refreshing in Power BI.

In this session, you will tag along the journey of working towards a solution to this problem. We go through the journey of a real-life case where a Power BI set-up ended up needing advanced refresh handling.

After this session, you will be able to conceptualize and implement different Power BI refresh scheduling patterns with pipelines. You’ll learn what limitations in Power BI you can overcome with the Fabric orchestration tool as well as the different building blocks available. Finally, we will go through an example implementation as well as a step-by-step demo of how you can set this up yourself.

Topics:
- Why use a different orchestration tool than Power BI own refresh capabilities?
- Exploring the toolbox – what options do we have?
- Example implementation: Asynchronous Power BI refresh schedules orchestrated by pipelines
- Demo: How to set it up in practice

• Enrico van de Laar
• Tomaž Kaštrun

Crazy Data Science

Data is one of the most valuable assets to any company right now and you can gain a corporate advantage through the insights your data can provide. Many organizations are leveraging the power of statistics, Big Data and Machine Learning on a daily basis to optimize their products or achieve their strategic goals. Thankfully for us there are also more creative - real-world - challenges we can solve using the same methods as those organizations.

For instance, have you and your friends ever wondered who wouldn’t make it to the end of a horror movie? Or how to best prepare for a date as a data aficionado? If any of those questions make you raise your eyebrows and tickle your curiosity you’re ready for Crazy Data Science!

In this session we are going to apply real Data Science methods and techniques with the ultimate goal of solving mankind’s greatest mysteries. And while we are at it, we believe we can even teach you a thing or two about the world of Data Science!

• Heini Ilmarinen

To Bicep or to Terraform - That is the Question

If you're getting started with an implementation using Infrastructure as Code, one of the first things to figure out is which tool to use. When working with an Azure data platform solution, the most common options that come up are Bicep and Terraform; therefore, this session will dive into the details of the differences of Bicep and Terraform to help you choose the best option.

We will begin the session by going through the similarities of Bicep and Terraform, but will then jump straight into comparing these two tools. We will cover how state is handled, how configuration is scoped and how making changes is evaluated. Then we will go through how existing resources are handled and using preview features. At the end of this session you will be able to choose which tool is the best option for your implementation!

Slide deck etc

DatasatHol_BicepvsTerraform.pdf

• Kasper de Jonge

Fabric security: everything you need to know!

Microsoft Fabric is an all-in-one analytics solution for enterprises that covers everything from data movement to data science, Real-Time Analytics, and business intelligence. It offers a comprehensive suite of services, including data lake, data engineering, and data integration, all in one place.

Microsoft Fabric is a SaaS (Software as a Service) platform which works differently than a PaaS (Platform as a Service) like Azure. With the Fabric SaaS service, you are getting a lot of security features out of the box that you might now be aware of to allow you to secure your data estate.

In this session we will look at how Fabric secures your data, we will look at all the aspects of security of the Fabric platform:
- Understand how users authenticate,
- Understand inbound security options ,
- How can you access your secure data,
- Where and how is your data stored and where does it go when used,
- How to make sure your data is only accessible for certain users.
- Finally, how to govern your data with Purview integration.

This will make sure you understand what you get out of the box with Fabric and have the discussion with your security team!

• Hugo Kornelis

Approximate functions: How do they work?

Sometimes, a close approximation is good enough. And sometimes, a close approximation is a lot faster. Microsoft has introduced “Approximate Query Processing” (the APPROX_COUNT_DISTINCT and APPROX_PERCENTILE functions) to give you exactly that benefit when you don't need exact answers.

But do you have a good response when you propose to use this function and your manager asks you to explain how they work first? Or is your only option to claim "black magic by smart Microsoft engineers"?

The algorithms used are not a secret. HyperLogLog and KLL Sketch. And now you most likely know exactly as much as you already knew before. And when you google for those terms ... you end up with a headache.

Time to join me for a session where I explain the black magic in the simplest possible terms, so that you can then explain it to your manager!

• Marc Lelijveld

Visual Calculations: Making DAX easier

This is it. The day that the way that DAX became easier. After this, how you write DAX changes forever. Learn all about it in this session! The Power BI team has been working on exciting things related to DAX calculations, specifically targeted at making it easier to add typical business-type calculations (such as running totals or vs-first). Would you believe it if we told you that you don’t even have to type DAX anymore and still be able to get complex calculations done quickly? In this session, we will talk about this exciting new feature!

Join this session to learn more about this new feature which will make writing DAX statements so much easier and faster. Get ready to get your mind blown! See the future, today.

Slide deck etc

20241005_Power BI Visual Calculations - Marc Lelijveld.pdf

• Gabi Münster
• Sarath Sasidharan

Govern your Data on Fabric and Beyond

In the ever-evolving landscape of governance, where agility, transparency, and efficiency are paramount, the integration of cutting-edge technology becomes imperative. Enter Microsoft Fabric – a transformative platform designed to revolutionize data democratization. This pre-conference session serves as an immersive exploration into the governance capabilities within Microsoft Fabric.

Throughout this session, participants will delve into the multifaceted dimensions of governance, understanding its complexities and challenges in contemporary contexts. By leveraging the power of Microsoft Fabric and Microsoft Purview, attendees will uncover innovative strategies to streamline decision-making processes, enhance compliance frameworks, and foster greater accountability.

• Ola Hallengren

SQL Server 2022 Performance Enhancements

In this session we are going to look at the performance enhancements in SQL Server 2022. We will cover the most important enhancements in the optimizer (intelligent query processing), storage engine, Accelerated Database Recovery, availability groups, Query Store, stack dumps and some more.

Which problems are the features solving? How are they doing it?

I will share some real-world experiences of the features, from running SQL Server 2022 on mission-critical databases.

• Holly Smith

The Data Engineers' AI Survival Guide

I have a hypothesis, that 90% of people doing AI today weren’t doing it two years ago. The landscape is full of people stumbling their way through it, from the AI academics learning that code for papers is not software development ready, all the way to data experts suddenly needing to learn a new skill.

In this talk, I’ll go through what data engineers need to know to help get those AI projects off the ground. Starting with picking the right projects, execution plans, through to toolsets and skills that will make you shine.

Slide deck etc

The Data Engineers AI Survival Guide Shareable Download.pdf

• Linda Torrång

Empowering Success: Focusing on End-User Engagement with Power BI

How do we effectively demonstrate the value of Power BI to our business users?

When implementing Power BI into a business, the end users are often told when the decision has already been taken. Leaving them with the information that they must abandon their current methods of working with data to simply embrace using Power BI instead. However, without proper information and engagement with these users from the start, driving adoption becomes a significant challenge.

If reports and dashboards are not being utilized, it is our responsibility. There may be various reasons for why this fails, regardless of the reasons, what truly matters is addressing the issue and finding solutions and preventing this failure from happening again in future. Tools are just that - tools to achieve an outcome. In the case of Power BI, the desired outcome is to empower business users to extract more insight and create more value from the data they work with on a daily basis.

This session will emphasize the importance of user enablement, ensuring users understand not just how to use the tool, but much more important: why it is being implemented and how it will serve their needs better in the first place. Why do we want them to leave the safe haven of Excel? What value does a single point of truth bring? Why does this matter to THEM?

In addition, I will showcase some user-centric features designed to enhance adoption in Power BI, to empower users to feel engaged in a data-driven environment.

Slide deck etc

Empowering success.pdf

• Sam Debruyn

Fabric Capacities: Divide and Conquer

A single Fabric Capacity is easy to set up. But what about the risk of a single user taking down your entire data estate with a poorly written query? In this session, we’ll explore how to split and configure Fabric Capacities for different workloads. Autoscaling, auto pause, bursting, smoothing, monitoring, and more. We’ll cover it all. By the end of this talk, you’re ready to build a scalable and robust design Fabric Workspace and Capacity design for the entire organization.

Slide deck etc

datasaturdaycapacities.pdf

• Shasidhar Eranti
• Kamalendu Biswas

Ingesting and Transforming Streaming Data Using dbt and Databricks

Data ingestion is the process of obtaining and importing data from various sources for immediate use or storage in a database. It is a crucial first step in building a data platform, as it sets the foundation for data processing, analysis, and visualization. A robust data ingestion layer ensures that data is accurately and efficiently collected, transformed, and loaded into the system.

However, for users of dbt (Data Build Tool), a popular command-line tool for data transformation, data ingestion can be a challenging task. Dbt is designed primarily for data transformation, and it lacks some features for data ingestion. This is where the integration with Databricks, a data and analytics platform, comes in.

The session will discuss the strong integration between dbt and Databricks, and how they can be used together to build a robust data platform. It will also cover different architecture patterns for using dbt and Databricks together, based on the experiences of their customers.

Additionally, the session will delve into newer features in the latest dbt-Databricks release, which will further enhance the data ingestion and transformation capabilities of the two tools. Finally, the session will conclude with an end-to-end demonstration of the latest ingestion capabilities, showing how users can leverage the power of dbt and Databricks to build a robust data platform.

Slide deck etc

Data Saturday Holland_ dbt with Databricks.pptx.pdf

• Valerie Junk

From data to action: Driving decision-making with Power BI

Let's face it; there are probably not many people designing dashboards and reports just to have something pretty to look at. Companies asking for dashboards want to get insights and eventually take action with these insights.
Many Power BI dashboards companies use do not fully fulfill this need. Often there is data, which is good, but taking action and taking the next step with the insights needs many additional steps... When we take a step back, the dashboards were intended to lessen the workload and not add to the workload.

In this session, "From Data to Action," I will show how you can visualize the data in a way that helps companies to take the next step. Often, this is not complicated, and you don't need to buy additional tools. Just some visual tweaks will go a long way!

Also, this session will focus on asking the right questions and tailoring the design to your audience. So it's a mix of visuals, examples, and theory about choosing the right design to answer the (actual) question.

Whether you are a business analyst, a data enthusiast, or a decision maker, this session will help you to bring your dashboards to the next level. It will also help you to communicate more clearly to the team what you are looking for, even if you don't know everything about Power BI and dashboard design.

Slide deck etc

202410 - Data Saturday Holland - From data to action Driving decision-making with Power BI.pdf

• Alexander Arvidsson

Not My Problem(?) - Azure Networking 101 for Azure SQL Server DBAs

The unofficial scapegoats of the the IT world has always been "the network" or "the database". The traditional way of doing things on-prem has unfortunately added to this divide - either you're a networking specialist or a DBA, and very rarely will the same person do both jobs.

As an on-prem DBA, chances are that you never had to think twice about which network the database was in, what kind of endpoint was used for the traffic or how the firewall was configured. In Azure, things can get rather complex pretty quickly - especially when working with the platform-as-a-service (PaaS) version of Azure SQL Server. That is why it is important to have a solid understanding of basic networking in general and how it relates to the platform as a service in particular.

This session will walk you through the basics of networking, explore the concept of virtual networks and firewalls, and explain the use of endpoints - all from the perspective of Azure SQL Server. We will be looking at both how the technical components work, and also why one would choose a specific design in favor of another.

If you've been reluctant to fiddle with the networking settings of Azure SQL Server, then this is the session for you!

• Reitse Eskens

Code, deploy and maintain your Azure (data) Infrastructure with confidence

Have you been deploying your Azure databases and all connected resources through the portal?
Are you fed-up with clicking, weird resource naming and mostly, with having to deal with changes manually?

If you are working in Azure and you have anything to do with data, security and the infrastructure, this session is for you!

Azure Infrastructure as Code offers a plethora of possibilities, but the first time I checked it out, all I saw were Azure Resource Manager (ARM) templates. Hard to read, harder to write. They gave me headaches. It seems I wasn't the only one with that problem, because there are excellent tools to help you out! My favourite, and the one I'm using in this session is Terraform.

Now why is this presenter talking about this? I've deployed a number of customer environments with this language. Whenever there's a security update, like a new policy for example, I can deploy this to all customers in minutes. I'll only have to code this once and can easily deliver it many times, saving them time and money. Resources we can spend in other areas like ETL, ELT etc.

During the session, I'll demonstrate the basics of a data deployment, following the spirit of the Microsoft Well Architected Framework. I'll show you my way of working, the structure and and the end result. As securing resources and data is paramount in any cloud solution, it'll have plenty of attention in this session as well.
There is no need to try and photograph what's happening on screen, all the scripts will be available after the session.