Data Engineering in the era of Microsoft Fabric en

I need to be honest: I am a Data Engineer (DE) by heart and SQL is and was my first language of choice!
During my years of professional data wrangling, I went through different waves of DE technologies and hypes.
Since May 2023, a new analytics toolset went into the market: Microsoft Fabric and with it - a way of data massage (or should we call it data wrangling?).
In this session, I will show you the possiblities to get data into Fabric, how to massage your data entities and which options we found out are good to use and others maybe not.
You do not need to know Microsoft Fabric beforehand, I will present the foundational pieces too.
After this session we all should know more about the different Data Engineering options in Microsoft Fabric and when to choose which one.

More than "just" a Data Catalogue - Wirlwind Tour through the Microsoft Purview Universe en

First there was Azure Purview, then the name was changed to Microsoft Purview. And with that name change, the scope of the product was extended to included the Microsoft 365 services dealing with Compliance, Information Protection, Data Loss Prevention, Insider Risk Management and much more.

Join this session, where I will guide you through the Microsoft Purview universe and show you the possibilities of the Microsoft Purview universe.

Let's talk about Data Governance and how Microsoft Fabric brings it to a next level. en

Data Lakes, Lakehouses, Data Warehouses, Data Integration pipelines, notebooks and much more. Data is transformed, stored and reported using more and more technologies. For us as data professionials it is not easy to gain an overview about your data (analytics) landscape.
With Microsoft Purview data catalog, we got a tool to do the inventory of your data landscape, classify data and track lineage.
With Microsoft Fabric, we got an integrated SaaS analytics platform that contains (almost) everything: Data integration, data storage, data lake houses and warehouses and integrated Power BI reporting. How does this approach change in context of data cataloguing? How can we benefit from the integrated approach to get a better understanding of what happens to our data?
Join this sesion to learn more about the concepts of a data catalog, how Microsoft Purview implements this and how Data Governance and Microsoft Fabric work better together.

My 10 favorite Azure Synapse features en

We've got 10 minutes and I want to share my 10 favorite Azure Synapse features with you.
Lean back, enjoy the demos and join me for a whirlwind tour through the Synapse universe!

About the journey to find the best beef ah..data in your organization - And how Azure Purview helps en

To know your data estate and where data of a certain kind is stored and processed is one of the main pillars of data governance. A data cataloguing tool is the answer to solve these questions in an (semi-) automated way.
Azure Purview was introduced to support you on your journey to a better understanding of your data systems, their dependencies and how easy it is to find the (beef/bratwurst/tofu/vegetable) data!

When the standard UI is not sufficient - Azure Purview and the Apache ATLAS API en

Azure Purview has been introduced as the unified Data Governance service. Getting new sources and features every few months, the supported system landscape was broadened.
Sometimes however, the standard sources and features are not sufficient - for example you need to catalogue a system that is not supported by Purview itself. Or you need to query data catalog data from Purview to build documentation or beautiful dashboards.
In these cases, the Apache ATLAS is your friend: with the deep integration into Azure Purview, you are able to extend your data catalog, add and modify data assets plus query data from the Purview data map.
Join this session to get an overview about what is possible and discuss some ideas how the Apache ATLAS API could be used together with Azure Purview.

Data Governance with Azure Purview - Ask the Experts en

In this open session, it's your chance to ask our panel of 3 MVPs about data governance for your business using Azure Purview. Join Victoria, Wolfgang and Erwin as they answer YOUR questions. Submit your questions in advance here https://forms.office.com/r/dTP38LnmsJ
#SQLBitsDGQuestions

Feedback link: https://sqlb.it/?7347

SQL Server Developers - Come and meet Azure Synapse Synapse Analytics, your new home!? en

SQL Server and T-SQL are long time members of the BI and database development world. With the move to the cloud, more and more options were added to the data platform development space.
SQL Server developers, join this session to learn how Azure Synapse Analytics and its parts work together and how you start your Analytics journey in the cloud

Data Governance with Azure Purview and Power BI en

Sometimes, when we talk about governance we discuss if a list of Power BI workspaces is enough governance? Is the Lineage view in Power BI the best of breed?

Join this session if you want to learn more about data governance:
* What is it? Where to start?
* How to start in the context of Power BI and data governance? Is the data governance journey an all-or-nothing decision?
* Learn more about Azure Purview and how it works together with Power BI.

Join this session if you want to hear from our experience of bringing data governance (together with our customers) to a successful start!

Data Governance with Azure Purview in Demos only en

Where and how to start with Data Governance? Is Azure Purview a/the right tool to get into Data Governance?
In this session, Wolfgang guides you through the Azure Purview possibilities - configuring sources, defining scans and rule sets, data classification, business glossary, data lineage, integrations, roles and policies.
Join this session if you want to get a feeling, if Purview is the right choice for you to get into Data Governance on Azure. We'll discuss the current available feature set, the things missing and maybe some integration points you've not known before.

There will be no slides - just Azure Purview & yourself & Wolfgang!

Data Governance with Azure Purview - Theory, Customer Insights and Demos en

Many of us think that Data Governance is a technical problem to solve, but it takes more than just tools to make your Data Governance initiative effective. Only with well defined processes, a set of policies and people with defined roles the solving technology can lead to success.

Join this session to
* learn about the data governance definition, the processes involved, people and their roles as well as policies to define the interaction with your data.
* hear about the experiences from our customer data governance workshops and projects
* see one of the possible technologies - Azure Purview - in action: Data Catalog, classification, business glossary, central policy definition as well as data lineage browsing.

After this session, you should know more about the data governance theory, you've seen Azure Purview in action and heard about the steps we've already solved together with our customers.

Data Governance in a Nutshell – From Theory to Hands-On with Azure Purview en

Data is important for every organization. To know your data estate (systems), their dependencies, the responsible people and processes takes your company's data literacy to the next level.
This topic is called Data Governance, which includes two main streams: a) the organizational processes and policies and the b) the technical tools to support the organizational processes.

Many of us think, that Data Governance is a technical problem to solve, but I would start the Data Governance day with an explanation what DG is. We will talk about the people involved, the processes needed, policies that should be in place and the technology so support the processes.
The overall Data Governance vision and strategy will also be discussed.

After the DG theory part, we will dive into a Data Governance tool - Azure Purview. In the Hands-On lab we will connect to data sources, configure scans, see how Purview classifies data, assign and work with a business glossary, work with & analyze data lineage and see the Purview data catalog in action.
In the last part of the day, we will see Purview integration in action - the Apache ATLAS API will be presented as well the integration into Azure Data Factory and Azure Synapse Analytics.

At the end of the day, attendees should have a feeling about what Data Governance is, the organizational requirements as well as a first look into Azure Purview and how a technical answer to these questions can look like.

My favorite 10 Azure Synapse Analytics features en

Azure Synapse allows you to analyze data of different formats, volumes and sources under one umbrella - the Synapse workspace. You can decide if you want to use SQL, spark or Data Explorer analytic runtimes.
After a few years of customer projects using Synapse Analytics, I want to share my Top 10 features with you. See and feel Synapse in action and demos!
Btw: What is your favorite Synapse Analytics feature?

Best friends? Let's talk about the Relationship of Power BI and Azure Synapse Analytics en

Azure Synapse Analytics is the new star in the cloud data analytics field.
With the goal of combining enterprise data warehousing and Big Data analytics, this service provides an end-to-end solution for data analytics in the cloud.
In the past years, Power BI development was the rising star in the business intelligence field, and with Synapse Analytics a new chapter was added to the data story.
In this session, I would like to provide an overview of the Synapse architecture, the technologies that are similar to Power BI concepts, and how you - as a Power BI developer - can leverage Azure Synapse Analytics to bring your Power BI environment to a next level.

Ach, wo hab' ich nur meine Kundendaten wieder abgelegt...? en de

Daten, Daten, Daten... überall nur Daten..
Wo aber sind unsere Kundendaten abgespeichert?
Es sind oft die Kleinigkeiten welche uns das Datenleben erschweren - mit einem geeigneten Werkzeug - vielleicht einem Data Catalog !? - könnten wir uns hier das Leben erleichtern.
Mit Azure Purview schickt Microsoft ein Data Governance Werkzeug ins Rennen, welches wir in dieser Session beleuchten werden. Was kann es bereits? Was fehlt noch?
Und - ist es mir das überhaupt wert?

Data what? Why you should govern you data! en

Collecting data is one part of the story. Know you data estate is another part. Let's see how Azure Purview can help you to manage and govern your data estate and bring it to another level.
No matter if the data resides in a database, SAP, Power BI or a datalake - Azure Purview can scan and help you classify your data estate.

Azure Synapse Analytics: (Not only) for the Power BI Developer en

Azure Synapse Analytics is the new star in the cloud data analytics field.
With the goal of combining enterprise data warehousing and Big Data analytics, this service provides an end-to-end solution for data analytics in the cloud.
In the past years, Power BI development was the rising star in the business intelligence field, and with Synapse Analytics a new chapter was added to the data story.
In this session, I would like to provide an overview of the Synapse architecture, the technologies that are similar to Power BI concepts, and how you - as a Power BI developer - can leverage Azure Synapse Analytics to bring your Power BI environment to a next level.

Connect your data artifacts with Azure Synapse Analytics en

In human brains, synapses are responsible to connect information pieces together. Over time, our knowledge increases when more and more synapses are connected together. Following that analogy, Azure Synapse Analytics wants to connect (all) information silos together and provide a single point of analytics.
Join this session, if you want to hear about the building blocks of Azure Synapse Analytics, how Data Engineers and Data Scientists and even BI developer can work together in a single service and see how easy it is to start with Synapse Analytics!

How to start with Azure Synapse Analytics - Power BI Developer Edition en

In many cases, Power BI developers are often focused on the possibilities available in the Power BI universe. With Azure Synapse, a broader field for data transformation and integration is opened. What are new parts of the workspace that could be of interest and what are pieces you - as a Power BI developer - are already familiar with?
Join this session to get an introduction to Azure Synapse Analytics for the Power BI Developer!

Continuous Integration for the BI Developer en

In many cases and BI projects, the manual process of development and especially deployment of artefacts led to sleepless nights, emergency hotfixes, grey hair and many hours of stress.
Especially in BI development, the usage of database projects, unit testing, version control, continuous integration and deployment is an underrepresented area.
Join me in this demo-heavy session where I will guide you through the not-so-frightful jungle of continuous integration using SQL Server database projects, SSIS, T-SQLt and Azure DevOps etc.
After this 60 minutes you'll have the guidelines and some ideas how easy it is to change your manual BI development and deployment into a powerful and automated no-brainer that - just works!

PowerPlatform Dataflows –PowerQuery (and more) in the Cloud en de

With PowerPlatform dataflows, users can bring PowerQuery functionality to a cloud-only life. Created in the cloud, processed in the cloud and storing results in the cloud, dataflows can be seen as cloud native part of the ETL within the PowerPlatform.
After their initial start in the Power BI universe, they now reached out into other parts of the PowerPlatform and be one of the future options of ETL pipelines to transfer data into data lakes.
In addition to data transformation, dataflows can be enriched with AI functionality to bring more ML power into your ETL processes.
Join this session if you want to learn more about the current feature set available and see what is new and possible with data preparation in the cloud with PowerPlatform dataflows.

Power Platform Dataflows - PowerQuery (und mehr) in der Cloud en de

Mit den PowerPlatform Dataflows können Benutzer PowerQuery Prozesse in eine cloud-only Architektur überführen. Mit der Erstellung, der Verarbeitung und auch der Speicherung der Ergebnisse in der Cloud können die Dataflows als der cloudbasierte ETL Teil der Power Platform gesehen werden.
Nach dem Start im Power BI Universum, finden sich nun Dataflows auch in anderen Bereichen der PowerPlatform. Ein wichtiger Schritt in Richtung ETL pipelines ist gemacht, aber wo stehen wir heute und vor allem: wo wird die Reise mit den Dataflows hin gehen?

Einige dieser Fragen werde ich in meiner Session behandeln und mich dem Thema Datenaufbereitung in der Cloud mit den Powerplatform Dataflows im Detail beschöftigen.

The Microsoft Power Platform - What is it? en de

The term "Power Platform" was introduced by Satya Nadella and James Philips as the serving foundation for building powerful (cloud-baked) applications with PowerApps, Power BI and Microsoft Flow. Join me in this session to learn more about the super-powers of the Power Platform.

Let your data flow - Introducing Power BI dataflows en de

Power BI serves as a self-service BI platform with a strong focus on data preparation and interactive analysis. With the introduction of Power BI dataflows, self-service data preparation is brought to a new level using well-known and established technologies.

Hybrid Power BI - What is possible? What do you need? en

Power BI as a cloud-based SaaS solution is not limited to cloud data sources. In many projects, hybrid architectures are the key to successful projects using already existing infrastructure.
Besides the on-premises data gateway, there are additional options how a hybrid approach can bring benefits and lead to better solutions.

The Current State of Microsoft Reporting en

With the announcement of the Reporting Roadmap in 2015, Microsoft defined the fundamental concepts of their reporting future. The basic principles in this "reporting manifesto" are: harmonized report types (paginated, mobile, interactive and Excel reports); cloud and on-premises feature parity; SQL Server Reporting Services (SSRS) are the on-premises report distribution platform; and unified mobile experience. SQL Server/SSRS 2016 was the first step into the reporting future; the story continued with SSRS 2017 and with Power BI ReportServer (PBIRS). This session will look at the current state of implementation. What was planned, what is already available today, and what are the missing points so far?

Die Microsoft Power Plattform - Was ist das? en de

Die eigenständigen Technologien PowerApps, Power BI und Microsoft Flow sind erwachsen geworden und arbeiten als Power Plattform stärker denn je zusammen!
In dieser Session werden die einzelnen Teile der Plattform aber vor allem das Zusammenspiel in zahlreichen Demos vorgestellt.

Die Power BI Dataflows - Datentransformation in der Cloud und im Data Lake en de

Power BI ist die Self-Service BI Plattform von Microsoft mit einem starken Fokus auf die Datenaufbereitung, -transformation und interaktive Datenanalyse. Mit den Power BI Dataflows wird die Self-Service Datenaufbereitung in die Cloud gehoben, die Wiederverwendung gestärkt und der persönliche Power BI Data Lake befüllt.
In dieser Session wird das Konzept der Power BI Dataflows vorgestellt, die Unterschiede zu Power Query in Power BI datasets herausgearbeitet und die Möglichkeiten und Konzepte vorgestellt.

Let Me Automate You - Take Power BI To The Next Level en

In the early days, Power BI was placed as a self-service BI tool but as the userbase and deployment sizes within organizations grew, the need for Power BI automation got more important.
Join this session to learn how common Power BI administration tasks can be automated using the CLI, PowerShell and C#, how Azure DevOps can work together with Power BI for continuous integration and in addition, learn how create Power BI artefacts in an automated way.

In the early days, Power BI was placed as a self-service BI tool but as the userbase and deployment sizes within organizations grew, the need for Power BI automation got more important.

Data Governance? Was ist das denn? Und brauch ich das? en de

Daten sammeln kann jeder. Aber einen Überblick über die eigene Datenlandschaft zu bekommen und zu erhalten ist eine spannende Aufgabe.
Betrachten wir gemeinsam Azure Purview und sehen uns die Möglichkeiten an, um unsere Daten zu verwalten, zu katalogisieren und besser kennenzulernen. Und es kommt nicht darauf an, wo und mit welchem System die Daten gespeichert und verarbeitet werden – Azure Purview hilft uns dabei Daten zu finden, zu katalogisieren und zu klassifizieren.

Extend Microsoft Purview with Apache ATLAS APIs en

Microsoft Purview has been introduced as the unified Data Governance service. Getting new sources and features every few months, the supported system landscape was broadened.
Sometimes however, the standard sources and features are not sufficient - for example you need to catalogue a system that is not supported by Purview itself. Or you need to query data catalog data from Purview to build documentation or beautiful dashboards.
In these cases, the Apache ATLAS is your friend: with the deep integration into Azure Purview, you are able to extend your data catalog, add and modify data assets plus query data from the Purview data map.
We will talk about the Apache ATLAS, Eventhub, Kafka and Excel yes! Excel will be included.
Join this session to get an overview about what is possible and discuss some ideas how the Apache ATLAS API could be used together with Microsoft Purview.