SSIS Biml BimlScript SQL Server Integration Services SSAS Analysis Services Azure Data Factory azure data studio big data clusters
Ben has been working with SQL Server since SQL Server 6.5, mainly in the BI/Datawarehousing field.
He is a Microsoft Data Platform MVP, a co-author of "SQL Server Big Data Clusters" and "The Biml Book", regular blogger and speaker on national and international events.
Ben has been involved in about 150 BI Projects and is always looking for ways to become more productive and make SQL Server even more fun!
Together with his team at Solisyon, Ben provides training, implementation and consultancy for SQL/BI developers and data analysts in (upper-) mid-market companies around the globe.
Ever heard of modelling techniques like DataVault? Many of those approaches are based on so called ensemble modelling, where the ensemble forms the backbone of the whole architecture.
But... What does that mean?! We'll take a look at what an ensemble is, how to model it, what to avoid and, maybe most importantly, how it can help in designing and running an enterprise Datawarehouse.
You have heard about Biml? Maybe even seen a session about it before but still have doubts, how easy you can make something useful out of it? In this session, we’ll use Biml to build and populate a staging area including the corresponding SSIS packages. But there won’t be any pre-compiled demos! Everything is happening live! Starting with a blank staging database, we’re going to end up with a complete solution over the course of this session, to prove that it is not just easy to adapt existing Biml code but also to start from scratch and still be successful very quick!
Let’s see, how that goes…
There is a natural limit, on how many dataflows you can run in parallel in SSIS. The limiting factor may be the source or the destination and depending on these systems, your mileage may vary a lot. But there are limits. You’ve set up all the orchestration in a way that made sense at that time. But then some tables grew faster than expected. Others did not grow at all. Due to foreign key relationships, you may also not be able to just shuffle the dataflow tasks around in every kind of way. Manual reengineering would potentially be very time consuming – and the result would be obsolete shortly after.
This session is about monitoring and controlling your orchestration based on these restrictions and results using Biml. By automatically analyzing the result of our ETL loggings, we’ll be able to automate our staging orchestration!
With SQL Server 2019, Microsoft is introducing Big Data Clusters to make SQL Server your one stop shop for all your data needs.
In this session we are going to explore the capabilities of the exciting new feature. How does it work and how can we work with datasets that are non-relational?