Being able to run pipelines in parallel is one of the major benefits of data pipelines, but whether in Microsoft Fabric, Azure Synapse or Azure Data Factory parallel runs may also cause trouble. In Microsoft Fabric we may even have pipelines breaking if we do not manage parallelism carefully.

In this session, we explore the potential problems with parallelism and cover how to make up for some of these risks by managing parallelism using hierarchical pipelines, REST API, and control flow activities. All of this is delivered together with some of our personal experiences and stories about dealing with pipeline design problems.

After attending this session you should know about some of the pitfalls of parallelism and solutions to making sure your pipelines run smoothly.

Topics:
- Data integration design
- Hierarchical pipelines
- REST API endpoints for Data Pipelines
- Control flow activities