As we transition from on-premises to the cloud, what becomes of our Change Data Capture solution? This shift presents an opportunity to discover innovative ways to create solutions that stand the test of time. Join us as we delve deeper into the process of integrating SAP data into the Data/Delta Lake, with the reliable Apache Kafka at the center of it all.

Through this solution, you will discover how to combine various components of SAP, AWS, and Confluent. The process begins with real-time replication using SAP Landscape Transformation (SLT). This allows connectors set up on self-managed Kafka Connect clusters in AWS Elastic Containers service (ECS) to extract data from delta-enabled SAP sources. Kafka Streams processes crucial transformations, and the final step is completing the puzzle by constructing the data in the Data/Delta Lake. This way the SAP data can be used for real-time analysis and recommendations in client facing applications.

In this session, we examine the benefits of a strong focus on automation in simplifying the implementation process. From building and configuring Kafka Connect on AWS Containers to establishing Confluent clusters and managing role-based access on Confluent Cloud, our entire infrastructure is set up using Infrastructure as Code with Terraform.