This technical talk will provide an overview of Apache Beam, an open-source, unified programming model for batch and streaming data processing pipelines that simplify large-scale data processing dynamics. Thousands of organizations around the world choose Apache Beam due to its unique data processing features, proven scale, and powerful yet extensible capabilities.

A data engineer can select a programming language from a variety of language SDKs: Java, Python, Go, SQL, TypeScript, Scala (via Scio), or leverage multi-language capabilities to empower every team member to write transforms in their favorite programming language and use them together in one robust, multi-language pipeline. Apache Beam eliminates the skill set dependency and helps avoid becoming tied to a specific technology skill set and stack.

The talk will be useful for those interested in learning about Apache Beam and its capabilities for batch and streaming data processing jobs.