In an era in which real-time data defines competitive advantage, developing scalable and resilient streaming applications has become both essential and increasingly complex. Effective cost management for maintaining such applications plays a pivotal long-term role in ensuring sustainability and performance.

This session explores the key components influencing cost in the development of streaming applications and outlines strategies for customization based on varying data volumes and system criticality. We compare the computation of streaming costs across leading cloud providers—including Azure, AWS, and GCP—as well as open-source streaming engines. Finally, we examine targeted approaches for cost optimization and illustrate these concepts through a detailed practical example.

Knowledge Level - Intermediate for Data Streaming Applications in specific and Data Engineering in general

Target Audience - Senior Software/Data Engineers, Leads, Architects, and Leadership who manage cost

Session Duration - Can customize for lightning talk (15 mins), regular talk (30-40 mins).