Session
From 100 to 100,000 RPS: Scaling gRPC Services in Production Without Breaking the Bank
This talk presents a comprehensive journey through scaling gRPC services from startup-level traffic to enterprise-scale demands, drawing from real production experiences at companies processing millions of requests daily. Starting with a modest 100 RPS monolithic service, we'll explore the architectural decisions, performance optimizations, and cost management strategies that enabled scaling to 100,000+ RPS without proportional infrastructure cost increases. The session covers critical scaling bottlenecks including connection pooling, load balancing strategies, circuit breakers, and resource optimization techniques specific to gRPC's HTTP/2 multiplexing capabilities. Through detailed performance benchmarks and cost analysis, this talk demonstrates how thoughtful gRPC implementation choices can achieve 10x traffic growth with only 3x infrastructure costs, making it essential viewing for engineering teams planning for scale.
Please note that Sessionize is not responsible for the accuracy or validity of the data provided by speakers. If you suspect this profile to be fake or spam, please let us know.
Jump to top