Session
High-Throughput Data Enrichment
Point of the talk: To teach developers how to design highly parallelized data enrichment workers that fetch external API data or microservice context without hitting rate limits or blocking downstream consumers.
Duration: 45 Minutes
Detailed Breakdown: Data enrichment often requires stitching incoming telemetry with external user profiles, geocoding APIs, or CRM data. Doing this synchronously destroys pipeline throughput. This talk covers how to build non-blocking enrichment workers using FastStream and Asyncio. We will explore advanced throttling strategies, token-bucket algorithms for API compliance, and how to use Redis as a high-speed caching layer to prevent redundant external network requests. Attendees will walk away with a resilient blueprint for handling thousands of requests per second.
Muhammed Mizaj
Product Engineer at UST Global
Thiruvananthapuram, India
Links
Please note that Sessionize is not responsible for the accuracy or validity of the data provided by speakers. If you suspect this profile to be fake or spam, please let us know.
Jump to top