Session

Beyond the Chatbot: Hardening Asynchronous Agentic Workflows on Cloud Run & Eventarc

The Problem: Moving AI agents from Python notebooks to mission-critical backend systems reveals a harsh reality: traditional request-response micro-services break under agentic workloads. Multi-step LLM reasoning loops introduce long-tail latency, non-deterministic timeouts, and cascading failures across downstream APIs.

The Approach: To solve this, we must decouple synchronous user endpoints from multi-turn agent execution loops. This talk walks through building an event-driven choreography architecture using Google Cloud Run, Eventarc, and Firestore to manage asynchronous agent workloads at scale.

The Proof: I will demonstrate a concrete architectural blueprint where state machines and checkpointing are used to resume agent workflows after mid-execution timeouts or tool-call failures without re-running expensive context tokens.

The Outcome: By adopting event-driven patterns, systems achieve resilient rate-governance, implement circuit-breaking when downstream models degrade, and eliminate synchronous blocking in core services.

The Takeaways: Attendees will learn how to enforce concurrency limits on Cloud Run for LLMs, handle state persistence during agent loops, and implement distributed tracing across agent thoughts, tool invocations, and database mutations.

What is Next: As standards like Google's A2A protocol mature, asynchronous event-driven foundations will become the mandatory baseline for secure, multi-agent interoperability in the cloud.

Snigdha Kashyap

Contributing to #Tech as SDE-2 @ExpediaGroup

Gurugram, India

Actions

Please note that Sessionize is not responsible for the accuracy or validity of the data provided by speakers. If you suspect this profile to be fake or spam, please let us know.

Jump to top