Session
OpenTelemetry for Generative AI applications
The rise of Generative AI and agentic workflows has introduced new challenges in monitoring and observability. Applications powered by large language models (LLMs) involve dynamic interactions across multiple agents, tools, and APIs, creating complex workflows that demand robust monitoring. This session demonstrates how to implement OpenTelemetry in .NET for Generative AI applications, focusing on multi-agent systems and their unique requirements.
Through the lens of a real-world travel agency application, we’ll explore how agents interact to handle flight queries, weather updates, and ticket bookings in a seamless workflow. The session will cover:
- Instrumenting OpenTelemetry in LLM workflows to trace interactions across agents.
- Monitoring iterative loops in agentic workflows to identify bottlenecks and optimize performance.
- Addressing common observability challenges, such as distributed tracing, metrics collection, and logging in generative AI applications.
Divakar Kumar
Technical Architect @FlyersSoft | Microsoft MVP | MCT
Chennai, India
Links
Please note that Sessionize is not responsible for the accuracy or validity of the data provided by speakers. If you suspect this profile to be fake or spam, please let us know.
Jump to top