Session

Observing Agentic/MCP Traffic & Keeping Costs Low

LLMs and MCP Server tools are at the forefront of every engineering organization when it comes to agentic implementation. That's why there are two major questions that come up.

1). How can we observe metrics, OTel data, and usage.
2) How can we control cost.

Traditional monitoring falls short for AI workloads. Organizations are extending platforms like OpenTelemetry for AI specifically so they can pinpoint failures and hallucinations in LLM interactions along with token usage to understand costs. When using a proper AI Gateway, organizations can accomplish the implementation needs for these needs.

In this session, you'll learn how to use agentgateway to produce Agentic and MCP traffic to get a visualization on what is going on within the environment at the observability level.

Michael Levan

Building High-Performing Agentic and Kubernetes Environments | AI Architect | CNCF Ambassador | 4x Published Author & International Public Speaker

Saddle Brook, New Jersey, United States

Actions

Please note that Sessionize is not responsible for the accuracy or validity of the data provided by speakers. If you suspect this profile to be fake or spam, please let us know.

Jump to top