Ritu Soni
CTO & Co-founder SkillBrew.AI
Jaipur, India
Actions
CTO & Co-Founder building scalable products and cloud infrastructure. An Oracle Certified Java SE and AWS Certified Solutions Architect, with hands-on expertise across AWS, Azure, and GCP. Experienced in DevOps, Cybersecurity, AI/ML, MCPs, LLMs, NLP, and open-source ecosystems, including Kubernetes, Keycloak, Wasm, and ArgoCD. Passionate about Automation, AI, and Agentic Flows that seamlessly integrate with humans to amplify impact.
Area of Expertise
Topics
How to do GenAI/MCP/VectorDB Observability using Prometheus and Grafana
As Generative AI models move into production, traditional observability metrics fall short in capturing model-specific risks such as hallucination, toxicity, or bias.
This session explores how to extend open-source observability stacks—Prometheus and Grafana—to monitor GenAI systems at scale. We’ll discuss designing exporters and dashboards that track model health, including hallucination and bias detection, token-level usage metrics, and request performance (volume, latency, success rate).
Attendees will learn practical patterns for instrumenting LLMs, embeddings, and Model Control Planes (MCPs), integrating model evaluation signals into observability pipelines, and visualizing drift or degradation trends over time. The talk demonstrates a unified approach to trust, transparency, and performance analytics for both new and existing GenAI workloads using cloud-native tools.
Please note that Sessionize is not responsible for the accuracy or validity of the data provided by speakers. If you suspect this profile to be fake or spam, please let us know.
Jump to top