Session

Your Agent Lies and Passes Every Test

Your agent invents a hotel amenity that was never in the search results. The test says PASS, because all it checked was that a hotel came back. Across a conversation it gets worse: turn one is safe, turn five gives advice it should never give. You get zero-shot detection that needs no labeled data, per-turn scoring that shows drift while it happens, and a lifecycle hook that swaps an unsafe answer for a safe one before the user sees it, plus the monitoring setup to watch it in production.


Outline:
• Introduction: The Silent Failure Problem
• Part 1: Zero-Shot Hallucination Detection
• Part 2: Trajectory-Level Safety Drift Monitoring
• Part 3: Real-Time Guardrails with Lifecycle Hooks
• Production Monitoring and Q&A

Elizabeth Fuentes Leone

Developer Advocate

San Francisco, California, United States

Actions

Please note that Sessionize is not responsible for the accuracy or validity of the data provided by speakers. If you suspect this profile to be fake or spam, please let us know.

Jump to top