Session
Chaos Testing: When Your Agent Trusts Bad Data
Your tests only cover the happy path, so they pass until production, where tools time out and APIs return half a response. Chaos testing checks what your agent does when a tool returns a wrong but plausible value, like 12 degrees for Miami in June, buried in a verbose dump. The agent reports it as fact and burns tokens reading the junk. A small guardrail range-checks the value and replaces a bad result with a one-line error before the model ever sees it, fixing both accuracy and token cost.
Outline:
• The happy-path trap
• Inject realistic corruption
• The guardrail that catches it
• One run is not a measurement
• Build chaos into your test suite
Elizabeth Fuentes Leone
Developer Advocate
San Francisco, California, United States
Links
Please note that Sessionize is not responsible for the accuracy or validity of the data provided by speakers. If you suspect this profile to be fake or spam, please let us know.
Jump to top