Session

Chaos Testing: When Your Agent Trusts Bad Data

Your tests only cover the happy path, so they pass until production, where tools time out and APIs return half a response. Chaos testing checks what your agent does when a tool returns a wrong but plausible value, like 12 degrees for Miami in June, buried in a verbose dump. The agent reports it as fact and burns tokens reading the junk. A small guardrail range-checks the value and replaces a bad result with a one-line error before the model ever sees it, fixing both accuracy and token cost.


Outline:
• The happy-path trap
• Inject realistic corruption
• The guardrail that catches it
• One run is not a measurement
• Build chaos into your test suite

Elizabeth Fuentes Leone

Developer Advocate

San Francisco, California, United States

Actions

Please note that Sessionize is not responsible for the accuracy or validity of the data provided by speakers. If you suspect this profile to be fake or spam, please let us know.

Jump to top