Session
Your AI Agent Needs a Flight Recorder
When an AI agent makes a bad trade, denies a customer, exposes sensitive information, or calls the wrong tool, “the model did it” is not a root-cause analysis. This talk shows AI engineers how to build a forensic flight recorder that can reconstruct exactly what a production agent saw, decided, and did.
Using a failed financial-services agent workflow as a running example, Daniel Garrie will break down an evidence-ready architecture that captures:
Correlation IDs across model calls, retrieval systems, tools, policy checks, and human approvals
Prompt, context, model, tool, and policy versions
Tool inputs, outputs, permissions, exceptions, and side effects
Integrity controls that reveal whether logs or records were altered.
Replay mechanisms—and the limits of deterministic replay
Retention and redaction controls for sensitive customer and business data
Evaluation hooks that distinguish hallucination, retrieval failure, tool misuse, and policy bypass
The goal is not to log everything forever. It is to preserve the minimum reliable evidence needed to debug failures, evaluate agent behavior, investigate incidents, and explain consequential automated actions.
Attendees will leave with a practical agent-event schema, a seven-part logging checklist, and an incident-reconstruction workflow they can adapt to production systems.
Daniel Garrie
JAMS Neutral | Founder, Law & Forensics | Faculty Harvard
New York City, New York, United States
Links
Please note that Sessionize is not responsible for the accuracy or validity of the data provided by speakers. If you suspect this profile to be fake or spam, please let us know.
Jump to top