Session
Stop Sending Every Tool on Every Call and Save Tokens
Every call your agent makes packs the description of every tool into the context window, whether the question is about the weather or a hotel booking. That is thousands of tokens on every query, and the bill grows with each tool you add, including the ones the request will never touch. Match the request to the few tools that fit and send only those. You see the same agent run with and without the filter on identical queries, token counts side by side, and you leave with code you can reuse.
Outline:
• The Dual Problem
• Solution Architecture
• Live Implementation
• Production Pattern
• Tool Dependency Graphs, Caching, and Monitoring
Elizabeth Fuentes Leone
Developer Advocate
San Francisco, California, United States
Links
Please note that Sessionize is not responsible for the accuracy or validity of the data provided by speakers. If you suspect this profile to be fake or spam, please let us know.
Jump to top