Session

Stop Sending Every Tool on Every Call and Save Tokens

Every call your agent makes packs the description of every tool into the context window, whether the question is about the weather or a hotel booking. That is thousands of tokens on every query, and the bill grows with each tool you add, including the ones the request will never touch. Match the request to the few tools that fit and send only those. You see the same agent run with and without the filter on identical queries, token counts side by side, and you leave with code you can reuse.


Outline:
• The Dual Problem
• Solution Architecture
• Live Implementation
• Production Pattern
• Tool Dependency Graphs, Caching, and Monitoring

Elizabeth Fuentes Leone

Developer Advocate

San Francisco, California, United States

Actions

Please note that Sessionize is not responsible for the accuracy or validity of the data provided by speakers. If you suspect this profile to be fake or spam, please let us know.

Jump to top