Session
Stop Sending Every Tool on Every Call and Save Tokens
When your agent has a lot of tools, every call packs all of their descriptions into the context window, whether the user asks about the weather or a hotel booking. That is thousands of tokens you pay for on every single query, and the bill grows with every tool you add, even for tools the request will never use. The fix is to stop sending every tool every time. Match the user's request to the few tools that actually fit and hand the model only those, so each call carries a fraction of the tokens. A shorter list also means fewer wrong tool picks, but the big win is the cost: you see the same agent run with and without this filtering on identical queries, token counts side by side, and you leave with code you can drop into your own agent.
Outline: • The Dual Problem • Solution Architecture • Live Implementation • Production Pattern • Advanced Patterns
Elizabeth Fuentes Leone
Developer Advocate
San Francisco, California, United States
Links
Please note that Sessionize is not responsible for the accuracy or validity of the data provided by speakers. If you suspect this profile to be fake or spam, please let us know.
Jump to top