Session

Keeping Context Small: Systems Lessons for AI Agents

As agents grow, their context grows with them: more tools, instructions, memory, and state. Loading all of that on every request is expensive and often unnecessary.

This talk looks at how to keep agent context small using ideas from systems design: working sets, caching, lazy loading, and dynamic tool discovery. We’ll cover both the theory and the practical trade-offs, when cached reads are much cheaper than normal input, what should you cache, how much should you preload, and when should tools be fetched on demand? The goal is to reduce token cost and context bloat without hurting agent quality.

Saksham Dhull

Software Engineer (Team Lead), AI Agents, Wisdom AI

Bengaluru, India

Actions

Please note that Sessionize is not responsible for the accuracy or validity of the data provided by speakers. If you suspect this profile to be fake or spam, please let us know.

Jump to top