Building AI agents no longer means the cloud is mandatory. AI agents can now run directly in the browser and on mobile devices. This talk explores "on-device" processing (Edge AI), which allows you to build intelligent agents that operate entirely offline. You no longer need a constant internet connection, and you stop paying for every API call. This unlocks new functionalities, ensures data privacy, and provides zero latency.

We'll focus on lightweight (meaning compact enough to run on-device) open models like Gemma, Llama, Deepseek, and others. They are designed to run efficiently on client devices and serve as the "brain" for our offline agents.

This talk is a practical guide to building these systems. We will show how to implement full-fledged agent capabilities, not just simple inference:

On-device Function Calls: How to teach the model to interact with device APIs (e.g., reading contacts or calendar events) without an internet connection.

On-device RAG: How the agent can query local data (documents, notes, emails) to provide highly relevant, context-aware answers.

We will cover the architecture and practical steps for integrating these models in both a browser and a mobile application, and frankly discuss the trade-offs: weighing the benefits (privacy, offline) against the challenges (model size, performance).