Discover how to build the next generation of mobile apps with Offline AI Agents. This talk explores leveraging Edge AI and on-device processing to create intelligent agents that operate entirely without an internet connection, enhancing privacy, reducing latency, and enabling new functionalities independent of the cloud.

We'll focus on using lightweight, open models like Google's Gemma family, designed to run efficiently on mobile devices. These models form the "brain" of our offline agents. A key part of this session introduces a custom Flutter plugin that seamlessly integrates these models, making it significantly easier to build offline AI capabilities into your Flutter projects.

Learn the practical steps for implementation, from selecting on-device models (e.g., Gemma, Deepseek, Llama) to integrating them with our Flutter plugin. We will discuss the trade-offs of Edge AI—weighing benefits like offline access and privacy against challenges like model size and device performance compared to cloud AI. We will also explore techniques for structuring agent tasks, fine-tuning models, and delving into on-device Retrieval-Augmented Generation (RAG). This advanced RAG capability enables agents to query local data sources for highly relevant, context-aware interactions, entirely offline.