In this talk, we’ll explore how to run machine learning models directly on Android devices using lightweight runtimes and optimized architectures.

You’ll learn how to prepare and load models, run inference efficiently, and integrate with tools like MediaPipe for real-time computer vision and natural language experiences. We’ll look at how to optimize models for size and performance, chain multiple models together, and handle input and output tensors on-device.

Through practical code examples and lessons learned from real projects, you’ll see how on-device AI enables faster responses, offline capabilities, and stronger privacy while keeping your app lightweight and responsive.