Large Language Models today are almost always used via cloud services, with associated costs, latency, and privacy implications.
But do we really need to always be connected?

In this talk, we'll see how to run LLMs directly on a smartphone, fully offline, using Flutter and the Cactus framework. We'll analyze the advantages and limitations of on-device inference and show a real demo of a Flutter app integrating a local language model.