A fully self-contained Android application demonstrating Model Context Protocol (MCP) orchestration running entirely on-device, powered by ExecuTorch with Qualcomm HTP and XNNPACK backends.
This talk presents a working architecture that collapses the MCP client, transport, and server into a single in-process orchestrator running on a commodity Android phone. User requests are routed through a confidence-gated three-tier pipeline: a small language model (Phi-3 Mini, INT4-quantized via ExecuTorch) handles the request first; if its confidence falls below a calibrated per-domain threshold, the query escalates to an on-device RAG layer (FAISS over a local corpus); only structurally, never over the network. MCP remains the contract between tiers — tool discovery, capability tokens, and audit logging all work exactly as they would in a distributed deployment, but the "transport" is a coroutine channel, not HTTP.
The result: no data egress, sub-second p50 latency without network round-trips, and GDPR/DPDP compliance by architecture rather than by policy — there is simply nothing to consent to sending, because nothing is sent.