In Africa we already have the digital divide and with AI coming we are now having an AI divide which is even worse due to reliance on existing network infrastructure and hardware that can support AI needs. In this talk, I will talk about how my team is using open-source LLMs to create an e-learning solution that works offline and utilises AI. The talk goes beyond my work and discusses how we can ensure an inclusive and equitable AI future that caters to all as we attempt to achieve the SDGs. The talk is less techie and utilises day-to-day language and examples to explain how and why we could utilise quantized models to bridge the AI divide and tries to point out why that is essential that we do so now.