This presentation explores the critical role of open-source LLMs in achieving digital sovereignty. We will delve into the technical challenges and opportunities in building secure and resilient open-source LLMs, focusing on practical strategies for data privacy, model security, and community governance. We will examine case studies showcasing successful community-driven initiatives and discuss best practices for fostering collaboration and knowledge sharing within the open-source ecosystem.