Mohamed Belgaied Hassine
Consulting Architect at Mirantis
Munich, Germany
Actions
Born in Tunisia, graduated and first professional experiences in France, Mohamed lives now in Germany since 2013, where he has been doing Consulting for Software vendors, first in the Big Data space, and then in the Cloud native space since 2019.
Links
Area of Expertise
Topics
Can Kubernetes Run AI Inference in Your Homelab? An Honest Answer, with Three CNCF Projects
There's a Dan Garfield talk from KubeCon EU 2021 — "The Quest for the Ultimate Kubernetes Homelab" — that put an idea in a lot of platform engineers' minds: the cluster in your closet isn't a toy, it's where you learn what you do later at work. Five years later, the question has changed: can the homelab cluster now run a useful LLM, the same way it runs your media server and your password manager?
For me, yes. With three Kubernetes-native projects: HAMi for GPU sharing, Kaito for declarative model deployment, and LLM-d for KV-cache-aware routing. Do you have more than one Gaming PC? Maybe yours and you son's, or maybe you kept your older GPU? If you add them to your Kubernetes cluster, you are a couple of minutes away from your own a distributed inference endpoint.
Does it make sense against running ollama or LM Studio? I will give you an honest answer.
You'll leave knowing exactly what to install on your homelab tonight — and whether you should.
The Future of AI Inference is Small, Distributed, and Budget-Conscious
By 2030, 90% of AI workloads will be inference—mostly smaller models at smaller organizations. Yet KubeCon talks focus on massive GPU clusters for frontier labs. We're building infrastructure for the wrong market.
This lightning talk argues for a shift: make AI inference accessible to budget-conscious organizations using CNCF projects we already have. I'll sketch a vision combining Cluster API (elastic infrastructure), HAMi (GPU sharing), and Kaito (optimized serving) to create cost-effective, distributed inference for the 90% of organizations who can't afford hyperscaler patterns.
Let's stop optimizing for OpenAI and Anthropic, and start optimizing for everyone else.
KCD UK Edinburgh 2026 Sessionize Event
Cloud Native Summit 2026 Sessionize Event
KCD Czech & Slovak 2026 Sessionize Event
Mohamed Belgaied Hassine
Consulting Architect at Mirantis
Munich, Germany
Links
Actions
Please note that Sessionize is not responsible for the accuracy or validity of the data provided by speakers. If you suspect this profile to be fake or spam, please let us know.
Jump to top