KubeVirt is redefining how we run virtual machines in Kubernetes but what happens when those VMs need GPU acceleration for demanding AI/ML workloads?
In this lightning talk, I will walk through how to enable GPU-backed virtual machines in KubeVirt, and why this approach is gaining traction for secure, scalable, and isolated inference pipelines. We will explore the differences between container-based and VM-based GPU allocation, and see how KubeVirt integrates with CNCF tools like Prometheus and Kubernetes scheduler to monitor and optimize performance. If you are looking to push KubeVirt beyond typical VM use cases and into production-ready ML/AI workloads, this session will give you the technical foundation and the inspiration to get started.