Session
GPUs On Kubernetes: How To Navigate The Graphical Landscape
With a larger need to run Data Models (LLMs/SLM/Standard Models) for AI workloads, GPU capabilities are necessary. The problem is that GPUs are expensive. If you look at the huge AI factories, they're spending billions of dollars on GPUs alone.
Just as Kubernetes helps engineers share resources across ephemeral stacks (Pods/Containers), it can also help engineers share GPU resources across Pods to not only keep cost and resource optimization low but to ensure the utmost performance, reliability, and scalability.
In this session, you'll learn why you want to run GPUs on Kubernetes and, from a hands-on perspective, how to deploy a cluster with GPU support. You'll also see how to connect Pods to Nvidia GPUs.

Michael Levan
Cloud-Native Consultant┇Microsoft MVP (Azure)┇Helping Businesses Drive Value with Content Creation & Independent Consulting┇Live Trainer, Author, Speaker┇k8s Release Team┇CNCF Ambassador┇Co-Host Platf
Saddle Brook, New Jersey, United States
Links
Please note that Sessionize is not responsible for the accuracy or validity of the data provided by speakers. If you suspect this profile to be fake or spam, please let us know.
Jump to top