Session

GPUs On Kubernetes: How To Navigate The Graphical Landscape

With a larger need to run Data Models (LLMs/SLM/Standard Models) for AI workloads, GPU capabilities are necessary. The problem is that GPUs are expensive. If you look at the huge AI factories, they're spending billions of dollars on GPUs alone.

Just as Kubernetes helps engineers share resources across ephemeral stacks (Pods/Containers), it can also help engineers share GPU resources across Pods to not only keep cost and resource optimization low but to ensure the utmost performance, reliability, and scalability.

In this session, you'll learn why you want to run GPUs on Kubernetes and, from a hands-on perspective, how to deploy a cluster with GPU support. You'll also see how to connect Pods to Nvidia GPUs.

Michael Levan

Cloud-Native Consultant┇Microsoft MVP (Azure)┇Helping Businesses Drive Value with Content Creation & Independent Consulting┇Live Trainer, Author, Speaker┇k8s Release Team┇CNCF Ambassador┇Co-Host Platf

Saddle Brook, New Jersey, United States

Actions

Please note that Sessionize is not responsible for the accuracy or validity of the data provided by speakers. If you suspect this profile to be fake or spam, please let us know.

Jump to top