Session

More Than YARN on K8s: Unified Queuing for Mixed AI & Big Data Workloads

The greatest challenge in migrating YARN workloads to Kubernetes is perfectly replicating its robust multi-tenant capabilities. This session demonstrates how Volcano uses hierarchical queues as the cornerstone for multi-tenancy, providing granular quota management, fair-share scheduling, and powerful cross-queue elastic preemption.

But the true evolution lies in moving beyond YARN. We will then show how Volcano provides an advanced framework for heterogeneous hardware under a single, unified queuing system. We will dive deep into the scheduling capabilities that the YARN model lacks but modern AI platforms demand, including: tenant-to-hardware affinity, workload-aware resource isolation, and performance-driven topology awareness (for networks, GPUs, etc.).

Hajnal Máté

Senior MLOps Engineer, CNCF-Volcano Core Contributor, LFX Mentor, Kubeastronaut

Kecskemét, Hungary

Actions

Please note that Sessionize is not responsible for the accuracy or validity of the data provided by speakers. If you suspect this profile to be fake or spam, please let us know.

Jump to top