Kay Yan
Maintainerof kubespray and containerd/nerdctl, Software Engineer in DaoCloud
Shanghai, China
Actions
Kay Yan is kubespray maintainer, containerd/nerdctl maintainer. He is the Principal Software Engineer in DaoCloud, and develop the DaoCloud Enterprise Kubernetes Platform since 2016.
Area of Expertise
Topics
Kubespray Unleashed: Navigating Bare Metal Services in Kubernetes for LLM and RAG
Kubespray, popular within the SIG-Cluster-Lifecycle of Kubernetes, is celebrated for deploying production-ready Kubernetes clusters, particularly on bare metal, which boosts performance for AI workloads like LLM and RAG. This session will explore using Kubespray in bare metal settings, addressing challenges, and sharing best practices.
The first part of the talk will show Kubespray's key features and provide practical tips. The latter half will focus on swiftly deploying AI using Retrieval-Augmented Generation (RAG), demonstrating how Kubespray facilitates setting up Kubernetes clusters on bare metal. This setup enhances AI applications by integrating continuous knowledge updates and domain-specific information via RAG, improving the accuracy and credibility of the AI systems.
The session will conclude with discussions on community engagement and future advancements, followed by a Q&A period to address participant queries.
How to deploy an AI-optimized k8s cluster with Kubespray
Kubespray is one of the most popular projects in the SIG-Cluster-Lifecycle community of Kubernetes, often used in a bare-metal environment. As AI workloads are rapidly increasing, bare metal can provide superior performance. Therefore, this session will share features and best practices of using Kubespray to build an AI-optimized cluster.
In the first half of the session, we will demo and discuss the most main features of Kubespray, and we'll also share useful tips and best practices from Kubespray.
In the second half of the session, we will highlight enhanced features and share best practices to support AI workloads. This will include insights on GPU support, scheduler enhancement, batch job queuing, RDMA network, DRA driver, GPU monitoring, and more.
Lastly, we aim to delve deeper into community engagement and open a discussion about progressing the project further. We will then allocate a substantial amount of time for questions.
nerdctl: Docker-compatible CLI for containerd
During this session, participants will learn about nerdctl’s compatibility compared to Docker and Podman, along with features that Docker has not yet implemented. These include:
* Lazy-pulling with Stargz/Nydus/OverlayBD
* Peer-to-peer image distribution with IPFS
* Image encryption with OCIcrypt
* Image signing with Cosign
* Slirp-less rootless containers with bypass4netns
* Interactive Dockerfile debugging with buildg
Furthermore, the session will delve into nerdctl’s features, related projects(such as Lima, AWS Finch, Colima, Rancher Desktop, Kind ...), and the envisioned roadmap for its future development. Lastly, we aim to delve deeper into community engagement to contribute to the project.
SIG Cluster Lifecycle: What's new in Kubespray
Kubespray is one of the most versatile Kubernetes-cluster manager, and it benefits an extremely active worldwide community, especially in Asia.
In the first half of the session we will demo and discuss the most recent features such as HA with kube-vip, Manage offline files script for Air-Gap environment, fast image mirror, New OS(Rocky, Kylin, OpenEuler Linux, OpenEuler Linux...) Support, multi-arch cluster, support for Ansible collections, Cluster Hardening, work with the operator and GitOps. And we'll also share useful tips and best practices from Kubespray.
In the second half part, we would like to share some deep-dive about giving voice to the community and open a discussion about how to keep moving the project forward. And then allow a large amount of time for questions.
KubeCon + CloudNativeCon + Open Source Summit + AI_Dev China 2024 Sessionize Event
Maintainer Track + ContribFest: KubeCon + CloudNativeCon Europe 2024 Sessionize Event
KubeCon + CloudNativeCon + Open Source Summit China 2023 Sessionize Event
Please note that Sessionize is not responsible for the accuracy or validity of the data provided by speakers. If you suspect this profile to be fake or spam, please let us know.
Jump to top