Session

AI'm at the Gate! Introducing the AI Gateway Working Group in Kubernetes

Kubernetes Working Groups (WGs) play a vital role in shaping the future of Kubernetes and CNCF.

We’re excited to introduce a new addition: The AI Gateway WG.

This session will present the mission, scope, and early initiatives of the AI Gateway WG, focused on defining and advancing practices and standards at the intersection of AI and networking.

As AI systems increasingly rely on gateways, load balancers, and proxies, the WG is exploring the standardization of key capabilities, such as callouts to external AI backends for egress scenarios and payload-processing hooks that handle requests/responses before or after reaching an AI service. These primitives enable higher-level behaviors such as request/response guards, semantic routing, and other AI-aware traffic controls.

We’ll share the initial designs, early prototypes, and emerging directions shaping the WG’s roadmap.

Join us to learn how you can contribute and help shape the future of AI-aware gateway capabilities in Kubernetes.


Presented at KubeCon EU 2026, Amsterdam:
https://kccnceu2026.sched.com/event/2EF5t/aim-at-the-gate-introducing-the-ai-gateway-working-group-in-kubernetes-nir-rozenbaum-ibm-kellen-swain-google-morgan-foster-red-hat?iframe=yes&w=&sidebar=yes&bg=no

Nir Rozenbaum

Kubernetes & Open Source, NVIDIA

Yoqneam, Israel

Actions

Please note that Sessionize is not responsible for the accuracy or validity of the data provided by speakers. If you suspect this profile to be fake or spam, please let us know.

Jump to top