Since launching the AI Gateway Working Group, the Kubernetes community has been turning early ideas about AI-aware networking into concrete designs and emerging API directions.

AI traffic challenges traditional networking assumptions. Requests now include prompts, tool calls, streaming responses, and external model interactions, requiring new patterns for routing, payload handling, and policy enforcement.

In this session, we will present the latest work from the AI Gateway WG, covering emerging AI traffic patterns, payload processing and transformation hooks, external model egress, and how these map to Gateway API and its extension model.

We will also discuss key design tradeoffs: what should be standardized vs left to implementations, how much payload awareness belongs in the network layer, and how to avoid premature abstractions.

Attendees will leave with a clear understanding of the WG's direction, current designs, and the open questions shaping AI networking in Kubernetes.

Presented at KubeCon NA 2026, Salt Lake City:
https://events.linuxfoundation.org/kubecon-cloudnativecon-north-america/program/schedule/?id=1289716