The rapid evolution of generative AI has introduced a complex ecosystem of tools, but many conversations focus narrowly on isolated features and solutions. This can leave engineers wondering: What does a complete, functional GenAI platform actually look like?

This talk provides a practical roadmap for building generative AI infrastructure from the ground up. We’ll guide you through three key phases starting with a Thinnest Viable Platform (TVP), demonstrating the minimal setup needed for LLM inference on Kubernetes. Moving to MVP, we'll explore essential platform components: LLM gateways, vector databases, and KServe deployments. Finally, we'll dive into advanced platform features: intelligent load balancing for LLMs, observability patterns, and performance optimization techniques.

This session is more than a showcase of tools — it’s a roadmap for navigating the AI platform landscape. Join us for practical insights and lessons learned from real-world GenAI platform engineering.