Shiva Kalyan Reddy Giri
Fidelity Investments, Software Engineer
Dallas, Texas, United States
Actions
Shiva Kalyan Reddy is a Senior Software Engineer with experience building and modernizing enterprise web and mobile applications, particularly in financial-services environments. His work spans full-stack development, API architecture, cloud platforms, enterprise modernization, and generative AI. He has hands-on experience with LLM APIs, retrieval-augmented generation (RAG), vector databases, semantic search, prompt engineering, real-time AI applications, and AI-assisted software development. He is especially interested in production readiness, secure data handling, scalability, maintainability, and ensuring that engineering teams understand and take ownership of the systems they build and operate.
Links
Area of Expertise
Topics
From AI Prototype to Kubernetes: Production Guardrails for LLM Applications
AI applications can move from idea to working prototype quickly, but deploying them reliably introduces challenges that model demonstrations often hide. Real-time APIs, WebSocket connections, external LLM services, vector retrieval, authentication, background processing, and unpredictable workloads all create new operational requirements.
This session presents a cloud-native architecture for moving an API-driven generative AI application toward Kubernetes. Using a real-time AI assistant as the reference use case, the talk examines how to separate frontend, API, transcription, retrieval, orchestration, and persistence workloads into independently deployable components.
Attendees will learn how Kubernetes primitives can support autoscaling, secrets management, health checks, resource controls, rolling deployments, workload isolation, and failure recovery. The session will also cover challenges such as scaling stateful WebSocket sessions, managing external model rate limits, tracing requests across AI services, controlling inference costs, and designing graceful degradation when a model or transcription provider becomes unavailable.
The presentation is vendor-neutral and focuses on reusable Kubernetes and cloud-native patterns rather than a particular commercial platform.
Austin Kubernetes Meetup User group Sessionize Event
Shiva Kalyan Reddy Giri
Fidelity Investments, Software Engineer
Dallas, Texas, United States
Links
Actions
Please note that Sessionize is not responsible for the accuracy or validity of the data provided by speakers. If you suspect this profile to be fake or spam, please let us know.
Jump to top