Rama Krishna Raju Samantapudi
Sr. Staff AI/ML Architect at ServiceNow
Austin, Texas, United States
Actions
Rama Samantapudi is a Sr. Staff AI/ML Architect at ServiceNow, specializing in Search, Ranking, Recommendations, Conversational AI, Generative AI, and Agentic AI. With over 13 years of experience across Walmart, Zillow, State Street, and FactSet, Rama has led large-scale AI initiatives that bridge applied research and production systems. His work focuses on building intelligent search, ranking, reasoning and structured extraction models that enhance user experience, automation and decision-making at scale.
Area of Expertise
Topics
Agentic Governance: Securing Autonomous AI Systems at Enterprise Scale
Building an AI agent demo takes an afternoon. Deploying it safely to production takes months — and that gap is almost entirely a governance problem, not a model problem. This technical deep dive presents a four-pillar framework — Lifecycle Management, Risk Management, Security, and Observability — that gives engineering teams a concrete, implementable path from prototype to production-ready agent system.
The talk covers nine actionable patterns: versioning agents as deployable artifacts with CI/CD and eval gates; securing data access through curated views, column masking, and intentional APIs; assigning dedicated least-privilege service identities; and building governance-grade observability that
can answer, for any request, which version ran, which tools were called, and whether policy was followed.
Attendees leave with a production readiness checklist, a prioritized four-step implementation roadmap, and a framework they can apply immediately to any agent they have in production or in development.
"Smarter, Cheaper AI Agents: Semantic Caching in Production"
AI agents are expensive to scale. A single agentic workflow can involve dozens of LLM calls, and popular reasoning models make every token costly. The classical solution caching breaks down for natural language: no two users phrase the same question identically.
Semantic caching solves this by matching on meaning (embedded as vectors) instead of characters. But getting this right in production requires the right threshold, the right eviction strategy, the right accuracy techniques, and the right query routing.
This talk walks through the full engineering stack: how semantic caches work, how to measure them rigorously, four composable techniques to improve accuracy, how to embed caching inside agentic workflows at the sub-question level, and how Walmart's waLLMartCache achieved ~90% accuracy in production across a multi-tenant, globally scaled deployment.
Please note that Sessionize is not responsible for the accuracy or validity of the data provided by speakers. If you suspect this profile to be fake or spam, please let us know.
Jump to top