Session
Crafting Production Ready RAG/GenAI Recipes with OPEA
Enterprises face significant challenges in developing and deploying Python-based Gen AI solutions—from model development, fine-tuning, and bias resolution to large-scale deployment. With few standardized tools available, OPEA, the Open Platform for Enterprise AI by the Linux Foundation, fills the gap. It offers a microservices framework for state-of-the-art GenAI systems, including LLMs, data stores, and prompt engines to accelerate enterprise adoption. The platform provides blueprints for end-to-end workflows like ChatQnA, CodeGen, and RAG systems. This talk explores practical steps for deploying cloud-native GenAI applications on Kubernetes across various hyperscalers, showcasing diverse data stores, open-source vector databases, and managed services to demonstrate RAG capabilities with over 50K documents. Attendees will learn deployment strategies with OPEA and discover clear paths for contributing to the project.
Suvrakamal Das
Software Engineer @Mattoboard
San Francisco, California, United States
Links
Please note that Sessionize is not responsible for the accuracy or validity of the data provided by speakers. If you suspect this profile to be fake or spam, please let us know.
Jump to top