Ramakrishna Yekulla
Principal Architect
Bengaluru, India
Actions
Ramakrishna Yekulla "Ramky" is a Principal Architect within the Application Developer Business Unit at Red Hat. In this role, he focuses on creating distinctive platform features that enhance developer efficiency, streamline data and application connections, and empower customers with the knowledge and resources to prioritize software supply chain security, minimize technical obligations, and achieve compliance goals. His interests lies in System Design, Functional Programming and Observability
Area of Expertise
Topics
Supercharge your development machine to create AI apps in minutes
In this talk, my co-speaker Ramakrishna Yekulla and I will cover how developers can create AI apps on their laptop. We will be covering several AI models such as granite, InstructLab and will give a demo on how using Podman AI Lab developers can create an app within minutes and test various AI LLM's to find the one suitable for their specific domain. We will also cover how they can train the model (due to time constraint we will cover on InstructLab) on their laptop to improve the models for their organisation specific use cases. This will be a 20 mins talk followed by 10 minutes of Live demo.
Demystifying Self-Hosted LLMs : A Beginner's Guide to Self-Hosting on Kubernetes with Podman Desktop
Deploying and managing large language models (LLMs) in production often presents significant challenges.By self-hosting LLMs on Kubernetes, organizations gain enhanced data privacy, flexibility in model training, and potential cost savings. This talk aims to enabling beginners by demystifying the process of self-hosting LLMs within the robust Kubernetes ecosystem.We will place a special emphasis on harnessing the capabilities of the Podman Desktop AI Lab extension to accelerate and simplify the development, deployment, and management of LLM workloads on Kubernetes.
Key topics will include:
- Strategically selecting and containerizing suitable open-source LLM models for optimal performance
- Crafting Kubernetes deployment manifests tailored for LLM workloads
- Provisioning and managing Kubernetes resources to meet the computational demands of LLMs
- Deep dive into leveraging the Podman Desktop AI Lab extension for streamlined LLM workflows on Kubernetes
Secure and Efficient LLM Deployment: Containerizing with Rootless Podman and Bootable Containers
This talk is tailored for those new to the cloud, focusing on deploying large language models (LLMs) using Podman’s innovative, user-friendly approach. We introduce rootless Podman for enhanced security and simplicity and extend into the realm of bootable containers, offering streamlined, direct deployments. Learn how to set up Podman, containerize an LLM, and safeguard your supply chain with image scanning and signing. We'll cover efficient management and monitoring techniques for your containerized LLMs. This session will empower you to leverage the full potential of bootable containers, ensuring secure, efficient LLM deployments in the cloud. Join us to confidently navigate the intersection of advanced AI and container technology.
Beyond Vulnerability Scanning: Proactive Software Supply Chain Security with SBOMs and VEX
Modern apps rely heavily on open source, but this agility brings security risks. Learn how to proactively defend your cloud-native software supply chain with SBOMs (inventory your components), VEX (actionable vulnerability insights), and CNCF projects like sigstore & GUAC (establish trust & visibility). Gain hands-on knowledge of integrating these tools, learn industry best practices, and explore real-world use cases. Join us to build a more secure cloud-native future!
Key Takeaways:
Technical Implementation: Gain knowledge of how to integrate SBOMs, VEX, sigstore, and guac into your cloud-native development workflows.
Best Practices: Learnpractices for securing your software supply chain from code commit to production deployment.
Kyverno: Enhancing CI/CD Security Through Policy-Driven Automation
This talk delves into leveraging Kyverno for securing CI/CD pipelines. It will cover how Kyverno's policy-driven approach automates the enforcement of security best practices, compliance checks, and access controls within Kubernetes. Attendees will learn:
* Brief of Tekton and Argo
* Fortify Your Pipelines: Learn to embed security at every stage with precise, enforceable policies.
* Streamline Compliance: Ensure your deployments always meet regulatory and corporate standards automatically.
* Prevent Breaches: See how Kyverno can block vulnerable or unauthorized changes before they reach production.
Kyverno: Enhancing CI/CD Security Through Policy-Driven Automation
This talk delves into leveraging Kyverno for securing CI/CD pipelines. It will cover how Kyverno's policy-driven approach automates the enforcement of security best practices, compliance checks, and access controls within Kubernetes. Attendees will learn:
* Brief of Tekton and Argo
* Fortify Your Pipelines: Learn to embed security at every stage with precise, enforceable policies.
* Streamline Compliance: Ensure your deployments always meet regulatory and corporate standards automatically.
* Prevent Breaches: See how Kyverno can block vulnerable or unauthorized changes before they reach production.
Please note that Sessionize is not responsible for the accuracy or validity of the data provided by speakers. If you suspect this profile to be fake or spam, please let us know.
Jump to top