Session

Secure and Efficient LLM Deployment: Containerizing with Rootless Podman and Bootable Containers

This talk is tailored for those new to the cloud, focusing on deploying large language models (LLMs) using Podman’s innovative, user-friendly approach. We introduce rootless Podman for enhanced security and simplicity and extend into the realm of bootable containers, offering streamlined, direct deployments. Learn how to set up Podman, containerize an LLM, and safeguard your supply chain with image scanning and signing. We'll cover efficient management and monitoring techniques for your containerized LLMs. This session will empower you to leverage the full potential of bootable containers, ensuring secure, efficient LLM deployments in the cloud. Join us to confidently navigate the intersection of advanced AI and container technology.

Ramakrishna Yekulla

Principal Architect

Bengaluru, India

Actions

Please note that Sessionize is not responsible for the accuracy or validity of the data provided by speakers. If you suspect this profile to be fake or spam, please let us know.

Jump to top