Session

AI Runtime Integrity: Detecting Unauthorized Changes in Linux AI Serving Stacks with eBPF

AI inference services on Linux are becoming complex runtime systems. A single vLLM or SGLang deployment may load model weights, tokenizers, LoRA adapters, shared libraries, CUDA components, Python packages, containers, and GPU kernel modules. These changes often happen below the application layer, where traditional AI security controls have little visibility.

This talk presents an open-source prototype for runtime integrity monitoring of Linux AI serving stacks using eBPF. The tool monitors model and shared library loads, suspicious file replacements, container executions, and selected kernel module activity for inference frameworks such as vLLM, SGLang, and PyTorch.

The goal is to show how Linux kernel observability can detect unauthorized runtime drift in AI infrastructure before it becomes a silent production risk.

Sai Sravan Cherukuri

Open Source Enthusiasts and DevSecOps Architect

Actions

Please note that Sessionize is not responsible for the accuracy or validity of the data provided by speakers. If you suspect this profile to be fake or spam, please let us know.

Jump to top