Traditional keyword search is no longer sufficient for modern SRE workflows because infrastructure error messages are often too generic to be actionable. This session explores a technical shift in observability: moving from standard indexing to high-dimensional vector embeddings for terminal traces and post-mortems using OpenSearch.

We will deep-dive into a privacy-first AI architecture, demonstrating how to integrate OpenSearch’s vector engine with local, private models (such as Llama) to ensure sensitive production logs never leave your VPC.

You will learn the mechanics of building a Retrieval-Augmented Generation (RAG) pipeline designed specifically for infrastructure telemetry. The session includes a live demo where a local agent "recalls" the exact historical fix for a messy, real-time stack trace, providing a direct link to the relevant PR or configuration change from the past.