From Chaos to Clarity: Real-Time Logging with Fluent Bit and OpenSearch.

Discover how Fluent Bit and OpenSearch simplify real-time log management.
Turn scattered, noisy logs into clear, actionable insights instantly.
Learn to collect, filter, and visualize data across your systems effortlessly.
Bring structure, speed, and clarity to your observability pipeline.

Automating and Orchestrating Workflows with Apache Airflow

Apache Airflow enables teams to automate, schedule, and orchestrate complex workflows with code-driven precision. This session covers how to build reliable DAGs, manage dependencies, and integrate Airflow with modern data and cloud ecosystems. Attendees will learn practical best practices for creating scalable, observable pipelines that streamline end-to-end automation.

From Chaos to Clarity: Real-Time Logging with Fluent Bit and OpenSearch.

Unlock the full potential of your observability stack by integrating Fluent Bit with OpenSearch.
In this session, learn how to efficiently collect, filter, and route logs with Fluent Bit — and turn them into actionable insights using OpenSearch’s powerful search and visualization tools.
Whether you're scaling microservices or cleaning up a noisy logging pipeline, this guide will help you streamline log management, cut overhead, and troubleshoot faster — all in real-time.

Turning Logs into Knowledge: Real-Time Observability with Fluent Bit, OpenSearch & RAG

Modern systems generate massive volumes of logs, yet most teams still rely on keyword searches and dashboards to understand production issues. This often leads to slow incident response and missed insights hidden within operational data.

In this session, we’ll explore how to turn logs into knowledge by combining Fluent Bit, OpenSearch, and Retrieval-Augmented Generation (RAG) to build a real-time, AI-assisted observability platform. We’ll start with designing an efficient log ingestion pipeline using Fluent Bit, covering parsing, enrichment, and filtering at scale. Next, we’ll examine how OpenSearch enables fast indexing, search, and analytics for operational logs.

Finally, we’ll demonstrate how RAG can be applied to logs, enabling natural-language queries such as “What caused the failure after the last deployment?” and “Summarize recurring errors across services.” Through real-world use cases, you’ll learn how AI-assisted observability can reduce mean time to resolution and transform reactive monitoring into knowledge-driven operations.

From Noisy Logs to Actionable Insights: AI-Assisted Observability with Fluent Bit, OpenSearch & RAG

Modern Kubernetes platforms generate massive volumes of logs, yet most teams still rely on keyword searches and dashboards to debug production issues. This slows down incident response and hides valuable operational knowledge inside unstructured data.

In this talk, we’ll demonstrate how to build an AI-assisted observability pipeline using Fluent Bit, OpenSearch, and Retrieval-Augmented Generation (RAG) to transform raw logs into queryable, contextual insights. We’ll walk through a cloud-native architecture that streams logs from Kubernetes workloads, enriches and indexes them in OpenSearch, and uses RAG to answer operational questions in real time.

Attendees will see how this approach helps SREs and platform teams reduce MTTR, improve root-cause analysis, and move from reactive troubleshooting to proactive observability—using open-source, CNCF-aligned tooling.

Key Takeaways

How to design a cloud-native log pipeline with Fluent Bit and OpenSearch

How RAG augments observability by adding context to unstructured logs

Practical patterns to reduce MTTR and improve incident response in Kubernetes environments

Target Audience

SREs, Platform Engineers, and DevOps practitioners

Kubernetes users dealing with large-scale logging and observability challenges

Engineers exploring AI + Cloud-Native integrations using open source

Technical Level

Intermediate

Why this works better for KCD

Strong Kubernetes + CNCF alignment

Clear problem → solution → outcome

No vendor pitch, fully open-source focused

Concrete benefits (MTTR, RCA, real-time ops)