The current observability pipelines using OpenTelemetry Collector cannot be configured dynamically. This means that the user cannot change the pipeline configuration without restarting the collector. This is a problem for users who want to change the pipeline configuration based on the data they are receiving. For example, a user might want to change the sampling rate of a trace exporter based on the number of traces they are receiving or they might want to parse unstructured logs into structured logs for further processing. This is not possible with the current static pipelines.

In this talk, we'll discuss

- How we use OpAMP to build user configurable observability pipelines.
- The problems we faced with the existing static pipelines and how we leveraged OpAMP to solve them.
- How we exploited the flexibility of OTEL Collector components to build a preview pipeline that allows users to preview their pipeline configuration before deploying it.
- Show all of this in action with a demo