
Zhu Jiekun
Senior Software Engineer
Actions
Jiekun is an open-source software enthusiast and a contributor to OpenTelemetry with a focus on the Collector and sampling.
Links
TTChat’s Story: Connect Metrics, Logs and Traces With eBPF
In TTChat, microservice observability faces two challenges: how to instrument microservices without code modification across diverse programming languages and frameworks, and how to connect logs, metrics and traces.
We will share our story of building an observability platform. We relied on client SDK initially, collecting 200TB data per day, and then transitioned to using eBPF for auto-instrumentation. We explored various approaches to connect the three pillars of observability. By leveraging the OpenTelemetry Collector and self-built exporters, we preserved meaningful observability data, particularly in connecting error traces and logs with metrics.
We will share those practical experiences and discuss why connecting eBPF data without context is difficult. We will not only showcase the key of different approaches but also delve into the challenges we encountered. Attendees can learn how to connect observability data and take away valuable lessons to avoid repeating our mistakes.
Balancing Cost and Quality in OpenTelemetry: An Evaluation of Sampling Policies
Distributed tracing is crucial for troubleshooting in today's microservice architecture. At FUTU, over 100 million Trace Spans are generated every second, requiring 200TB of disk space per day to store them. Collecting the entire volume of Trace data can be expensive, and many Traces that appear identical may not be helpful.
OpenTelemetry offers various sampling policies. These policies help to reduce resource usage, but different policies require different amounts of network I/O, memory, and storage space to achieve varying sampling quality. Finding the best combo of different policies for a specific scenario is essential.
We will share FUTU's experience in evaluating different combo of sampling policies by analyzing their cost and sampling quality quantitatively. We'll also introduce a new sampling policy that aims to cover more edge cases. You will learn about the specific costs and benefits of different sampling policies and discover how to customize them for your own business.
CNCF-hosted Co-located Events Europe 2024 Sessionize Event
KubeCon + CloudNativeCon + Open Source Summit China 2023 Sessionize Event
Please note that Sessionize is not responsible for the accuracy or validity of the data provided by speakers. If you suspect this profile to be fake or spam, please let us know.
Jump to top