~/talk

Telemetry Showdown: Fluent Bit vs. OpenTelemetry Collector - A Comprehensive Benchmark Analysis

Talkat KCD Barcelona 2024 · 2024-06-13..06-14· [observability, kubernetes]
slides:none on file

Benchmark compares Fluent Bit 3 against OpenTelemetry Collector using real Hipster Shop + otel-demo load and Kepler high-cardinality exports; Fluent Bit handles logs far cheaper (Fluent Bit: ~60m CPU, ~15–20Mi RAM for logs) while Collector uses more CPU and memory for logs but provides full metrics/traces features. Collector shows a memory blowup when scraping Prometheus cumulative metrics with high cardinality (reaches ~10Gi and crashes) — root cause traced to Prometheus receiver conversion; adding the operator target-allocator offloads scraping and reduces Collector footprint to hundreds of Mi and ~100–200m CPU. Traces: Collector wins; metrics at scale: prefer Collector; logs-only: prefer Fluent Bit.

AI-written summary · about

  1. 0:00Introduction
  2. 7:54Design comparison
  3. 18:42Logging plugins
  4. 23:40Metrics plugins
  5. 30:15Traces plugins
  6. 33:15Performance results
  7. 49:33Recommendations & Q&A
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.