Fluentd: A Complete Logging Ecosystem for Kubernetes
summary
Fluentd presents a low-latency, streaming logging stack for Kubernetes with a Ruby-based core, plugin model, and companion Fluent Bit for lightweight edge collection. It ships as deb/rpm/msi and supports inputs like tailing container logs, Docker logging driver, and disk reads, plus outputs to Elasticsearch/Kafka/HDFS/MongoDB. Key behaviors are disk-backed file buffer chunks to avoid loss, an at-least-once forwarding protocol for HA and load balancing, Kubernetes metadata enrichment via the API, and flexible copy/merge pipelines for multi-destination delivery.
AI-written summary · about
chapters (12)
- 0:00Start
- 0:27What's Fluentd
- 5:26Event structure
- 8:03Architecture Butler Plugins
- 9:403rd party input plugin
- 10:31Simple forwarding
- 11:41Multiple destinations
- 12:34Multi-tier Forwarding
- 14:29Resources
- 15:55Docker logging with
- 20:40Container Logging approach summary
- 21:25Fluents and Fluent-bit
related talks
09mLightning Talk: Fluentd at Scale; Keys to successful Logging Syndication
42mLogging for Containers
27mUnder the Hood with Fluent Bit Operator: Kubernetes-native Log Processor
46mBuilding a scalable logging platform
05mLightning Talk: Flexible Logging Pipelines with Fluentd and Kubernetes
05mLightning Talk: What I Wish I’d Known about Fluentd with Kubernetes - Bryan Boreham, Weaveworks
33mFluent Bit V2.0: Unifying Open Standards For Logs, Metrics & Traces
34mPower of O11y with FLUENT BIT in AWS EKS environment