Intro: Fluentd

on YouTube ↗35m

" summary

Overview of Fluentd architecture and concrete deployment choices: shows core components (source → filters → buffers → outputs), explains the micro-batch chunks model and how chunk size trades latency for throughput, and lists real outputs (Elasticsearch, S3, MongoDB) plus packaging (RPM/DEB/MSI and Docker images). Covers Kubernetes/logging patterns with the docker log driver, daemonset sidecars, shared volume collection, buffering to memory vs disk, and practical retry/backup strategies for high traffic.

AI-written summary · about

" chapters (6)

1. 0:00Start
2. 8:37Data pipeline (simplified)
3. 15:03Simple forwarding
4. 16:49Multi-tier Forwarding
5. 18:10Multiple destinations
6. 24:58Container Logging approach summary

" related talks

• 34mFluentd: A Complete Logging Ecosystem for KubernetesMasahiro Nakagawa, Yuta Iwama · KubeCon + CloudNativeCon China 2019
• 33mFluentd and Distributed Logging [I]Masahiro Nakagawa · KubeCon + CloudNativeCon North America 2017
• 36mFluentd Project Intro – Eduardo Silva & Masahiro Nakagawa, Treasure DataEduardo Silva, Masahiro Nakagawa · KubeCon + CloudNativeCon Europe 2018
• 22mLogging: Fluentd & Fluent BitEduardo Silva, Masahiro Nakagawa · KubeCon + CloudNativeCon North America 2020 Virtual
• 37mFluentd: Cloud Native LoggingMasahiro Nakagawa, Yuta Iwama · KubeCon + CloudNativeCon North America 2019
• 39mMaking Logs Work for you with FluentdPhil Wilkins · Conf42 Cloud Native 2021
• 31mBuild the Unified Logging Layer with Fluentd and RubyKiyoto Tamura · RubyConf 2014
• 46mBuilding a scalable logging platformRicardo Castro · DevOpsDays Geneva 2020