Fluentd: Cloud Native Logging
Talkat KubeCon + CloudNativeCon North America 2019 · on Tuesday, 2019-11-19· at 15:20· Room 17AB - San Diego Convention Center, Mezzanine Level·
summary
Fluentd is a Ruby-based streaming log router with 900+ plugins that routes events (tag, time, JSON record) through input → filter → buffer → output stages; it ships Fluentd 1.8 with service-discovery for dynamic aggregators, a faster file buffer (single/chunk metadata split), and stronger metrics. Deployment patterns for containers are daemonset/shared-volume/library (or Docker logging driver), forwarding uses forward/out_forward with at-least-once semantics and multi-destination copy, and legacy Ruby (2.1–2.3) and v0.12 support is dropped end of 2019.
AI-written summary · about
chapters (20)
- 0:00Intro
- 0:24What is Fluentd
- 3:50Streaming Way with Fluent
- 4:51Design
- 7:13Event Structure
- 8:16Simplified Architecture
- 9:27Input and Parser Plugins
- 10:22Filter Plugins
- 11:07Buffer Plugins
- 12:09Formatter and output plugins
- 13:15Simple Forwarding
- 16:05Multiple Destinations
- 17:15Multi-tier Forwarding
- 19:30Fluentd with Docker and kubernetes
- 21:14Mounted Volumes
- 22:09Sending Data via fluent-logger
- 23:12Docker Long Driver
- 23:59Kubernetes Daemonset
- 24:41Announcement and Update
- 28:06Summary
related talks
33mFluentd and Distributed Logging [I]
34mFluentd: A Complete Logging Ecosystem for Kubernetes
22mLogging: Fluentd & Fluent Bit
35mIntro: Fluentd
31mBuild the Unified Logging Layer with Fluentd and Ruby
36mFluentd Project Intro – Eduardo Silva & Masahiro Nakagawa, Treasure Data
34mFluentd and Fluent Bit
39mMaking Logs Work for you with Fluentd