Getting Started With Logging in Kubernetes
summary
Demo shows a Fluent Bit daemonset reading container JSON logs on every node, calling the Kubernetes API to attach pod/namespace/label metadata, parsing Apache lines via an annotations-triggered Apache parser, and shipping structured records into Elasticsearch where document count hits ~100 during the demo. Fluent Bit is a C, low-memory alternative to Fluentd (850 plugins vs ~45), exposes a Prometheus endpoint, supports Lua filters for custom record mutation, and announces buffering-on-disk and a 1.0 release roadmap — the demo pipeline works end-to-end.
AI-written summary · about
chapters (12)
- 0:00Introduction
- 2:31Logging in with Docker containers
- 6:07How Kubernetes works
- 11:16Append timestamp
- 22:56Fluency
- 23:21FlyinD
- 24:17Flu Embed
- 25:56Pod Definition
- 26:34Filtering
- 27:40Fluent Bit
- 28:13Documentation Repository
- 28:36Questions
related talks
37mGetting Started with Logging in Kubernetes - Eduardo Silva, Treasure Data
26mKubernetes and Logging: Do It Right
22mLogging: Fluentd & Fluent Bit
34mFluentd: A Complete Logging Ecosystem for Kubernetes
33mCloud Native Logging 101 [B]
40mFluentd Deep Dive
27mBuild a Cloud Native Logging Pipeline on the Edge with Fluentbit Operator
05mLightning Talk: Flexible Logging Pipelines with Fluentd and Kubernetes