Cloud Native Logging 101 [B]
summary
Cloud native logging requires an end‑to‑end pipeline: collect, parse, filter, buffer, and deliver. It demonstrates using Fluentd (700+ plugins, CNCF project, >2,000 users) and the lightweight Fluent Bit (C, ~35 plugins, daemonset on Kubernetes) to read container log files, call the API server for pod labels/annotations, enrich records with metadata, buffer for reliability, and ship to Elasticsearch (visualized in Kibana). Demo shows per‑second ingestion and JSON records augmented with pod name, namespace, labels and parsed fields.
AI-written summary · about
chapters (6)
- 0:00Introduction
- 3:15Distributed systems
- 8:23Logging pipeline
- 12:55Unstructured data
- 17:10Fluent Bit
- 20:52Kubernetes Logging
related talks
34mGetting Started With Logging in Kubernetes
34mFluentd: A Complete Logging Ecosystem for Kubernetes
27mBuild a Cloud Native Logging Pipeline on the Edge with Fluentbit Operator
37mFluentd: Cloud Native Logging
26mKubernetes and Logging: Do It Right
39mMaking Logs Work for you with Fluentd
22mLogging: Fluentd & Fluent Bit
35mIntro: Fluentd