Centralized Logging Patterns
summary
Demonstrations use the Elastic Stack with Beats, Logstash, Elasticsearch and Kibana to show four concrete patterns: Parse (grok rules to extract fields; multiline stack traces break into extra lines until fixed), Send (log appender over TCP — fast but can lose logs if the app exits before delivery or buffer fills), Structure (JSON logs avoid parsing), and container patterns with a filebeat sidecar that collect Docker/K8s metadata and end up showing 82 events after multiline-handling fixes.
AI-written summary · about
chapters (15)
- 0:00Introduction to logging challenges
- 1:09Centralized logging needs
- 2:55Elastic stack components
- 5:50Demo setup and Java app
- 10:06Structured logging basics
- 11:12Parsing log formats
- 13:43Handling stack traces
- 16:07Logstash parsing demo
- 21:27Direct log sending approach
- 26:05Structured JSON logging
- 30:05Logging in Docker containers
- 32:29Sidecar pattern for logs
- 37:16Kubernetes logging setup
- 44:07Recommendations and wrap-up
- 45:31Q&A session
