Practical Application Logging and Monitoring
summary
Centralized logging using the ELK stack with Logstash (later replaced by a tiny in‑house processor), file shippers (beaver/filebeat), and Kibana dashboards; metrics emitted as a single metrics.log JSON line and indexed per day/month; requests carry a request ID aggregation so logs from microservices join into one timeline. Alerts run every 30 seconds, trace logs expire after 7 days, metrics kept ~6 months, and a demo API plus request generator prove the pipeline end‑to‑end.
AI-written summary · about
chapters (14)
- 0:00Intro
- 3:42Issues
- 8:20Elastic Search
- 11:18Application Stack
- 15:55Demo API
- 23:21Index Happiness
- 26:06Average Response Time
- 30:11Network Response
- 32:36Indexing
- 34:41Server Metrics
- 35:21Our Own System
- 36:31Event Monitoring
- 38:11Aggregation
- 40:16Hotbox
related talks
01h 00mApplication Logging & Logstash
42mMake your logs work for you
45mI Want to Watch Your Logs
14mCentralized Logs using ELK (Elasticsearch, Logstash, Kibana) Stack
39mFast log management for your infrastructure
30mCentralized Log Management
40mA needle in a logstack
44mThe Holy Trinity of Observability: Logs, Metrics, and Traces