Monitor your containers with the Elastic Stack

on YouTube ↗01h 00m

" summary

Shows how the Elastic Stack actually collects container data: use filebeat to tail Docker’s json-file logs or mounted volumes, choose syslog/journald/GELF alternatives, run metricbeat as a sidecar to read cgroups or use the Docker API (community dockbeat merged into metricbeat 5.x), and capture HTTP/DB wire metrics with packetbeat. Demonstrates Kibana dashboards, Elasticsearch storage tweaks for metrics, Docker images on Elastic’s registry (no latest tag), and warns about exposed ES instances and recommended firewall/proxy/security plugin fixes.

AI-written summary · about

" chapters (17)

1. 0:00Start
2. 0:47Who uses more than 10 servers / containers?
3. 0:57How do you log?
4. 1:42What are logs?
5. 6:38Elastic Stack
6. 9:54Filebeat
7. 10:40At-Least-Once, Backpressure, and Graceful Downtime
8. 13:08Multiline Filtering JSON Decode
9. 13:55Logging with Docker 101 options
10. 18:47Read cgroup data from /proc/ Part of the system module
11. 19:04No Docker API access required Security
12. 19:52Enriches process information automatically with cgroup data
13. 21:29In Metricbeat 5.1+
14. 24:34Packetbeat
15. 45:13PS: Ransom
16. 50:02Private network only Firewall
17. 52:11Conclusion

" related talks

• 35mFull Stack Visibility with Elastic: Logs, Metrics and TracesCarlos Pérez-Aradros · KubeCon + CloudNativeCon North America 2017
• 46mMonitoring and metrology for containersJonathan Raffre, Jean-Pascale Thiery · XebiCon'17
• 34mMonitor Kubernetes cluster with ElasticAshish Tiwari · KCD Mumbai 2023
• 50mMonitoring and metrology for containersJ.Raffre, J-P Thiery · Paris Container Day 2017
• 32mELK Stack: Use in Performance Testing and MoreAlexander Venger · QA Fest 2018
• 28mYou’re monitoring containers wrongAlessandro Gallotta · Incontro DevOps 2017
• 31m360° Monitoring of Your ServicesPhilipp Krenn · CloudNativeCon + KubeCon Europe 2017
• 14mCentralized Logs using ELK (Elasticsearch, Logstash, Kibana) StackEstu Fardani · FOSSASIA Summit 2017