Cloud Foundry Logging & Metrics
summary
Describes how Cloud Foundry streams logs and metrics via Loggregator components Metron Doppler Traffic Controller and exposes a full firehose that nozzles can subscribe to; shows using Logsearch (Elasticsearch Logstash Kibana) packaged as BOSH releases with a Redis queue for buffering and Kibana dashboards, and cites a sizing example of ~10 VMs for ~300k logs/min; details two metrics paths: the older collector-to-graphite approach (now community maintained) and a firehose-to-graphite nozzle the presenters built.
AI-written summary · about
chapters (21)
- 0:00Introduction
- 1:17Why logging and monitoring are important
- 3:05Overview
- 3:37Logger Gator
- 5:37Sources
- 7:06Firehose
- 8:55Logging
- 10:31Elk Stack
- 11:45Log Search for Cloud Foundry
- 13:56Cloud Foundry Web Interface
- 15:44Redis
- 16:58pauses
- 18:02elasticsearch
- 18:15Cabana
- 19:12Setup
- 22:42Why Log Search
- 23:53Conclusion
- 24:43Graphite
- 25:33Collector
- 27:51Graphite Nozzle
- 28:44Graphic Server
related talks
30mMonitoring Cloud Foundry: Learning about the Firehose
30mCloud Foundry Monitoring and Metrics Collection Using Sensu and Graphite
25mMonitoring Cloud Foundry Infrastructure and Applications with Stackdriver and BigQuery
33mSeeing the Forest for the Trees: An Operator’s Guide to Observability of CF with...
31mThe Long and Winding Road to Application Logging [A]
32mTuning and Managing Loggregator, the Cloud Foundry Logging Subsystem
10mLightning Talk: Fluentd as syslog drain for CloudFoundry
13mLightning Talk: Cloud Foundry Monitoring: How to Never Leave Your Deployment Unattended