Inspecting Nomad Events Using Grafana Loki

on YouTube ↗25m

" summary

Collects Nomad event stream with nomad-events-sink, uses the Nomad Go client to subscribe and batch events (flush on batch size 5 or 5s idle timeout), forwards via HTTP into Vector, transforms with Vector remap language (VRL), and stores in Grafana Loki (also supports ClickHouse/S3/Postgres). Demo shows events indexed in Loki, JSON parsing and label queries for job IDs and node drains, and working alerting for failed deployments and unhealthy nodes using Grafana/PromQL.

AI-written summary · about

" chapters (6)

1. 0:00Introduction to Nomad events
2. 5:03Subscribing to Nomad event stream
3. 12:30Processing events with Vector
4. 17:29Demo of event pipeline
5. 23:35Use cases and monitoring insights
6. 25:01Conclusion and Q&A

" related talks

• 22mAdding Observability to HashiCorp Nomad Applications with GrafanaCyril Tovena · HashiTalks 2021
• 21mMonitoring Nomad with Prometheus and IcingaBram Vogelaar · HashiTalks 2020
• 44mIntroduction to Grafana LokiJulien Pivotto · CentOS Dojo Brussels 2020
• 25mAutoscaling Your Nomad Jobs Using SRE InsightsBram Vogelaar · HashiTalks 2021
• 53mGetting started with Grafana Loki, a modern logs databaseKaviraj Kangaraj · DevOpsDays Geneva 2023
• 05mGrafana Loki Log Aggregation for Incident InvestigationsCallum Styan · DevOpsDays Vancouver 2019
• 30mAutoscaling with HashiCorp NomadBram Vogelaar · stackconf online 2021
• 18mData Management & Monitoring at The National Library of the NetherlandsGerard van Engelen · GrafanaCON 2024