Deep Dive into the Prometheus Operator Ecosystem
summary
Explains how Prometheus-Operator converts ServiceMonitor, PodMonitor, Probe and the new ScrapeConfig CRD into a single Prometheus config secret that a config-reloader sidecar mounts, and shows AlertmanagerConfig (v1beta1), Prometheus Agent (v1alpha1) and remote_write setups in real YAML examples. Demonstrates common failures (missing port names, rule syntax) and recommends an admission webhook for rule validation, and calls out sharding limits where replicas split targets and can cause data loss.
AI-written summary · about
chapters (27)
- 0:00Intro
- 0:39Takeaways
- 2:08Prometheus Architecture
- 3:44Typical Monitoring Stack
- 5:20Operator Pattern
- 5:57Operator = CRD + Custom Controllers
- 6:46Prometheus Operator Architecture
- 7:54Prometheus-Operator CRD's
- 8:18Prometheus Custom Resource
- 10:06ServiceMonitor, PodMonitor and Probe
- 11:04ServiceMonitor Example
- 12:39Probe Example: Static Target
- 13:27Probe Example: Ingress
- 13:50What's latest in Prometheus-Operator
- 14:36Additional Scrape Config
- 15:27ScrapeConfig CR
- 17:43Prometheus Agent
- 18:28PrometheusAgent CR
- 18:59How monitoring works?
- 20:04Alerting - PrometheusRule
- 21:35Admission Webhook
- 23:07Alerting - AlertManager CRD
- 23:55Managing AlertManager Configuration
- 24:21Alerting - AlertManagerConfig
- 25:59RemoteWrite
- 28:16Limitations
- 30:01Summary
related talks
24mHow to Be 10x SRE? A Deep Dive to Prometheus Operator
28mPrometheus Operators in the Wild
26mEnd-to-end monitoring with the Prometheus Operator
46mLeveraging Prometheus Service Monitor and Pod Monitor for Enhanced Kubernetes Monitoring
02h 43mPrometheus from A to Z
35mDeclarative Multi-Cluster Monitoring with Prometheus
03mOptimizing Scrape Configs with Prometheus Operator
31mEvolving Prometheus for More Use Cases