Incident management for small service teams
summary
Red Hat CKI runs kernel CI pipelines and describes a practical incident workflow: detect with Prometheus metrics, Loki logs, and Sentry exceptions, alert via pager or Slack, create a ticket immediately, and move incidents through active → mitigated → resolved → prevented. Example: GitLab runners stop because Docker Machine rejects AWS spot instances due to a too-low bid, quick SSH edit mitigates, CI deployment fixes config, and a policy plus automation prevents recurrence.
AI-written summary · about
chapters (5)
- 0:00Start
- 0:29team background
- 4:41detection: monitoring and alerting setup
- 10:31metrics - Prometheus
- 29:03social dynamics and summary
related talks
31mFrom Jenkins-under-your-desk to resilient service
19mHow to handle incidents at scale
30mHow HashiCorp does Incident Management
05mDevOps and incident management: A recipe for success
01h 04mIncident Management - Talk the Talk, Walk the Walk
35mAgentic Incident Response
34mIncidents Happen
29mComposing the Response: Building an Incident Pipeline from Scratch