Double, Double Toil and Trouble; SRE Transform...
summary
Platform runs automated detection and notification for cryptocurrency miners, escalates via Slack and creates remediation work using Pivotal Tracker API so operators spend fewer cycles on repeat cleanup. Iterations move from detection to creating a tracked story to eventual automatic suspension; detection jobs run on a schedule in Concourse CI with simple bash scripts. Team uses a toil snake, SLI/SLOs and frequency×impact prioritization to pick which chores to automate, then scales solutions by pairing, workshops and self‑service so the fixes actually get adopted.
AI-written summary · about
chapters (5)
related talks
28mToil and Trouble
26mDouble, Double, Toil and Trouble!
22mSRE and Risk management: a love story
26mIncreasing the collaboration between SREs and Developers
17mIncident Response @ Scale-Building a Next Generation SOC
47mPersistent SRE Antipatterns: Pitfalls on the Road to Creating a Successful
54mUnraveling the Differences
47mDetection as Code: The Engineering-Focused Future...