Getting Back to Sleep ASAP for the On-Call Developer
summary
A concrete postmortem of an on-call incident that adds runtime instrumentation to a live JVM, extracts and correlates a user transaction ID across services, and pivots from logs to traces to locate a faulty billing call. Shows Lightrun-style live debugging: injecting probes, creating short-lived dashboards, and validating a rollback, ending with the service restored and the on-call rota unpaged so the team can return to sleep.
AI-written summary · about
chapters (9)
- 0:00Start
- 0:27Introduction
- 3:14On-call challenges
- 8:30Debugging strategies
- 13:12Handling incidents
- 17:08Real-time troubleshooting
- 20:38Post-incident learning
- 23:25Preventing issues
- 24:27Q&A
related talks
25mGetting Back to Sleep ASAP for the On-Call Developer
50mYou build it, you run it (why developers should also be on call)
44mYou build it, you run it
05mOn-Call in a World Full of Toil
31mHow to Build a Healthy On-call Culture
30mOn call does not have to suck
26mDebugging Clojure Services Under Stress
22mRaise a Production System:Making on-call human-scale w/ Observability & Trust
