Maintaining Performance and Reliability on the Edge

on YouTube ↗06m

" summary

Verizon Digital Media Services builds a tool called Coal Mine to manage canary releases across a global CDN, with a live dashboard that links to server management, incident tickets, and customer support. The system enforces A/B comparisons for every change, collects requirements from change reviews and postmortems, and incrementally added dozens of small features that together reduced release risk and made rollouts observable and reversible—practical, used, and effective.

AI-written summary · about

" chapters (10)

1. 0:00Start
2. 0:28Tools & culture-2009
3. 0:45Tools & culture-before 2009?
4. 1:38Delivering on promises
5. 2:02Example: be reliable (TMTOWTDI)
6. 2:19Conway's law: software architecture will mirror your organization
7. 2:46Conway's law: alternate interpretation
8. 3:12Example #1: canary/coalmine tools for release management
9. 4:34Dynamic model: natural confluence points
10. 5:09Practical takeaways

" related talks

• 13mCanary in the Internet MineBrook Shelley · SREcon17 Asia/Australia
• 07mInterviewRob Peters · Velocity Conference Santa Clara 2014
• 07mImproving CDN with the Verizon Media PlatformDave Andrews · O'Reilly Velocity Conference 2019
• 28mSmall Changes, Big ResultsTed Middleton · Velocity Europe Conference 2013
• 21mI Don’t Always Test My Code, but When I Do It’s in ProductionIsaac Mosquera · Spinnaker Summit 2020
• 07mJeff Geiser (Verizon Digital Media Services)Jeff Geiser · Velocity 2016 Santa Clara
• 10mAutomating content delivery in a DevOps worldCraig Adams · O'Reilly Velocity Conference 2017 - New York, New York
• 29mSex, Lies & Videotapes: The Truth Behind Your CDN LogsJavi B · RTC.On 2023