Operational Controls
summary
BBC runs over 4,000 services and deploys immutable AMIs with HashiCorp Packer, rolling updates and CloudWatch-driven automatic rollbacks. Production uses JSON-held feature toggles (S3 + agent) surfaced in a Cosmos UI, emitting SNS/Slack events and Datadog markers for visibility. A Kinesis Analytics-backed concurrency counting service caps UHD streams (4k ~36 Mbps) during World Cup/Wimbledon trials to avoid saturating UK bandwidth and works by admitting or denying playback. Operational controls also include flag poles (S3 status files), circuit breakers and static JSON fallbacks at the edge.
AI-written summary · about
chapters (14)
- 0:00Introduction
- 0:32The BBC
- 1:41BBC Account Beep
- 2:55BBC iPlayer
- 3:30Context
- 4:58Operational Controls
- 20:23Staff Mode
- 21:31geolocation restrictions
- 22:19debug menu
- 23:57feature toggle
- 26:57IPlayer
- 29:09Static fallback
- 29:31UHD ondemand
- 30:50BBC Internet Blog
related talks
28mReliability Lessons from Running High Traffic Services for More Than 10 Years
59mAdvanced Observability Strategies for Media Workflows at Netflix
29mHow Seven delivers large-scale streaming success
37mEmbracing Change: Infrastructure Experiment...
31mMastering Near-Real-Time Telemetry and Big Data: Invaluable Superpowers for Ordinary SREs
33mThe Challenges of Testing Video Playback at Scale
31mNode.js that's hugely reliable, fast, and scalable
10mMoving Live Video Quality Control from the Broadcast Facility to the Living Room