Scaling YouTube's Backend: The Vitess Trade-offs
summary
Vitess is a Go-based MySQL sharding and routing system that YouTube runs in production since 2011, built around VTTablet (proxy + connection pooling + query parser) and VGate (query router). It automates reparenting (~30s reparent with a 5s goal), supports automated reshard/split, uses Zookeeper for topology, keeps a consistent primary-key row cache via replica binlog subscriptions, and handles spikes (one service accepts ~60,000 connections). Open source, MariaDB-compatible, and operational at web scale.
AI-written summary · about
chapters (19)
- 0:00Intro
- 2:53Start off simple
- 3:19Add replicas
- 8:23Chop and Slice
- 10:33Add data centers
- 13:21Vitess journey
- 14:38Vitess components
- 16:27Vitess lock server (zookeeper)
- 19:47The big picture
- 20:41What does vttablet do?
- 28:37Query service: efficiency
- 31:14Query service: failsafes
- 32:07Query service: enrichment
- 35:03Production ready, runs well
- 36:27The sweet spot
- 36:53We're excited!
- 38:37Crazy ideas
- 43:09The team
- 45:14Questions?
