Order And Consistency At Scale

on YouTube ↗22m

" summary

Spanner synchronously replicates ranges with Paxos and enforces external consistency so concurrent transactions appear serializable and ordered by real time, enabling lockless consistent snapshot reads. A global TrueTime service provides commit timestamps with an average uncertainty under 1.5 milliseconds, letting read‑only transactions be cheap and nonblocking. Production Spanner handles hundreds of millions of requests per second across 30,000 databases and exabytes of data, and Zanzibar uses Spanner for ACLs at roughly 20 million reads per second with 95% checks under 10 ms.

AI-written summary · about

" chapters (11)

1. 0:00Introduction
2. 1:09Bigtable to Spanner design
3. 3:54Secondary index challenges
4. 5:19Strict consistency matters
5. 8:27Correctness and performance
6. 10:10External consistency with TrueTime
7. 13:22Read-only transactions
8. 15:47Secondary index timestamps
9. 16:09Zanzibar access control
10. 18:18Latency vs consistency
11. 21:06Intuitive system semantics

" related talks

• 49mSpanner - fully managed horizontally scalable relational DB with ACID transactionsRobert Kubis · Spring I/O 2017
• 41mSpanner - Google's Distributed DatabaseSebastian Kanthak · Strange Loop 2013
• 47mGoogle Cloud Spanner: Global consistency at scaleRobert Kubis · JavaDay Ukraine 2017
• 01h 08mKeynote: Building SpannerAlex Lloyd · Berlin Buzzwords 2012
• 33mGoogle Cloud Spanner: Global consistency at scaleRobert Kubis · Devoxx Belgium 2017
• 37mGoogle Cloud Spanner: Going global with relational databaseDmitriy Novakovskiy · GDG DevFest Ukraine 2017
• 21mZanzibar: Google’s Consistent, Global Authorization SystemMike Burrows, Lea Kissner, Ruoming Pang, Ramon Caceres, Zhifeng Chen, Pratik Dave, Nathan Germer, Alexander Golynski, Kevin Graney, Nina Kang, Jeffrey L. Korn, Abhishek Parmar, Christina D. Richards, Mengzhi Wang · USENIX ATC '19
• 01h 00mDistributed transactions implementation trade-offsArtem Aliev · Hydra 2022