Life After Sharding
summary
Talk discusses post-sharding challenges at Badoo: after physically splitting data, logical relationships remain and data integrity must be maintained. It covers tools and approaches Badoo uses to preserve consistency and integrity across shards in high-load systems.
AI-written summary · about
chapters (12)
- 0:00Introduction
- 4:30Data consistency problem
- 7:44Consistency methods
- 10:11Queue-based solution
- 15:44Event processing principles
- 18:14Cross-DC data replication
- 23:48Queue-driven synchronization
- 26:00Contact processing optimization
- 29:18Real-time event delivery
- 31:23Queue system monitoring
- 34:20Summary
- 34:41Q&A
related talks
49mSharding: from scratch to Yandex Disk
52mTo Shard or Not to Shard
50mApproaches to implementing sharding in modern [No]SQL systems
56mSharding: patterns and antipatterns
28mSharding: DIY or Out of the Box Solution?
32mA New Sharding Architecture for MongoDB
47mSharding in MongoDB
37mSharding: Growing Systems from Node-scale to Planet-scale