Automatically shard & scale-out traditional databases on K8s

on YouTube ↗27m

" summary

Claims a concrete path to turn existing MySQL/Postgres/Oracle clusters into a distributed, elastic system using Apache ShardingSphere as a proxy/GDBC layer, with a computing–storage split and read-write splitting to replicas. Shows Helm chart deploy on Kubernetes, SQL dialect for creating sharded tables (hash mod example), a live demo that creates shards and measures higher QPS, and notes that existing tooling and replicas remain usable.

AI-written summary · about

" chapters (10)

1. 0:00Introduction
2. 2:01Big Data characteristics
3. 6:07OLTP vs OLAP requirements
4. 8:18Adopt distributed databases
5. 11:13Turning databases distributed
6. 13:21Benefits of ShardingSphere
7. 15:07ShardingSphere project overview
8. 16:33ShardingSphere JDBC and Proxy
9. 21:42Demo setup on Cloud
10. 26:05Summary and Q&A

" related talks

• 42mPostgreSQL Distributed & Secure Database Ecosystem BuildingJuan Pan · Big Data Conference Europe 2022
• 31mPostgreSQL Distributed & Secure Database Ecosystem BuildingTrista Pan · Conf42 Cloud Native 2022
• 46mDatabase Sharding the Right Way Easy, Reliable, and Open sourceEsen Sagynov, Lee Seongjun · HighLoad++ 2012
• 23mSharding for hyperscale and geographically distributed relational databasesPankaj Chandiramani, Shailesh Dwivedi · Oracle CloudWorld 2022
• 32mData @Scale Seattle- Eric Hwang introduced by Ganapathy KrishnamoorthyEric Hwang, Ganapathy Krishnamoorthy · Data @Scale Seattle 2015
• 32mSharding for mission-critical, internet-scale appsShailesh Dwivedi · Oracle DatabaseWorld 2021
• 38mIntro: VitessSugu Sougoumarane, Deepthi Sigireddi · KubeCon + CloudNativeCon Europe 2019
• 53mBreakout SessionJason Petersen · PGConf Silicon Valley 2015