How to Rewrite VKontakte's Private Messaging Database from Scratch

on YouTube ↗57m

" summary

Describes rewriting VKontakte’s custom personal-messages database engine from scratch because the old engine hindered new features and required massive server counts as traffic grew to trillions of messages and petabytes of data. Explains challenges of scaling and maintainability and the approach taken to build a new storage system to reduce resource use and support future features.

AI-written summary · about

" chapters (6)

1. 0:00Introduction
2. 10:00Message storage evolution
3. 20:00New architecture concept
4. 30:00Data testing and migration
5. 40:00Results and optimization
6. 50:00Q&A

" related talks

• 49mFAQ on the Architecture and Operation of VKontakteAleksey Akulovich · HighLoad++ Moscow 2018
• 53mFrom Algorithm to Production: How to Approach Verification of Distributed SystemsNikita Galushko · Saint HighLoad++ 2023
• 01h 03mArchitecting a large social network without breaking the bankOren Eini · DotNext 2021 Moscow
• 41mHow VK Inserts Data into ClickHouse from Tens of Thousands of ServersYuriy Nasretdinov · HighLoad++ Moscow 2018
• 27mAn Introduction to Messaging in ValkeyKyle J Davis, Roberto Luna Rojas · MQ Summit 2025
• 48mHow VK Inserts Data into ClickHouse from Tens of Thousands of ServersYuriy Nasretdinov · HighLoad++ Siberia 2018
• 01h 05mArchitecture: History and Future Illustrated by VKontakteAleksandr Tobol · Saint HighLoad++ 2022
• 43mHow WhatsApp moved 1.5B users across data centersIgor Istocniks · Code BEAM SF 2019