VK Video Delivery: From 10 Gbps over HTTP to 160 Gbps over HTTPS from a Single Machine
summary
A Java-based HTTP(S) server for serving VK Video was developed on Linux using the one-nio framework and OpenSSL to reach from ~20 Gbit/s up to an experimental 160 Gbit/s on a single machine. The talk covers ten years of development, vertical-scaling challenges encountered, using async-profiler to find bottlenecks, integrating OpenSSL 3 features into one-nio, and practical performance-tuning advice for backend engineers.
AI-written summary · about
chapters (9)
- 0:00Introduction
- 3:38VK video service evolution
- 10:36HTTP server in Java
- 15:10HTTP to HTTPS switch
- 20:21Scaling problems and optimizations
- 26:01TCP and network tuning
- 30:16Kern TLS for acceleration
- 38:20Summary and final settings
- 39:46Q&A
related talks
43mHow to Build a 200 Gbps Video Platform
46mTaming Player Technical Events in VK Video
20mDecentralizing Video Streaming
47mArchitecture of the National Video Hosting RUTUBE: How We Serve 5 Tbps
33mThe Challenges of Testing Video Playback at Scale
23mVideo @Scale Fall 2022 LIVE Q&A #2
49mVideo Killed My Data Plan: Delivering Video that Doesn't Break the Web
48mA 4K Streaming Platform for a Million Concurrent Viewers