Web Acceleration Mechanics

on YouTube ↗43m

" summary

Compares architectures and internals of specific web accelerators (Nginx, Varnish, Apache Traffic Server, HAProxy, H2O, Tempesta FW) to explain how they manage client/backend connections, HTTP message queuing and failover, and the security consequences. Covers how HTTP/1.x, HTTP/2 and HTTP/3 (QUIC) parsers and HPACK/QPACK compression interact and can harm performance, what HTTP allows to be cached and different caching implementations (mmap(), file cache, database), plus network I/O and TLS optimizations in accelerators and modern Linux kernels.

AI-written summary · about

" chapters (35)

1. 0:00Who am I?
2. 0:53Tempesta FW: Application Delivery Controller (ADC)
3. 1:07Web accelerator
4. 2:20Agenda & Disclaimer
5. 2:48Server connections
6. 3:41HTTP/1 message pipelining
7. 4:21HTTP Response Splitting attack (Web cache poisoning)
8. 9:26Resend HTTP requests?
9. 10:26Requests reforwarding (not for persistent sessions!)
10. 13:47HTTP/2 prioritization
11. 15:15HTTP messages adjustment
12. 16:19Multi-pass HTTP parser
13. 16:54Switch-driven HTTP parser
14. 17:50HTTP parsers in the wild
15. 18:32Why HTTP strings matter?
16. 19:45Let's check
17. 20:17HPACK (HTTP/2) & QPACK (QUIC)
18. 23:12HTTP/2 as the first class citizen
19. 24:47Not to cache
20. 25:09Cache Set-Cookie?
21. 26:56Cache entries freshness
22. 27:53HTTP/2 server PUSH
23. 30:16Vary
24. 33:23Cache storage: mmap(2)
25. 34:05Requests coalescing
26. 35:1210 & multitasking
27. 35:32Threads vs Processes vs Softirq
28. 37:03Network asynchronous I/O
29. 37:45vmsplice(2) zero-copy transmission
30. 38:30User space HTTP proxying
31. 39:07Tempesta FW: zero-copy proxying
32. 39:32TLS termination
33. 40:11SSL/TLS: (zero-)copying
34. 40:53TLS record size & TCP
35. 41:41TCP & TLS dynamic record size

" related talks

• 40mWhirlwind tour through the HTTP2 specOle Michaelis · Full Stack Fest 2016
• 38mHTTP Headers that Make Your Website Go FasterThijs Feryn · SREcon23 Europe/Middle East/Africa
• 01h 00mHTTP/2 - The future of the web todayRob Crowley · NDC Sydney 2017
• 50mHTTP request proxying by a web acceleratorAleksandr Krizhanovskiy · РИТ++ 2017
• 50mHigh-performance web apps using HTTP/2Owais Zahid · Voxxed Days Singapore 2017
• 34mHow HTTP already solved all your performance problems 10 years agoPaul Sadauskas · MountainWest RubyConf 2010
• 42mHow a Web Accelerator Accelerates Your SiteAleksandr Krizhanovskiy · РИТ++ 2016
• 01h 03mWhirlwind tour through the HTTP2 specOle Michaelis · PHP UK Conference 2016