Advanced Caching Patterns used by 2000 microservices

on YouTube ↗34m

" summary

Wix handles >500 billion HTTP requests and >1.5 billion Kafka events per day and documents three concrete patterns: Configuration Data Cache persists startup-critical config to local disk or S3 so services boot with stale-but-available data; DynamoDB+CDC based Cache keeps an in-memory LRU per instance repopulated from DynamoDB events via Kafka (Greyhound) for near-zero read latency and fast warmup; HTTP Reverse Proxy Caching uses Varnish with ETag purge events to serve hot HTML at the edge.

AI-written summary · about

" chapters (9)

1. 0:00Introduction and context
2. 1:19Why caching matters at Wix
3. 4:48When to use caching patterns
4. 9:02Static config cache with Koboshi
5. 12:51DynamoDB in-memory cache pattern
6. 22:41HTTP reverse proxy cache with Varnish
7. 29:48Choosing the right cache pattern
8. 32:00Resources and closing remarks
9. 33:02Q&A session

" related talks

• 41mBattle-tested event-driven patterns for your microservicesNatan Silnitsky · Scale By the Bay 2021
• 47mArchitectural Patterns for Caching MicroservicesRafal Leszko · Developer Summit 2020
• 43mBattle-tested event-driven patterns for your Microservices archit.Natan Silnitsky · Devoxx Ukraine 2020
• 45mWhere is my cache? Architectural patterns for caching microservices by exampleRafal Leszko · Voxxed Days Ticino 2019
• 43mWhere Is My Cache? Architectural Patterns for Caching ...Rafal Leszko · Heapcon 2019
• 25mArchitectural Caching Patterns for KubernetesRafal Leszko · Conf42 Cloud Native 2021
• 54mLessons learned from working with 2000 event-driven microservicesNatan Silnitsky · GeeCON 2023
• 46mLessons Learned From Working with 2000 Event-Driven MicroservicesNatan Silnitsky · Build Stuff 2022