~/talk

Cache Strategies with Best Practices

Talkat SREcon21 · 2021-10-12..10-14· [web-performance]
name:Tao Cai
links:none on file
slides:none on file

Describes concrete tactics: introduce soft and hard TTL plus async refresh so expired keys keep serving while background refreshes run, and dynamic TTL based on change frequency; dedupe fallback to run one DB fetch for many concurrent misses; cache partial and empty results and cache DB error status with short TTL; persist or peer-copy local caches and use remote cache or sharding (one deployment example reduces per-node dataset to 25%); memory optimizations cut one structure from 7 GB to 700 MB.

AI-written summary · about

  1. 0:00Intro
  2. 1:30Read-through Cache Architecture
  3. 2:24A simple cache implementation
  4. 3:35A production issue
  5. 5:22Async Cache Refresh
  6. 6:44Dynamic TTL
  7. 7:55Notification pipeline
  8. 8:37Time-to-live (TTL)
  9. 9:22A real production issue
  10. 10:15Dedup fallback calls
  11. 10:46Async cache update
  12. 12:07Cache partial, empty and error result
  13. 13:56Persistent cache
  14. 14:50cache rsync
  15. 15:32A shared remote cache
  16. 15:54schema upgrade
  17. 16:37cache warm up
  18. 17:51local cache format
  19. 18:47duplication objects
  20. 19:58remote cache schema
  21. 21:30Sharding and memory usage
  22. 22:27Conclusion
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.