~/talk

Splitting the Monolith

linkedin:zachzundel
slides:none on file

Meta converts its single monolith to a dedicated generative AI tenant that keeps the same developer surface but changes the infra: a smaller colocated deployment with 600 million lines of Hack, a longer request timeout, and about 10x larger thread pools plus JIT-cache warmup and shadow traffic. GenAI requests spend 90% of their time blocked on I/O, so these changes cut latency, enable streaming, remove timeout roadblocks, and make products roughly 30% faster in practice.

AI-written summary · about

  1. 0:00Introduction
  2. 2:40Cooperative Multitasking
  3. 6:43generative AI
  4. 10:03streaming
  5. 18:13conclusion
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.