~/talk

Capacity Planning for AI Training Hardware

Talkat Product @Scale 2024 · on Wednesday, 2024-08-14· [ai-assisted-development, cloud-infrastructure]
name:Rahul Rai
linkedin:rahulrai243
slides:none on file

Meta describes mCP as a process that turns product forecasts into firm hardware orders using capacity contracts and a unified resource schema so new accelerators plug in without rewriting tooling. Planning targets include ~600k GPUs by end of 2024 across a multivendor fleet (NVIDIA, AMD, Meta silicon) and regional collocation to avoid cross‑region traffic. Decision engines run at different cadences: the mCP solver on a quarterly cycle, Tetris solver hourly/daily for data placement, and a real‑time job placer; Infra Cloud Portal and ML Hub expose the flows.

AI-written summary · about

  1. 0:00Introduction to MCP
  2. 2:24Growth and complexity
  3. 4:15AI training challenges
  4. 7:16AI foundations
  5. 14:26Solver and runtime operations
  6. 16:01User experience interfaces
  7. 17:55Threads launch case study
  8. 20:13Future outlook and closing
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.