~/talk

PyTorch Updates

links:none on file
slides:none on file

PyTorch reports 15,000 contributions this year and 1,250 new contributors while remaining the backend for 9/10 top research projects and 90% of open‑source ML repos. The release adds pre-compilation for torch.compile via a new torch Titan graph trainer that produces distributable artifacts and achieves bitwise equivalence and matching performance on Llama 3. A new type system, SPMD types, is open‑sourced to statically verify correct collectives and prevent silent gradient bugs, inspired by JAX sharding.

AI-written summary · about

  1. 0:00PyTorch Conference Europe
  2. 1:25PyTorch growth and community
  3. 2:29D tensor and device mesh
  4. 2:51Pre-compilation with torch.compile
  5. 7:48Pre-compilation challenges and future
  6. 8:31SPMD types for distributed training
  7. 13:03Value proposition of SPMD types
  8. 18:21SPMD types with examples
  9. 20:04Summary and open-source plans
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.