~/talks

Yanghua Peng

what they talk about

where they keep going back

no series more than once — all 4 in the filters

on a stage with

all 49 in the filters

who talks about the same things

nobody close enough yet

titleconferencedate
Optimus: Accelerating Large-Scale Multi-Modal LLM Training by Bubble ExploitationUSENIX ATC '252025-07-07
Reports a system called Optimus that cuts end-to-end MLLM training time by ~20.5–21.3% on 3,072 GPUs (ViT-22B encoder + GPT-175B backbone) by turning idle GPU…
Talk on
ByteCheckpoint: A Unified Checkpointing System for Large Foundation Model DevelopmentNSDI '252025-04-28
ByteCheckpoint implements a parallelism-agnostic checkpoint representation and load-time resharding so checkpoints saved on one GPU layout can be read into…
Talk on
MegaScale: Scaling Large Language Model Training to More Than 10,000 GPUs21st USENIX Symposium on Networked Systems Design and Implementation (NSDI '24)2024-04-16
MegaScale is a production system that trains LLMs on more than 10,000 GPUs and achieves concrete gains: 55.2% Model FLOPs Utilization when training a 175B…
Talk on
BGL: GPU-Efficient GNN Training by Optimizing Graph Data I/O and PreprocessingNSDI 20232023-04-17
Distributed GNN training system BGL builds a dynamic cache engine and a two-level CPU+GPU cache that together cut feature-retrieval traffic and reduce…
Talk on
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.