~/talks

Yinmin Zhong

what they talk about

where they keep going back

no series more than once — all 5 in the filters

on a stage with

all 58 in the filters

who talks about the same things

nobody close enough yet

titleconferencedate
FastServe: Iteration-Level Preemptive Scheduling for Large Language Model InferenceNSDI '262026-05-04
FastServe implements iteration-level preemption for autoregressive LLMs, letting the system preempt after each token instead of running to completion. It…
Talk on
DistRS: Disaggregated Reward Service for RLVR with Batch-Level ConstraintNSDI '262026-05-04
DistRS is a disaggregated reward service that separates reward computation from training, implements a microservice pipeline with per-stage worker pools, and…
Talk on
Optimizing RLHF Training for Large Language Models with Stage FusionNSDI '252025-04-28
RLHFuse claims up to 3.7× end-to-end RLHF training throughput by splitting tasks into sample-level subtasks and microbatch subtasks. It overlaps generation and…
Talk on
DistServe: Disaggregating Prefill and Decoding for Goodput-optimized Large Language...18th USENIX Symposium on Operating Systems Design and Implementation (OSDI '24)2024-07-10
System disaggregates prefill and decoding onto separate GPUs, assigns independent parallelism and resource plans for each phase, and places instances to cut…
Talk on
MegaScale: Scaling Large Language Model Training to More Than 10,000 GPUs21st USENIX Symposium on Networked Systems Design and Implementation (NSDI '24)2024-04-16
MegaScale is a production system that trains LLMs on more than 10,000 GPUs and achieves concrete gains: 55.2% Model FLOPs Utilization when training a 175B…
Talk on
AlpaServe: Statistical Multiplexing with Model Parallelism for Deep Learning ServingOSDI 20232023-07-10
AlpaServe uses model parallelism not just to fit big models but to statistically multiplex GPUs across many models, trading partition overhead for burst…
Talk on
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.