~/talks

Shengyu Liu

what they talk about

all 4 in the filters

where they keep going back

no series more than once — all 4 in the filters

on a stage with

all 26 in the filters

who talks about the same things

nobody close enough yet

titleconferencedate
FastServe: Iteration-Level Preemptive Scheduling for Large Language Model InferenceNSDI '262026-05-04
FastServe implements iteration-level preemption for autoregressive LLMs, letting the system preempt after each token instead of running to completion. It…
Talk on
Mirage: A Multi-Level Superoptimizer for Tensor ProgramsOSDI '252025-07-07
Mirage is a multi-level superoptimizer that generates custom CUDA kernels from tensor programs using a uniform representation across kernel, thread-block, and…
Talk on
Optimizing RLHF Training for Large Language Models with Stage FusionNSDI '252025-04-28
RLHFuse claims up to 3.7× end-to-end RLHF training throughput by splitting tasks into sample-level subtasks and microbatch subtasks. It overlaps generation and…
Talk on
DistServe: Disaggregating Prefill and Decoding for Goodput-optimized Large Language...18th USENIX Symposium on Operating Systems Design and Implementation (OSDI '24)2024-07-10
System disaggregates prefill and decoding onto separate GPUs, assigns independent parallelism and resource plans for each phase, and places instances to cut…
Talk on
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.