~/talks

Zili Zhang

what they talk about

all 5 in the filters

where they keep going back

no series more than once — all 5 in the filters

on a stage with

all 19 in the filters

who talks about the same things

nobody close enough yet

titleconferencedate
FastServe: Iteration-Level Preemptive Scheduling for Large Language Model InferenceNSDI '262026-05-04
FastServe implements iteration-level preemption for autoregressive LLMs, letting the system preempt after each token instead of running to completion. It…
Talk on
Optimizing RLHF Training for Large Language Models with Stage FusionNSDI '252025-04-28
RLHFuse claims up to 3.7× end-to-end RLHF training throughput by splitting tasks into sample-level subtasks and microbatch subtasks. It overlaps generation and…
Talk on
dLoRA: Dynamically Orchestrating Requests and Adapters for LoRA LLM Serving18th USENIX Symposium on Operating Systems Design and Implementation (OSDI '24)2024-07-10
dLoRA is a LoRA-serving system that dynamically merges and unmerges adapters and migrates both requests and adapters to reduce latency and boost GPU…
Talk on
Fast Vector Query Processing for Large Datasets Beyond GPU Memory with Reordered...21st USENIX Symposium on Networked Systems Design and Implementation (NSDI '24)2024-04-16
RUMMY is a GPU-backed vector query engine that pipelines host-to-GPU transfers and computation to handle billion-scale datasets beyond GPU RAM. It implements…
Talk on
Jolteon: Unleashing the Promise of Serverless for Serverless Workflows21st USENIX Symposium on Networked Systems Design and Implementation (NSDI '24)2024-04-16
An orchestrator called Jolteon implements a stochastic performance model combining analytical whitebox formulas and blackbox variability, formulates a…
Talk on
Transparent GPU Sharing in Container Clouds for Deep Learning WorkloadsNSDI 20232023-04-17
Claims a kernel‑intercept OS layer called TGS that enables transparent GPU sharing under Docker/Kubernetes with ~3000 LOC, adaptive rate control and…
Talk on
Fast, Approximate Vector Queries on Very Large Unstructured DatasetsNSDI 20232023-04-17
Auncel provides bounded query error and bounded latency for billion-item vector search by building a per-query error-latency profile that predicts how many…
Talk on
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.