Zhuohan Li
where else to find them
no profile links on file
what they talk about
where they keep going back
no series more than once — all 3 in the filters
on a stage with
all 15 in the filters
who talks about the same things
nobody close enough yet
| title | conference | date |
|---|---|---|
| The State of vLLM | Ray Summit 2024 | 2024-09-30 |
vLLM is an open‑source LLM inference and serving engine (origin Aug 2022, open‑sourced June 2023) that now powers production demos and cloud integrations and… | ||
| Fairness in Serving Large Language Models | 18th USENIX Symposium on Operating Systems Design and Implementation (OSDI '24) | 2024-07-10 |
Defines fairness as a token-cost function (input vs decode tokens) and implements a scheduler that updates per-client virtual counters at token granularity… | ||
| AlpaServe: Statistical Multiplexing with Model Parallelism for Deep Learning Serving | OSDI 2023 | 2023-07-10 |
AlpaServe uses model parallelism not just to fit big models but to statistically multiplex GPUs across many models, trading partition overhead for burst… | ||
| nothing matches | ||