Luo Mai
where else to find them
no profile links on file
what they talk about
all 7 in the filters
where they keep going back
no series more than once — all 7 in the filters
on a stage with
all 26 in the filters
who talks about the same things
nobody close enough yet
| title | conference | date |
|---|---|---|
| BatchGen: An Architecture for Scalable and Efficient Batch Inference | 20th USENIX Symposium on Operating Systems Design and Implementation (OSDI '26) | 2026-07-13 |
An execution architecture represents every input sequence as a fine-grained event-driven coroutine and exposes sequence coroutine compute model primitives to… | ||
| WaferLLM: Large Language Model Inference at Wafer Scale | OSDI '25 | 2025-07-07 |
WaferLLM adapts LLM inference to wafer-scale chips using a PLMR model that guides placement and communication, implements MeshGEMM and MeshGEMV operators, and… | ||
| ServerlessLLM: Low-Latency Serverless Inference for Large Language Models | 18th USENIX Symposium on Operating Systems Design and Implementation (OSDI '24) | 2024-07-10 |
ServerlessLLM is a distributed system that actually stores checkpoints on GPU servers, implements a loading-optimized checkpoint format and a multi‑tier… | ||
| Offloading-Efficient Sparse AI Systems | Sparse 2024 | 2024-06-25 |
Built a system called Infinity that uses request-level tracing to predict and prefetch only the experts actually used during inference, showing that four to… | ||
| Move Fast and Meet Deadlines: Fine-grained Real-time Stream Processing with Cameo | NSDI ’21 | 2021-04-12 |
Cameo treats operator invocations as serverless functions and attaches priority context metadata to events so schedulers stay stateless while propagating… | ||
| Meet MindSpore, the new open source AI framework! | Open Source AI Workshop S1E2 | 2020-09-30 |
MindSpore claims to automate distributed training decisions by using an Auto Parallel component that measures device utilization and gradients, applies a cost… | ||
| Spotnik: Designing Distributed Machine Learning for Transient Cloud Resources | HotCloud '20 | 2020-07-13 |
SPOTNIK implements an adaptive all-reduce ring that repairs membership without global checkpoints, uses an atomic barrier so partially applied parameter… | ||
| nothing matches | ||