Lu Qiu
where else to find them
linkedin:luqiu-ai
what they talk about
all 6 in the filters
where they keep going back
- PyData Global3 editions2022–2024
all 7 in the filters
on a stage with
- Bin Fan2×
- Jasmine Wang2×
- Allison Wangonce
all 21 in the filters
who talks about the same things
- Bin Fan13 talks
- Susan Wu7 talks
- Hope Wang2 talks
- Yaron Haviv7 talks
- Huamin Chen20 talks
- Ronen Dar3 talks
| title | conference | date |
|---|---|---|
| Empowering PySpark with Lance Format for Multi-Modal AI Data Pipelines | PyData Global 2024 | 2024-12-03 |
Claim: PySpark writes directly to Lance format using the Python Data Source API and Arrow so transformed data lands as Lance fragments without intermediate… | ||
| Data Caching for Enterprise-Grade Petabyte-Scale OLAP | USENIX ATC 2024 | 2024-07-10 |
Alluxio local cache embeds on-node SSDs and a page store to serve reads for Presto and HDFS, cutting network I/O and API calls. Deployed at Uber and Meta for… | ||
| Advanced CSI-FUSE Filesystem for AI/ML Data Management in Kubernetes | Data on Kubernetes Day Europe 2024 | 2024-03-19 |
Compares two concrete approaches: CSI-FUSE (mounts cloud object stores as local filesystems) and an etcd-backed FSB (a lightweight Python filesystem API… | ||
| Maximize GPU Utilization for Model Training | PyData Global 2023 | 2023-12-06 |
Uses PyTorch + Alluxio + S3 to build a distributed caching layer colocated with Kubernetes training clusters, implements consistent-hash affinity caching and… | ||
| Overcoming I/O Bottlenecks in LLM Training with Open-Source Distributed... | Open AI + Data Forum @ Open Source Summit Europe 2023 | 2023-09-19 |
Alluxio implements a hierarchical distributed cache (kernel page cache → local disk pages → remote cache cluster) to cut repeated cloud reads, lower metadata… | ||
| Overcoming I/O Bottlenecks in LLM Training with Open-Source Distributed Caching | Open Source Summit Europe 2023 | 2023-09-19 |
An open-source distributed caching layer (Alluxio) is presented that sits between object/HDFS storage and training nodes, using hierarchical cache: memory →… | ||
| How to Eliminate the I/O Bottleneck and Continuously Feed the GPU While Training in the... | Open AI + Data Forum @ Open Source Summit North America 2023 | 2023-05-10 |
Describes Alluxio’s new Dora decentralized repo sitting between compute and cloud storage, built as worker + server-registry + client with no single point of… | ||
| How to Eliminate the I-O Bottleneck & Continuously Feed the GPU While Training in the Cloud | PyData Global 2022 | 2022-12-01 |
Claim: a caching layer called Alessio mounts S3 Azure and HDFS and streams data so GPUs never wait. Implementation uses the POSIX-like process API to load and… | ||
| Alluxio Data Orchestration for Machine Learning | ApacheCon@Home 2021 | 2021-09-21 |
Alluxio adds a POSIX layer with a JNI-based FUSE implementation, a distributed caching layer and a distributedLoad job to prefetch datasets; engineers optimize… | ||
| nothing matches | ||