"Distributed Ranges": Model for Building Distributed Data Structures, Algorithms & Views
Talkat CppCon 2023 · on Monday, 2023-10-02· at 16:45· Cottonwood 2/3, 6700 North Gaylord Rockies Boulevard·
summary
Claims a concrete model that makes C++ algorithms and views interoperate with many distributed data structures by adding concepts and customization points to the ranges library. Implements remote ranges via remote pointers with proxy references (RDMA‑style) and a segments customization point, limits to trivially copyable element types, and provides two working back ends: a multi‑GPU CLE/SHP path (demo on eight GPUs) and a multi‑node NPI/MHP path; shows good scaling and practical limitations (zip/transform view workarounds).
AI-written summary · about
chapters (18)
- 0:00Introduction
- 1:10Distributed ranges concept
- 2:37Parallel/distributed challenges
- 4:43C++ ranges background
- 8:15Parallel execution policies
- 10:42Communication mechanisms
- 13:11Remote pointers
- 16:24Distributed iterator concepts
- 19:11Distributed data structures
- 21:42Remote ranges & locality
- 24:12Distributed algorithms
- 27:28Distributed views challenges
- 32:25Multi-GPU execution models
- 34:33Live demo
- 39:35Distributed matrices
- 44:14Lessons learned
- 47:42Summary & project
- 48:25Q&A
