Large Block I/O for Linux
Talkat Open Source Summit Europe 2023 · on Tuesday, 2023-09-19· at 12:20· Room 0B (Floor 0), Abandoibarra Etorb., 4, 48011 Bilbao, Bizkaia, Spain·
summary
Proposes changing Linux memory and page-cache units from 4K pages to folios so block I/O can use larger sector sizes (databases often prefer 16k increments). Implements kernel patches that attach buffer_heads to folios, updates the BRD test driver to advertise large blocks and exercises an NVMe target; NFS copy to a 128M transfer surface triggers OOM and reveals increased memory fragmentation. Proof-of-concept runs and needs further testing, qemu/driver work, and patch unification.
AI-written summary · about
chapters (7)
- 0:00Introduction
- 3:58Large block I/O matters
- 11:26Introducing folios
- 16:53Buffer heads legacy
- 25:42Hannah’s implementation
- 33:52Challenges and future work
- 36:48Q&A
related talks
47mEnabling Large Block Size devices in Linux
45mData Placement in Linux: Evolving Block and File I/O
50mOverview of the Linux Storage Stack
34mEnhancing Data Integrity in Linux
36mIntroducing the libblkio High-performance Block I/O API
41mLinux IO internals for PostgreSQL administrators in 2023
40mLinux Storage System Bottleneck for eMMC/UFS
01h 06mIO in PostgreSQL: Past, Present, Future