Enhancing Data Integrity in Linux
summary
Describes three main kernel changes: a new io_uring PI pointer SQE fields API (merged in v6.14) that lets applications attach per-I/O protection metadata; a PI offset for flexible placement change (merged in v6.9) so drivers declare where metadata lives; metadata buffers get pinned to eliminate bounce-copy overhead; and a checksum-offload mount option that lets filesystems hand checksum work to NVMe devices. Reported results: host writes drop ~35% (direct IO), FS/extent tree writes drop up to 77%, CPU use falls ~30% on random write, SSD power ~18% lower.
AI-written summary · about
chapters (9)
- 0:00Data integrity in Linux
- 1:06Existing integrity stack
- 4:35Gaps in integrity
- 5:38Flexible PI placement
- 7:04User space PI interface
- 13:29Optimizing IO path
- 14:36Checksum offload
- 23:31Future directions
- 26:24Q&A
related talks
50mOverview of the Linux Storage Stack
45mData Placement in Linux: Evolving Block and File I/O
37mLarge Block I/O for Linux
43mThe Forefront of the Development for NVDIMM on Linux Kernel
01h 06mIO in PostgreSQL: Past, Present, Future
52mHow ZNS SSD's Are Changing the Landscape
41mLinux IO internals for PostgreSQL administrators in 2023
19mEvaluating File System Reliability on Solid State Drives