Bringing Incremental Backups to Kubernetes with CSI Snapshot Metadata Service
summary
CSI adds a external snapshot metadata sidecar that exposes two new RPCs, GetMetadataAllocated and MetadataDelta, letting backup software request allocated blocks for one snapshot or changed blocks between snapshots; the demo uses the external-snapshot-metadata repo tools (backup client and verifier), authenticates via Kubernetes token request and token review, and returns ranges (example: 4MiB offsets, maxResults=10) so backups transfer only changed extents — the prototype works on K8s 1.34 alpha.
AI-written summary · about
chapters (12)
- 0:00Kubernetes storage and backups
- 3:34Incremental backups motivation
- 6:03CSI Snapshot Metadata Service
- 6:46Architecture and request flow
- 12:23Live demo setup
- 15:46Writing data and snapshots
- 18:04Fetching backup blocks
- 21:12Verifying snapshot integrity
- 22:39Calculating block changes
- 25:23Benefits and future of CSI CBT
- 26:25Call to action
- 28:19Q&A
related talks
58mProtecting Stateful Workloads With CSI Snapshot
27mIncremental backups in Kubernetes: Where we stand and what's missing
35mBeyond Storage Management
27mCeph-CSI: The Engine Behind Persistent Storage in Kubernetes
01h 27mIntro + Deep Dive: Kubernetes Storage SIG
28mKubernetes Data Protection WG Deep Dive
31mIntro & Deep Dive: Kubernetes SIG-Storage
26mKubernetes SIG-Storage Intro and Update