Migrating Prometheus data between different storage systems
summary
Prom-migrator is an open source tool that moves Prometheus data between any remote_write/remote_read compatible stores (Promscale, Thanos, Cortex, M3DB) and handles migrations from megabytes up to petabytes. It uses concurrent pull-and-push of time-range slabs, adapts slab size with additive increase / multiplicative decrease to honor a target memory budget, and remains stateless by recording the last slab’s max timestamp as a separate series so migrations resume after crashes. Demo and repo are available.
AI-written summary · about
chapters (7)
- 0:00Introduction
- 0:10About me
- 0:32Motivation
- 1:12Compatibility table
- 1:42Scenario of migration
- 2:21Memory intensive migration
- 3:31Restart
