The Road Towards an Open Database Performance Ranking

on YouTube ↗47m

" summary

An open database performance ranking built with benchANT publishes reproducible results for nine popular databases across three cloud providers, three VM sizes and cluster sizes of 1/3/9 nodes using YCSB workloads; metrics include ops/sec, read/write latency and monthly cloud-only costs so throughput-per-cost is computable. Bench runs are currently single executions per configuration; full raw metrics and metadata are promised on GitHub. Early findings show Postgres 13 high throughput, untuned MongoDB on EC2 highest ops, and Azure North Europe showing degraded performance due to overbooking.

AI-written summary · about

" chapters (6)

1. 0:00Start
2. 5:13Market Promises
3. 10:50Benchmarking in the Pre-Cloud versus the Cloud Era
4. 17:39Benchmark Selection
5. 28:49The Open Database Performance Ranking
6. 31:57Disclaimer

" related talks

• 56mBenchmark Your Cloud-Native DatabaseJosh Berkus, Sagy Volkov · DevConf.CZ 2020
• 32mBenchmark Your Cloud Native DatabaseJosh Berkus · KubeCon + CloudNativeCon + Open Source Summit China 2019
• 31mDemanding the impossible rigorous database benchmDmitry Dolgov · DevConf.CZ 2023
• 53mPerformance Testing of NoSQL DatabasesDenis Nelyubin · HighLoad++ 2013
• 32mBenchmark Your Cloud Native DatabaseJosh Berkus · KubeCon + CloudNativeCon China 2019
• 36mBest Practices in PostgreSQL Tuning: Navigating Key Performance Bottlenecks in the CloudAlicja Kucharczyk, Dilip Ramachandran · SQLBits 2024
• 29mPerformance Archaeology - 20 years of improvementsTomáš Vondra · POSETTE: An Event for Postgres 2025
• 24mDevOps. Monitoring Databases. On-Premise and Cloud environmentsDmitry Romanoff · DevOpsDays Tel Aviv 2024