QEMU & KVM Automated Performance Benchmarking @ SUSE
summary
SUSE describes an automated benchmarking framework built on MMTests that runs benchmarks inside and across multiple VMs, creates and installs guest OS images, and can also target containers or KubeVirt VMs by IP. It collects results, plots statistics, profiles and traces, and implements a lockstep synchronization barrier so iterations across VMs line up. Current use finds regressions on product kernels; next steps include running upstream QEMU/KVM, hooking into CI and dashboards, and refining aggregation (now simple averaging).
AI-written summary · about
chapters (16)
- 0:00Introduction
- 0:41Automated benchmarking importance
- 2:07Benchmarking challenges
- 5:35Test matrix complexity
- 8:25mmtests suite intro
- 10:13mmtests automation
- 13:48Synchronizing VM benchmarks
- 16:42Proof of synchronized benchmarks
- 17:24mmtests in development
- 18:30CI pipeline with mmtests
- 19:57Regression testing use cases
- 21:27Benchmarking upstream QEMU
- 22:56Sharing benchmark results
- 24:00Choosing benchmarks and configurations wisely
- 26:28Aggregating VM results
- 27:10Q&A
related talks
22mKnow your QEMU and KVM Test Frameworks
20mQemu Performance Regression CI
20mKubeVirt Benchmar...
28mKVM-unit-tests: When "KVM" Doesn't Mean KVM
41mReducing Friction in Testing Using QEMU and Labgrid for Yocto-based Products
30mKernel Testing with KUnit: Bridging the Gap
10mTowards a More Efficiently Synchronization in KVM
44mBenchmark testing