Android Benchmarking and other stories
summary
Three Android benchmarking tools get compared: microbenchmark (unit-like CPU tests — example: quicksort and RecyclerView scrolls run from a separate Gradle module), macrobenchmark (startup, frame timing, trace metrics; example run with five iterations producing JSON results), and JankStats (released 9 Feb 2022), an in-app jank collector with aggregation and reporting. The recommended CI flow installs APKs on real devices, stores millisecond timings with build IDs, and uses a sliding step-finding algorithm (used by Jetpack Compose) to detect real regressions vs. noise.
AI-written summary · about
chapters (7)
- 0:00Introduction and speakers
- 1:12What is Android benchmarking
- 4:44Microbenchmark framework
- 7:10Macrobenchmark framework
- 10:20JankStats framework
- 13:14Detecting regressions in CI
- 27:31Recap and resources
related talks
36mFighting Regressions with Benchmarks in CI
44mPractical guide to performance Benchmarks
46mEfficient Android UI Testing
46mDo you need the Jetpack Macrobenchmark library?
18mValBench: Benchmarking exact value analysis
40mAndroid Testing
37mState of Android Testing in 2022
02h 41mMicro Benchmarking - The Art of Realizing One is Wrong