Distributed performance testing at the push of a button

on YouTube ↗23m

" summary

Automated pipelines create and tear down distributed test clusters at the push of a button: Terraform spins up a test cluster, GitLab pipelines upload a jar, Cucumber drives JMeter to assemble and run distributed plans on remote slaves, reports are published and the cluster is destroyed to save costs. The project takes about two months and eight people to build, test updates take under a minute, early runs hit ~20 req/s but the framework scales by adding slaves and tests run green with aggregated JMeter and Cucumber reports.

AI-written summary · about

" chapters (7)

1. 0:00Start
2. 4:10Concept An executable test suite
3. 5:25Concept Laying the pipes Test pipeline
4. 7:45Costs and benefits How to create a test framework that all teams can and will use?
5. 8:54Costs and benefits Benefits using Cucumber
6. 10:37Costs and benefits Benefits of do-it-yourself
7. 11:18Costs and benefits Benefits of reusing product tooling

" related talks

• 45mBuilding loose-coupled continuous testing platformArtem Rozumenko · DelEx Conf 2019
• 26mOn-demand Test Infrastructure on ECS as codeBharti Madaan · Selenium Conference India 2018
• 46mPerformance Testing FrameworkAnton Serputko · QA Fest 2018
• 45mHow to Build a Performance Testing Pipeline from ScratchValera Zakharov · droidcon San Francisco 2018
• 27mAdvanced Multipurpose Infrastructure: A Self-Managed Cloud Environment with HashiCorp TerraformAleks Volochnev · HashiTalks 2019
• 29mEphemeral Cloud Infrastructure for Acceptance Tests with Terraform Enterprise & GitLabWes Novack · HashiTalks 2021
• 47mTest infrastructure on steroidsSergey Pirogov · SeleniumCamp 2018
• 43mInfinite Space for Your TestsAlexei Khursevich · DelEx Conf 2019