Autotest Coverage Visualization

on YouTube ↗34m

" summary

A CI pipeline generates a tiny Swagger file per API test, computes a swagger diff against the service spec, and reports which endpoints, parameters and status codes are exercised (finding for one project 349 endpoints with ~10% fully covered and 49% untested). Web tests record element/page/action hits, render UI hotspots, and link failing locators to Allure results and Selenoid video replays via an Allure plugin. The implementation uses rest-assured, Selenium (with Puppeteer support), Atlas and Selenoid, runs automatically, and is intended to improve test focus.

AI-written summary · about

" chapters (7)

1. 0:00Introduction
2. 1:28Autotest coverage misunderstanding
3. 6:26Measuring test coverage
4. 13:47Code coverage visualization
5. 15:12API test coverage with Swagger
6. 22:49Web test coverage via UI graph
7. 31:41Summary

" related talks

• 13mHelping developers with continuous testingAlon Girmonsky, Stephen Feloney · Velocity 2017
• 44mAPI Testing following the Test PyramidElias Nogueira · Selenium Camp 2020
• 25mRethinking Software Quality: Why API Testing Needs to ChangeAmeet Deshpande · Apidays India 2025
• 40mAmplifying Test Automation using REST AssuredShashi Ranjan Kumar, Nilesh Saurabh · J-Fall 2018
• 30mMeasuring Coverage and why Cypress Cloud UI Coverage is the Holy GrailAnthony Browness · CypressConf 2024
• 40mSaying goodbye to full stack tests with task analysisMark Winteringham · SeleniumConf London 2019
• 27mQuest for Adequate Autotest CoverageAlexander Pushkarev · DelEx Conf 2018
• 26mAutomate Your API Testing in CI/CD PipelinesMairtin Conneely · apidays Paris 2021