Metric Driven Software Testing
summary
Describes a BI pipeline that ingests JIRA and test logs, uses easy bi for JIRA, and produces dashboards that expose concrete surprises: a spike of 224 bugs week 15, test effectiveness collapsing to 5% test effectiveness, and only 20% of bugs coming from the core product while its fixes take three times longer. Shows building a BI infra, hit a huge data quality cleanup task, tuned metrics and a CPI cadence, and reports what worked, what slowed (performance) and what decisions followed.
AI-written summary · about
chapters (17)
- 0:00Introduction
- 4:02Why is it good
- 5:05Our story
- 5:58Effectiveness
- 6:55Distribution
- 8:11Data Collection
- 8:53Data Issues
- 9:40Lessons Learned
- 10:25Alien
- 10:57False assumptions
- 11:44Results
- 12:29Use Cases
- 13:50CPI Framework
- 15:30Customer Support
- 16:17EasyBI
- 17:20Wrap up
- 19:02Questions
related talks
33mAnalytics Data Driven Testing
39mModern Data Pipelines Testing Techniques: A Visual Guide
53mTransforming testing methodologies: From manual to robust strategies
46mTaking Quality to Next Level: Metrics for Improvement
38mA Game of Testing
37mCI/CD Observability, Metrics and DORA: Shifting Left and Cleaning Up!
06mLightning Talk: Automated Testing Done Right
24mImproving Development Quality and Speed with Agile Testing