Does A/B Testing Work?
summary
A presentation about using A/B testing to resolve team disagreements over design and user interface choices, including cultural differences (e.g., Asian audiences). It describes how the team prepared and set up A/B tests, performed result analysis, and shows real examples (including Facebook News Feed) and practical guidance for newcomers and those who want to try A/B testing on their projects.
AI-written summary · about
chapters (10)
- 0:00Introduction
- 3:19Product changes without testing
- 6:36What is A/B testing
- 9:03Preparing for A/B testing
- 12:34Technical testing process
- 15:45Tools setup and traffic split
- 17:51Results analysis and changes
- 20:00Successful A/B test examples
- 22:11Ethics and limitations
- 23:18Q&A
related talks
09mDemystifying the Dreaded A/B Test
32mAB Testing to Determine Product Priority
41mLittle-Known Pitfalls of A/B Testing
38mTesting, Testing: On Experimental Drift and Data Driven Product Design
39mA/B testing for 250 million people
15mA/B Testing at Scale
28mOptimizing your A/B testing roadmap
48mNo A/B — result XZ, or how we built an A/B testing platform at Ozon