Make a Difference with Simple A/B Testing
summary
Claims a practical Rails-friendly A/B system that proves tests can be quick to add, easy to update, and trivial to remove. Builds an experiments class per test, a backed experiment events table that logs first-entry buckets, and an experiments table with variant ratios so seeds map deterministically; supports staggered rollouts (example initial 90/10) and computes conversions and statistical significance from DB queries. Migrates events to a polymorphic target so tests apply to users, categories, or orders. Demonstrates the system working at a small startup (nift).
AI-written summary · about
chapters (8)
- 0:00Start
- 2:44Call to Action Buttons
- 4:38Test Collisions
- 10:36Results for Ab Tests
- 11:49Statistical Significance
- 12:27Formula for Calculating Statistical Significance
- 14:25Experiments Table
- 17:43Add a Base Experiments Class
related talks
38mTesting, Testing: On Experimental Drift and Data Driven Product Design
18mData Science Careers via A/B Testing
28mOptimizing your A/B testing roadmap
09mDemystifying the Dreaded A/B Test
28mBeyond A/B: Test automation approaches for web variants from A to Z
01h 00mTesting Heresies
31mGoing on a Testing Anti-Pattern Safari
36mUsing Tests as a Tool to Wrangle Legacy Projects