A/B testing and feedback techniques in your mobile apps
summary
Shows how to collect actionable feedback and run real A/B tests: uses store reviews and in‑app prompts, integrates an in‑app feedback widget (Wired Dash — free tier to 100,000 devices, three‑minute setup, screenshot doodling and a confidential widget), and implements A/B tests with Firebase Remote Config + Analytics (limited dashboard, no web AB tests, needs BigQuery for complex queries). Demonstrates a simple e‑commerce CTA color experiment implemented via remote config and cubit, notes small samples fail to reach significance and recommends tools like PostHog 1M free requests for richer funnels.
AI-written summary · about
chapters (17)
- 0:00User feedback and A/B testing intro
- 1:08Why user feedback matters
- 2:13Feedback via store reviews
- 3:58Quick feedback forms
- 4:40Engaging power users
- 6:04Wired Dash tool
- 10:02What is A/B testing
- 13:59Statistical foundations
- 16:28Designing A/B test in 4 steps
- 18:35Firebase A/B test example
- 26:01Firebase limits and alternatives
- 27:47PostHog for A/B testing
- 30:37Other A/B testing tools
- 32:02Overcoming A/B testing barriers
- 33:05Best practices for A/B testing
- 35:55A/B testing beyond features
- 36:59Conclusion
related talks
27mA Tale of Two Components: Mastering A:B Testing in React
09mDemystifying the Dreaded A/B Test
45mHow we killed 80% of features and increased outcomes of a/b testing by 100%
05mUsing A B testing to rebuild the UI used by 1 5 million users a day
39mDIY A/B Testing Architecture
29mA/B and see: Improving User Experience with Experimentation
11mFront-End Analytics for Smarter Products and Engineering Growth
01h 00mMobile App Architecture: How to Conquer the Giant!