No Traffic, No Users, No Problem! - Usability Testing for New Apps
summary
Claim: get meaningful usability feedback before any public launch by hooking a local app to a crowd via Rails + Mechanical Turk. Implementation uses an external HIT iframe, the turkey gem, forward/localtunnel to expose a dev server, Vanity/Redis for A/B tests and Heroku for hosting. A built demo 5s5 yields specific fixes (logo contrast, image saturation, a Facebook signin error) and an inconclusive A/B result. Notes: majority of turkers are US/India with many college degrees, spam can hit ~40%, and a gold-standard validating question cuts bot noise and improves quality.
AI-written summary · about
chapters (37)
- 0:00Introduction
- 0:43The Problem
- 1:58Service Critical Church
- 2:26Mechanical Turk
- 3:16Terminology
- 4:05Classification
- 4:22Motivation
- 5:15Demographics
- 5:34Gender Breakdown
- 6:00Education Breakdown
- 6:30Average Income
- 6:49Interfaces
- 7:57Simple Interface
- 8:11External Hit
- 8:30Trigger
- 8:54Turkey Gentleman
- 9:11Turkey Form Core
- 9:30Turkey Workflow
- 10:15Turkey Demo
- 14:34Listening to Feedback
- 15:35Forward Gem
- 16:21Feedback Gem
- 16:34Study
- 18:16Background
- 19:20Sample Feedback
- 21:06Personal Appeal
- 22:49Vanity Room
- 23:29Intent
- 24:25Example Test
- 24:41Assumptions
- 25:44Option A
- 26:14Option B
- 28:50I Am Data
- 30:20Gold Standard Question
- 34:28Content Creation
- 35:25Creative Project
- 36:41The News
related talks
33mHuman Powered Rails: Automated Crowdsourcing In Your RoR App
25mThe hacker's guide to usability testing
24mUsability Testing for Developers
39mHacking usability
31mHow to think `User first`
46mHow to Build Amazing Mobile Games With Rapid User Testing.
48mUser testing on any budget
32mUnderstanding our users