Sprout: Crowd-Powered Task Design for Crowdsourcing
summary
Sprout is an open‑source system that surfaces confusion clusters from worker answers, lets requesters edit instructions and auto-generates a training+testing workflow, then reruns tasks to measure remaining disagreement. A user study (N=11) on car images and travel‑site labeling shows requesters prefer Sprout, produce longer instructions with more examples, and resolve more ambiguous categories; many suggested test questions are adopted and overall disagreement drops after iteration.
AI-written summary · about
chapters (5)
- 0:00Start
- 5:57Sprout Compiles Test Q's into Training & Testing
- 8:31Requester User Study
- 10:29Sprout aids instruction comprehensiveness
- 11:44Task Design Tool Landscape
related talks
25mCrowdsourcing platform engineering
36mConnect platforms with a Kotlin DSL
33mThe Wisdom of Crowds: Crowdsourcing Minimalism in an Open Organization
21mIdeaHound: improving large-scale collaborative ideation with crowd-powered real-time semantic ...
22mAutomate your inner scout
09mInterview
25mGotta catch'em all: recognizing sloppy work in crowdsourcing tasks
19mSketchExpress: Remixing Animations For More Effective Crowd-Powered Prototyping Of Interactive ...