Just Speak It: Minimize Cognitive Load for Text Editing with a Smart Voice Assistant
summary
SmartEdit is a smartphone voice agent (ASR + TTS, headset buttons) that uses a BERT sequence‑labeler to remove colloquial inserts automatically and two GPT‑2–based models for a just‑speak‑it replacement/insertion flow that predicts insert vs replace, the erroneous span, and insertion position. Trained on simulated voice errors, models report high test accuracy; a 15‑participant study shows 27.3% fewer editing tasks and a 54.1% lower average failure rate versus DesCommand and re‑speaking, with shorter commands and lower cognitive load.
AI-written summary · about
chapters (5)
related talks
13mStepWrite: Adaptive Planning for Speech-Driven Text Generation
52mDesigning digital assistants for those who need it most
44mSmartly AI: Cross Platform Voice Application Creation
59mDesigning for speech
17mBuilding Effective Voice Agents
55mDesigning for speech
38mCreate the next generation of user experiences with text generation
17mThe Voice-First AI Overlay: Designing Conversational Co-Pilots