What You Say is What You Get: Hands-Free Coding in 2022
summary
Claims a workable, low-cost hands-free coding workflow using existing speech engines plus a rule framework: uses Windows or Dragon for recognition, Talon (or Dragonfly/Caster) for command execution, an eye tracker for pointing, and Parrot for ultra-low-latency noise triggers. Shows live editing via dynamic Python grammars and command chaining (e.g., “open paren go left say hi”), demos inserting LaTeX templates and running code with “run code,” and notes the live demo mostly works but has small glitches. Recommends trying a zero-cost setup and adding parrot noise triggers or a paid conformer engine later.
AI-written summary · about
chapters (7)
- 0:00Start
- 4:08Where's the Challenge?
- 7:50Basic Voice Control
- 11:25Dynamic Scripting
- 18:33Handsfree Coding: Talon
- 31:50Multi-Computer Setup
- 34:23Workflow & Anger Management
related talks
14mLook ma, no hands! - How to program without using your hands
29mHello, computer. Writing Ruby with voice recognition
39mCursorless: A spoken language for editing code
09mCursorless: keyboards and mice are sooo last year!!
43mDesktop Linux, without a keyboard, mouse or desk
32mBeyond the Hype: A Pragmatic Look at How Developers Actually Use AI Tools
15mVibe Coding at Scale: Customizing AI Assistants for Enterprise Environments
24mFail fast, fail cheap, making voice apps the guerrilla way