CommandBoard: Creating a General-purpose Command Gesture Input Space for Soft Keyboards
summary
CommandBoard converts the area above a soft keyboard into an integrated command gesture space that recognizes freeform gestures and typed command names, supports type-and-execute and inline gesture shortcuts, and shows a dynamic guide when users pause. Built as a keyboard layer with gesture recognition and a command buffer, it runs commands, shows parameter sliders and mode switching, and in a user study selects commands almost twice as fast as markdown and yields 0.09 vs 0.36 styling errors.
AI-written summary · about
chapters (6)
- 0:00Start
- 2:24draw a gesture on top of a soft keyboard
- 2:53extending a transparent election interaction layer above the keyboard
- 7:32drawing a directional line with marking menu
- 11:12changing the font size with a slide bar
- 11:22adjust the font size
related talks
12mTapBoard 2: Simple and Effective Touchpad-like Interaction on a Multi-Touch Surface Keyboard
08mTypeBoard: Identifying Unintentional Touch on Pressure-Sensitive Touchscreen Keyboards
20mHandMark Menus: Rapid Command Selection and Large Command Sets on Multi-Touch Displays
20mDriftBoard: A Panning-Based Text Entry Technique for Ultra-Small Touchscreens
20mExpressive Keyboards: Enriching Gesture-Typing on Mobile Devices
21mDualKey: Miniature Screen Text Entry via Finger Identification
20mTipText: Eyes-Free Text Entry on a Fingertip Keyboard
18mTyping on a Smartwatch for Smart Glasses