Expressive Keyboards: Enriching Gesture-Typing on Mobile Devices
summary
Built a smartphone Expressive Keyboard (wizard-of-oz + working app) that analyzes gesture features and maps them to continuous outputs (RGB color, interpolated typefaces, parametric emoticons). Experiment 1 shows abundant gesture variation; three quantified features are curviness, inflation ratio, and speed consistency. Experiment 2 maps those features to color and finds ~75% of trials meet at least one success criterion and two thirds meet both, with output-focused control (~80% success) easier than input-focused (~70%). Experiment 3 shows people appropriate gestures in conversation, trading expression for occasional recognition errors.
AI-written summary · about
chapters (14)
- 0:00Introduction and motivation
- 1:08Digital writing limitations
- 2:15Gesture typing basics
- 3:19Expressive keyboards concept
- 4:21Experiment one setup
- 5:46Gesture feature analysis
- 7:32Experiment two control study
- 9:42Results of control study
- 11:26Key findings summary
- 11:47Expressive keyboard demo
- 12:28Experiment three real-world use
- 13:55User behavior insights
- 15:22Future directions
- 16:08Q&A session
related talks
18mM.Gesture: An Acceleration-Based Gesture Authoring System on Multiple Handheld and Wearable Devices
20mTipText: Eyes-Free Text Entry on a Fingertip Keyboard
21mDualKey: Miniature Screen Text Entry via Finger Identification
17mUser-Driven Design Principles for Gesture Representations
24mFrom Touch To Code: Gestures and Beyond
21mBeyond Just Text: Semantic Emoji Similarity Modeling to Support Expressive Communication 👫📲😃
23mIJQwerty: What Difference Does One Key Change Make? Gesture Typing Keyboard Optimization Bounded ...
20mOne-Dimensional Handwriting: Inputting Letters and Words on Smart Glasses