It's a Wrap: Mapping On-Skin Input to Off-Skin Displays
summary
Study maps forearm touches to an AR headset (HoloLens), Apple Watch, and desktop display using OptiTrack motion capture and a cone-like arm model with a 10 mm touch threshold. Participants overwhelmingly use the posterior forearm and place the top-left near elbow; orientation stays consistent across devices. Grid mappings show up to ~19% position mismatch and row shifts of ~20% between wrist and elbow. Models predict classification errors and provide an interactive tool for designing touch layouts.
AI-written summary · about
chapters (9)
- 0:00Introduction to study
- 1:10Problem of indirect input mapping
- 2:59Study design and three parts
- 6:31Motion capture and touch modeling
- 9:22Results from display mappings
- 12:37Target grid scaling findings
- 15:08Interface for model exploration
- 15:53Implications and future work
- 16:36Q&A session
related talks
17mFaceWidgets: Exploring Tangible Interaction on Face with Head-Mounted Displays
21mFaceTouch: Enabling Touch Interaction in Display Fixed UIs for Mobile Virtual Reality
43mDesigning for Hands, Gestures, and VR
17mLearnings & Challenges for the Integration of Touchless Interaction
14mSmart Touch: Improving Touch Accuracy for People with Motor Impairments with Template Matching
09mRetargeted Self-Haptics for Increased Immersion in VR without Hand Instrumentation
09mTangibleData: Interactive Data Visualization with Mid-Air Haptics
19mBackHand: Sensing Hand Gestures via Back of the Hand