FaceWidgets: Exploring Tangible Interaction on Face with Head-Mounted Displays
summary
A hardware prototype mounts physical controls on the HMD backside and uses a stepper-driven lift, OptiTrack and VR gloves to align tangible knobs with virtual counterparts at 20 cm from the eyes (study measured 33 test positions, final layout uses 12 knobs). Two interaction techniques — widget canvas and palm-facing gesture — resolve eye-convergence and reduce double vision. User studies show showing a hand lowers error rate, offset and workload, participants prefer a transparent hand model, and two apps (360 video player and contextual smart‑home input) work well.
AI-written summary · about
chapters (12)
- 0:00Introduction
- 0:51Motivation for FaceWidgets
- 2:14Direct manipulation concept
- 4:30Implementation details
- 6:59Interaction techniques
- 7:22Use case examples
- 8:55User study on operation distance
- 10:21Hand visibility study
- 12:12Hand model preference study
- 13:39User feedback and improvements
- 14:44Conclusion and contributions
- 15:28Q&A session
related talks
21mFaceTouch: Enabling Touch Interaction in Display Fixed UIs for Mobile Virtual Reality
17mLearnings & Challenges for the Integration of Touchless Interaction
43mDesigning for Hands, Gestures, and VR
09mRetargeted Self-Haptics for Increased Immersion in VR without Hand Instrumentation
43mThe Evolution of User Interfaces
07mBringing back human interaction to a digital world
19mProjective Windows: Bringing Windows in Space to the Fingertip
05mHaptic PIVOT: On-Demand Handhelds in VR