Pinpointing: Precise Head- and Eye-Based Target Selection for Augmented Reality
summary
System evaluates head and eye multimodal pointing implemented on a HoloLens with a Pupil eye tracker and tested with 12 participants on eight directions and two distances. Head-only pointing yields about 0.3° error; adding a head-based refinement reduces error to ~0.1° (3× improvement) and is the most accurate and fastest refinement. Eye-only requires very large targets (~16° diameter) due to tracker drift; an online correction using previous-trial error vectors, dubbed smart pupil, shrinks refinement distance and enables compact menus via the gaze browser.
AI-written summary · about
chapters (9)
- 0:00Intro
- 0:35Overview
- 2:17Motivation for Pinpointing
- 5:49Refinement with hand gestures
- 6:12Refinement with hand-held controllers
- 6:32Refinement with head motion
- 9:10Tap gesture activate
- 14:25SmartPupil-Online calibration improvement
- 17:02Conclusion
related talks
11mStabilizAR: Enabling Hands-Free Head Pointing while Mobile
10mInside-Out Instrument Tracking for Surgical Navigation in Augmented Reality
06mModeling Pointing for 3D Target Selection in VR
01h 05mChasing holograms - the future of HoloLens development
19mGazeProjector: Accurate Gaze Estimation and Seamless Gaze Interaction Across ...
06mOverthere : A Simple and Intuitive Object Registration Method for an Absolute Mid-air Pointing ...
19mHaptic Retargeting: Dynamic Repurposing of Passive Haptics for Enhanced Virtual Reality Experiences
17mAugmenting Augmented Reality with Non-Line-of-Sight Perception