The Evolution of User Interfaces
summary
Shows a decade of lab work that turns eye tracking plus hand tracking into a concrete UI: prototypes on HTC Vive and Leap Motion combine gaze-and-pinch for selection, extend to look-and-drop for dragging, and test hybrid pen/touch modes. Results come from iterative prototypes and user studies: gaze speeds aren’t always higher but interactions show reduced fatigue and far smaller hand movements. Apple Vision Pro adoption of gaze-based clicks validates the concept but mass usability and deployment remain open.
AI-written summary · about
chapters (7)
- 0:00Intro
- 3:21AR/VR today
- 8:50Agenda
- 9:10How did we get here?
- 20:22Where does eye input come from?
- 38:01What's ahead?
- 42:49Outro
related talks
43mDesigning for Hands, Gestures, and VR
14mTransform intent into action through your eyes
17mFaceWidgets: Exploring Tangible Interaction on Face with Head-Mounted Displays
09mAdvanced Augmented Reality interactions
34mFuture VR Input & UX Solutions
21mFaceTouch: Enabling Touch Interaction in Display Fixed UIs for Mobile Virtual Reality
30mLeveraging Decades of Research in 3D UI Makes or Breaks XR
17mLearnings & Challenges for the Integration of Touchless Interaction