Designing for Hands, Gestures, and VR
summary
Claims that hand tracking and midair haptics let designers move beyond screens and speed onboarding, backed by Ultraleap’s Leap Motion hand-tracking and a midair ultrasonic haptics array. Prototypes include touchless kiosks with a tap gesture, VR panels with grab/pinch selection, a wrist-mounted “wearable UI,” and an in‑car simulator where haptics map slider intensity to finger buzz. Testing with thousands of users shows large gesture variance, so tolerant tap/grab mappings and exaggerated audio/visual feedback improve reliability.
AI-written summary · about
chapters (13)
- 0:00Introduction to gestural interfaces
- 3:41Ultral’s hand tracking tech
- 9:18Key principles and gestures
- 14:14Flexibility in hand shapes and movements
- 18:52Virtual objects and affordances
- 21:44Wearable UI for VR
- 25:15Haptics for feedback
- 27:42Hand poses and shortcuts
- 29:09Onboarding and learning curves
- 31:37Human factors and ergonomics
- 33:23Mixed reality prototypes
- 34:28Design guidelines and resources
- 35:12Q&A session
related talks
09mRetargeted Self-Haptics for Increased Immersion in VR without Hand Instrumentation
56mDesigning Hands-First Games: A VR Developer's Guide to Getting It Right
09mTangibleData: Interactive Data Visualization with Mid-Air Haptics
16mMagicalHands: Mid-Air Hand Gestures for Animating in VR
43mThe Evolution of User Interfaces
07mWeirding Haptics: In-Situ Prototyping of Vibrotactile Feedback in Virtual Reality through ...
16mGetting hands on with VR
34mFuture VR Input & UX Solutions