Designing Hands-First Games: A VR Developer's Guide to Getting It Right
summary
Hand tracking is now used by 50% of Quest 3 users monthly and claims about when to pick hands are concrete: controllers give near 100% input reliability versus hand tracking at ~97% reliability, which matters for split-second shooters but not for gesture-driven social or comfort-focused games. The team ships an Interaction SDK essentials package for Unity/Unreal, records gestures (26 bones per hand plus pinch values), documents occlusion and fast-motion limits, offers fast‑motion and wide‑motion modes, and shows Maestro (a conductor game) successfully built for hands from day one.
AI-written summary · about
chapters (15)
- 0:00Introduction to Hand Tracking and Input Technology
- 1:49Choosing Between Controllers and Hand Tracking
- 2:50Unique Value Propositions: Reliability vs. Social Presence
- 4:32Interactions Suited for Controllers vs. Hands
- 7:34Best Practices for Designing Hand Interactions
- 8:21Differentiating Interaction Design and Meta Interaction SDK
- 10:31Leaning into Embodiment
- 12:28Using Affordances to Drive Immersion
- 14:40Case Study: Implementing Hand Tracking in 'Maestro'
- 18:12Data Differences: Controllers vs. Hand Tracking
- 19:33Pose and Gesture Detection Methods
- 22:01Technical Limitations and Perspective of Cameras
- 24:22Designing User Interfaces for Hand Tracking
- 26:04Natural and Intuitive Interactions
- 28:11Audience Q&A
related talks
43mDesigning for Hands, Gestures, and VR
34mFuture VR Input & UX Solutions
16mGetting hands on with VR
16mMagicalHands: Mid-Air Hand Gestures for Animating in VR
09mRetargeted Self-Haptics for Increased Immersion in VR without Hand Instrumentation
08mThe Effects of Hand Representation on Experience and Performance for 3D Interactions in Virtual R...
50mVR Best Practices
17mLearnings & Challenges for the Integration of Touchless Interaction