PathSync: Multi-User Gestural Interaction with Touchless Rhythmic Path Mimicry
summary
PathSync is a mid-air selection technique that matches a user’s hand motion to on-screen target motion using axis-rotated correlation, double thresholds and activation windows; calibration uses recorded Kinect traces from 20 participants and correlation on rotated argon vectors. Experiments with 40 participants show comparable error and time to Press to Select but higher perceived ease and less fatigue, minimum angular offsets of 37° and 28° support up to 24 buttons, and a 28-day public deployment with Kinect logs returns 1,065 sessions.
AI-written summary · about
chapters (17)
- 0:00Introduction to PathSync
- 1:06Prior work and research questions
- 2:11User study design and shapes tested
- 3:15Calculating correlation for selection
- 4:17Study results and target spacing
- 5:23Why squares worked better than circles
- 6:26Comparison study with Press to Select
- 7:53Tutorial and trial demonstration
- 8:55Quantitative and qualitative results
- 10:20Public deployment and Social NUIz game
- 11:44Discoverability and silhouettes
- 12:53Public study observations and failures
- 13:36Conclusion and contributions
- 14:20Q&A: Ergonomics and performance
- 16:46Q&A: Bits per second and sign language
- 17:38Q&A: Rhythmic sub-menu selection
- 18:40Q&A: Interface design challenges
related talks
21mSummon and Select: Rapid Interaction with Interface Controls in Mid-air
43mDesigning for Hands, Gestures, and VR
19mDesigning Multi-Touch Gestures Using the Space around the Smartwatch as Continuous Input Space
20mIt's a Wrap: Mapping On-Skin Input to Off-Skin Displays
45mUnderstanding the Mathematical Foundations of Spatial Computing
20mToward Realistic Hands Gesture Interface: Keeping it Simple for Developers and Machines
19mEyeScout: Active Eye Tracking for Position and Movement Independent Gaze Interaction with Large ...
20mGravitySpot: Guiding Users in Front of Public Displays Using On-Screen Visual Cues