Efficient Finger Model and Accurate Tracking for Hover-and-Touch, Mid-air and Microgesture Intera...
summary
Marker-based optical tracking uses four markers per finger, an articulated cylinder-and-sphere finger model, and a 7-minute per-user calibration to get 600 microseconds inference and 25 ms end-to-end latency. The system reports 1 mm touch accuracy and 0.02 mm precision, recovers quickly from occlusions within a ~1 m volume, and supports hover-and-touch, mid-air and microgesture combos; demo edits a 3D point cloud and implements a continuous slider on the index finger.
AI-written summary · about
chapters (7)
- 0:00Introduction
- 1:48Adequate performance thresholds
- 3:56Proposed tracking method
- 6:02Calibration and setup
- 7:49Demo and versatility
- 8:11Conclusion and limitations
- 8:54Q&A session
related talks
10mEllipses Ring Marker for High-speed Finger Tracking
17mAccurate and Low-Latency Sensing of Touch Contact on Any Surface with Finger-Worn IMU Sensor
14mDeepFisheye: Near-Surface Multi-Finger Tracking Technology Using Fisheye Camera
17mLearnings & Challenges for the Integration of Touchless Interaction
18mCamTrackPoint: Camera-Based Pointing Stick Using Transmitted Light through Finger
07mFingerTrak: Continuous 3D Hand Pose Tracking by Deep Learning Hand Silhouettes Captured by ...
43mDesigning for Hands, Gestures, and VR
20mToward Realistic Hands Gesture Interface: Keeping it Simple for Developers and Machines