Watching Your Phone’s Back: Gesture Recognition by Sensing Acoustical Structure-borne Propagation
summary
StruGesture senses structure-borne propagation using phone speakers/microphones and ultrasonic chirps, isolates structure-borne from air-borne paths via a Peak Selection Algorithm and a calibration exploiting adjacency of CIR peaks, and decomposes signals into gesture-rich and user-rich parts. A deep adversarial network learns gesture-specific representations. System is built on commodity phones, tested with 10 volunteers performing 10 gestures 100 times each across nine scenarios, and achieves 99.5% accuracy, outperforming air-based baselines.
AI-written summary · about