Audio Keyword Reconstruction from On-Device Motion Sensor Signals via Neural Frequency Unfolding
summary
Claims that a neural network reconstructs high-frequency spoken keywords from 100–400 Hz accelerometer and gyroscope traces by reversing aliasing in the time–frequency domain. It builds a frequency-expanding model using multi-resolution STFT, frequency convolutions and an alias unfolding layer to 16× upsampling of motion data, tested on a Google Pixel 1. Results beat three baselines on two datasets for pre-trained keywords, demonstrating feasible leakage but still limited generalization.
AI-written summary · about
related talks
25mLooking at Sound
45mAuditory Intelligence : beyond speech recognition
20mExploring the hidden potential of sound data
01h 14mExploring the hidden potential of sound data
36mVoice Enabling Mobile Apps and Custom Hardware Devices
42mResearch in the Age of AI
49mGyrophone: Eavesdropping Using a Gyroscope
22mUbicoustics: Plug-and-Play Acoustic Activity Recognition
