Compensating for Distance Compression in Audiovisual Virtual Environments Using Incongruence
summary
Built a spatial audio Unity plugin that runs with Oculus Rift and uses an inverted compression model to render audio displaced from the visual object so perceived distances match a psychometric curve. A within-subjects 2AFC study shows a small but reliable effect: incongruent audio (audio pushed back) improves distance accuracy beyond 3 m while offering no benefit at close range; effect scales with visual noise and shows no dependence on prior VR or gaming experience. Code on GitHub.
AI-written summary · about
chapters (7)
- 0:00Introduction to distance compression
- 2:38Maximum Likelihood Integration theory
- 4:05Modeling distance compression mathematically
- 6:34Experimental design overview
- 8:03Results and data analysis
- 10:29Conclusions and limitations
- 11:55Open source tool and Q&A
related talks
03mSoundTrek: A Virtual Reality Audio Perspective-Switching Game
22mVanishing Importance: Studying Immersive Effects of Game Audio Perception on Player Experiences ...
20mSpatial Communications at Scale in Virtual Environments
18mDepth Conflict Reduction for Stereo VR Video Interfaces
21mComposing Spatial Music with Web Audio and WebVR
13mRepurposing Audio Playback Tools to Test Human Localization with 6DoF Sound
10mImpostor-based Rendering Acceleration for Virtual, Augmented, and Mixed Reality
12mVR Side-Effects: Memory & Proprioceptive Discrepancies After Leaving Virtual Reality