Weaponizing the Audio Framework to Beamform with a 5ch Mic
summary
Describes modifying the Android Audio Framework on a Qualcomm device so a 5-microphone array produces a single-channel beamformed audio stream for apps. Integrates an external beamforming library, exposes raw 5-channel PCM via a custom channel-config flag (value 124), performs beamforming in the audio buffer path to convert 5ch→1ch, and overrides HAL headset switching so wired headset insertions still use the device mics. A working prototype returns clear 1-channel beamformed PCM to applications.
AI-written summary · about
chapters (8)
- 0:00Introduction
- 2:38What is Beamforming?
- 4:53Why is Beamforming Necessary?
- 6:16Supporting 5ch Microphone Input: Hardware Edition
- 9:56Supporting 5ch Microphone Input: Software Edition
- 16:17Supporting Third-Party Apps/SDKs
- 22:12Handling Earphone Mic Insertion/Removal
- 25:45Presentation Goals
related talks
26mUsing Qt to Create a Cross Target Audio Holoplot 3D Audio Wall
22mAndroid Built for Radio over IP
43mHome Multimedia and Automation Systems with GStreamer
15mAcoustic Sensing and Communication Using Metasurface
12mMAVL: Multiresolution Analysis of Voice Localization
19mRFocus: Beamforming Using Thousands of Passive Antennas
42mImplementing Bluetooth LE Audio & Auracast on Embedded Linux Systems
26mLE Audio – Specification and Zephyr Implementation