~/talk

UltraPoser: Pushing the Limits of IMU-based Full-Body Pose Estimation with Ultrasound Sensing on ...

on YouTube 13m
Talkat UIST 2025 · 2025-09-28..10-01· [machine-learning]

speakers

name:Yadong Li
links:none on file
name:Shuning Wang
links:none on file
name:Yongjian Fu
links:none on file
name:Justin Chen
links:none on file
name:Xingyu Chen
links:none on file
name:Ju Ren
links:none on file
name:Xinyu Zhang
links:none on file
name:Akshay Gadre
links:none on file
name:Ke Sun
links:none on file

resources

video:https://youtu.be/26VpX6JxMfM
slides:none on file

summary

UltraPoser fuses IMU data from a smartphone smartwatch and earbud with ultrasound sensing using built-in speakers and microphones to extend coverage and remove IMU drift. It extracts Doppler spectrum and channel impulse response via narrowband single-tone and odd-even frequency-division multiplexed signals across a 4 kHz band, encodes modalities separately, uses cross-attention and a graph convolutional kinematic model for fusion, and evaluates on a 10-person 300+ frame dataset showing 28.46% improvement overall and up to 67.28% limb error reduction.

AI-written summary · about

chapters (9)

  1. 0:00Introduction and motivation
  2. 1:34Limitations of IMU-only pose estimation
  3. 2:38UltraPose key idea and ultrasound sensing
  4. 4:03Design challenges and solutions
  5. 5:51Sensor setup and hardware details
  6. 6:54Graph-based multimodal fusion framework
  7. 7:38Evaluation results and demo
  8. 9:03Summary and code release
  9. 9:29Q&A session

related talks

~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.