~/talk

Towards Unobtrusive Physical AI: Augmenting Everyday Objects with Intelligence and Robotic Moveme...

on YouTube 14m
Talkat UIST 2025 · 2025-09-28..10-01· [robotics]

speakers

name:Violet Yinuo Han
links:none on file
name:Jesse T Gonzalez
links:none on file
name:Christina Yang
links:none on file
name:Zhiruo Wang
links:none on file
name:Scott E. Hudson
links:none on file
name:Alexandra Ion
links:none on file

resources

video:https://youtu.be/h_dTUU5jl3g
slides:none on file

summary

System augments everyday objects with onboard motion via robotic wheel platforms and a pipeline that streams camera frames to an off‑the‑shelf VLM for captions, maintains a memory-based temporal understanding, queries an LLM to infer user goals, grounds actions with an object knowledge base, filters outputs with an action‑goal alignment check, and executes A* path planning with Bluetooth motor commands. Built prototypes move trivets, knives, key trays and push dongles; evaluation (4 actors, 4 annotators, 16 raters) matches human decisions and outperforms a VLM baseline.

AI-written summary · about

chapters (7)

  1. 0:00Introduction and vision
  2. 1:27Motivation for physical AI
  3. 3:13System overview and examples
  4. 6:20Technical architecture
  5. 8:29Evaluation and results
  6. 9:11Challenges and future work
  7. 10:15Q&A session

related talks

~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.