Bodystorming Human-Robot Interactions
summary
Synthé records demonstrations using microphones for speech and armbands for gestures and automatically turns multiple traces into an executable interaction program that runs on a real robot. Synthé records demonstrations and labels traces, then performs synthesis via max-SMT to produce a finite-state Mealy automata that enforces one initial and common sink state. The team evaluates 12 designer pairs in 20–25 minute sessions (design time ~50% brainstorming, 30% editing, 10% acting, 10% simulating). Results work in real time but only generate high-level programs and rely on existing natural language models.
AI-written summary · about
chapters (9)
- 0:00Introduction to Bodystorming
- 2:36Challenges in Robot Programming
- 3:41Research Question and Solution
- 4:24Introducing Synthe Tool
- 7:15How Synthe Works
- 9:42Real-Time Program Synthesis
- 10:06Evaluating Synthe
- 14:28Key Takeaways
- 15:31Q&A Session
related talks
16mStrange New Bodies: Design Beyond Robots
16mEmbodied Sketching
21mDesigning in the age of the 10x engineer
18mSketching CuddleBits: Coupled Prototyping of Body and Behaviour for an Affective Robot Pet
10mYou Had Me at Hello: The Impact of Robot Group Presentation Strategies on Mental Model Formation
22mMorphological Interfaces: On Body Transforming Technologies
39mProgram synthesis for declarative building design
19mBeyond agents: AI as a creative partner
