Situated Live Programming for Human-Robot Collaboration
summary
A situated live programming system lets end users draw annotations on a robot-mounted camera feed to create atomic trigger-action pairs (presence, absence, object state) and a parameterized move action (by zone, pattern, or grid). The implementation focuses on pick-and-place behaviors, shows a conflict arbitration pop-up for simultaneous triggers, and runs on a tablet. An evaluation with n = 10 has users complete sorting, kitting, and assembly tasks; participants successfully build and iteratively edit reactive robot programs.
AI-written summary · about
chapters (10)
- 0:00Start
- 0:24Context
- 1:10Challenges
- 1:41Situated Live Programming
- 2:06Trigger-Action Programming (TAP)
- 5:20Implemented Syntax
- 6:02Priority Conflicts
- 6:22Exploratory study Sorting Tosk
- 8:19Excerpts from the semi-structured interview
- 8:40Summary
related talks
13mPATI: a projection-based augmented table-top interface for robot programming
12mWORM: Programming Collaborative Robots Through Manual Actions for Craft-Aligned Digital Fabrication
33mThe New Generation of Robots
14mTowards Unobtrusive Physical AI: Augmenting Everyday Objects with Intelligence and Robotic Moveme...
18mRobotics: why now?
20mRobotic Assembly of Haptic Proxy Objects for Tangible Interaction and Virtual Reality
25mLive Programming and Programming by Example: Better Together
20mAuthoring and Verifying Human-Robot Interactions