You as a Puppet: Evaluation of Telepresence User Interface for Puppetry
summary
A telepresence puppet maps head rotation from an HMD and arm pose from a Kinect depth camera to a seven DOF robot whose two eye webcams stream live view back to the performer; mouth motion uses an array of 10 photoreflectors and a microphone so the puppet speaks in sync. User studies with beginners and professionals show beginners perform more easily and all groups rate enjoyment >6 on average, while audience ratings match hand puppetry; issues include servo noise, HMD latency/VR sickness, fixed-stage operation and ~1.5 m² hardware footprint.
AI-written summary · about
chapters (9)
- 0:00Introduction and motivation
- 3:46System concept and design
- 4:29Implementation overview
- 6:17Audiovisual feedback details
- 7:23User study with performers
- 11:22Audience perception study
- 12:26Current limitations
- 15:52Future applications
- 16:57Conclusion and Q&A
related talks
35m3D virtual puppet remote controlled with smartphone
17mNo Place I’d Rather Be: The Future of Telepresence
07m#ProjectPuppetron
48mTalking VR Turkey
19mHaptic Retargeting: Dynamic Repurposing of Passive Haptics for Enhanced Virtual Reality Experiences
40mHolographic Telepresence with Hololens
23mParallel Eyes: Exploring Human Capability and Behaviors with Paralleled First Person View Sharing
10mCatching Jellies in Immersive Virtual Reality: A Comparative Teleoperation Study of ROVs in ...