3D virtual puppet remote controlled with smartphone
summary
Description of Puppets (github.com/AquiGorka/puppets), a mobile web app that reads smartphone gyroscope data and sends it to a remote web app. The two apps are connected via WebRTC so a control bar over a 3D puppet mirrors the phone’s orientation in real time, and the puppet reacts under applied physics.
AI-written summary · about
chapters (11)
- 0:00Project intro
- 1:48Idea origin and tech
- 5:26P2P smartphone control
- 9:58Key system components
- 13:28Browser-to-browser libs
- 15:153D puppet with Three.js
- 17:39Physics engines
- 21:12Smartphone gyro remote
- 24:01Extra puppet experiments
- 26:35Multiplayer games
- 27:21Q&A
related talks
20mYou as a Puppet: Evaluation of Telepresence User Interface for Puppetry
32mGeppetto's Guide to Living Puppets
43mRemote Controlling Robots with Flutter & WebRTC
19mHand gesture-controlled robot through the Internet
07m#ProjectPuppetron
06mMobileportation: Nomadic Telepresence for Mobile Devices
47mMonitoring Your 3D Prints with an Old Smartphone, from WebRTC…
16mPortal-ble: Intuitive Free-hand Manipulation in Unbounded Smartphone-based Augmented Reality