Reality Promises: Virtual-Physical Decoupling Illusions in Mixed Reality via Invisible Mobile Robots
summary
A system called Reality Promises creates mixed‑reality illusions by privately directing an invisible mobile robot to pick up and place objects so visual materialization matches physical state; it pairs an on‑headset robot controller Skynet (inverse kinematics, shared Quest anchors, real‑time state machine) with an on‑headset 3D Gaussian splat renderer Splatty Mate (reconstruction from ~200 images, cone culling) to hide the robot. Demos show magic‑make materializing a coconut water, dematerialize/rematerialize plant moves, and character‑driven deliveries and the pipeline operates in real time though collision and multi‑task scheduling remain open challenges.
AI-written summary · about
chapters (7)
- 0:00Introduction and motivation
- 1:47Reality promises concept
- 3:12Magic make interaction demo
- 5:42Skynet robot control system
- 8:12Splatty Mate rendering tech
- 10:09Conclusion and future work
- 10:29Q&A session
related talks
10mMixed Reality check
24mRobotics & the Industrial Metaverse
21mVR and Robots: Solving the future's problems
41mVirtual-Physical Environment Manipulation System based on ROS
56mWhen your Twin is Digital. And in 3D
20mRobotic Assembly of Haptic Proxy Objects for Tangible Interaction and Virtual Reality
07mHapticBots: Distributed Encountered-type Haptics for VR with Multiple Shape-changing Mobile Robots
17mNo Place I’d Rather Be: The Future of Telepresence