Mixed Reality Robotics Simulation with Ruby
summary
A mixed‑reality rig merges live robot sensors with a simple DragonRuby simulation projected onto the floor, using a ZMQ C extension to stream data; it runs on low‑cost Raspberry Pi clients and currently uses about 15 projectors mounted in a 3000 sq ft lab. Simulations reveal scale mismatches (robot speed ≈ 0.5 m/s looks slow) and calibration matters; the setup runs, the robot reacts to virtual obstacles, and next steps are more projectors and full hardware‑in‑the‑loop integration.
AI-written summary · about
chapters (11)
- 0:00Start
- 0:22Mixed Reality Simulation
- 7:05Live Coding
- 7:39Create a New Project
- 8:18Main Loop
- 10:14Initial Velocity
- 10:51Spring Equation
- 15:52Projectors
- 22:43Future Plans
- 23:46Questions
- 24:50Lidar Sensors








