Virtual-Physical Environment Manipulation System based on ROS
summary
A web-based digital twin synchronizes a 6-axis robotic arm with a physical unit, using three.js for 3D visualization and a Python backend that publishes/subscribes via ROS bridge and a custom ROS cloud API to record state and replay action scripts; WebRTC streamer pulls an IP camera feed (needed UDP→TCP and port-forwarding fixes) and a C# SDK controls the physical arm; CI/CD uses Docker and Jenkins; the demo shows real-time angle sync and repeatable recordings working end-to-end.
AI-written summary · about
chapters (16)
- 0:00intro
- 0:20preamble
- 1:02today's agenda
- 2:36speaker introduction
- 3:43tools & skills
- 5:40architecture
- 6:29demo
- 8:08what is ros and three.js
- 11:43figma
- 16:13three.js
- 27:16webrtc
- 32:42ros bridge
- 35:13backend - python
- 37:51backend - c#
- 38:27devops
- 39:28conclusion
related talks
56mWhen your Twin is Digital. And in 3D
57mThe Convergence of Robotics, the Web, and IoT
18mRobotics: why now?
46mReal IIoT
15mGhostAR: A Time-space Editor for Embodied Authoring of Human-Robot Collaborative Task with ...
13mReality Promises: Virtual-Physical Decoupling Illusions in Mixed Reality via Invisible Mobile Robots
48mROS on your robot: the tale of an inside, an outside robot and 2 arms
48mBuilding Robotics Applications at Scale using Open Source from Zero to Hero