Web based 3D Camera Simulator for Perceptual Computing
summary
A web-based simulator claims to let JavaScript replace a physical 3D camera by standing in for the USB stream: a NodeJS websocket server accepts getUserMedia video and feeds SDKs for Intel RealSense, Leap Motion and Kinect. RealSense expects raw image frames vs preprocessed JSON from Leap Motion, so the simulator sends binary array buffers or JSON as needed. Working demos exist for RealSense and Leap Motion, but depth data isn’t yet emulated.
AI-written summary · about
chapters (11)
- 0:00Start
- 1:56You get to hear about this for the next 30 minutes
- 3:093D camera
- 3:35Perceptual Computing
- 3:52Augmented Reality
- 4:38Motion sensing input devices
- 6:17Motivation behind this idea
- 7:20The SECRET!
- 9:16Websocket implementation
- 11:00Code Demo
- 18:25Lastly...
related talks
29mNatural User Interface using JavaScript
28mBuilding Motion Controlled Websites in JavaScript
27mUsing the Microsoft Kinect with Javascript OR Sweatin' to the Web
17mThe future of communication on the web
45mThe visual web of today and tomorrow - WebGL and WebVR.
36mJavaScript for Virtual Reality
36mWear glasses with NodeJS, Puppeteer, and Chrome
26mSelf-Portraits in JavaScript