Natural User Interface using JavaScript
summary
Builds a Leap Motion simulator that fakes the device SDK over websockets so the same JavaScript code runs with or without hardware, runs a mock server on port 3000 or the default 6437, and ships two demos: a one‑finger Draw app that streams tip positions as Leap JSON and a gesture‑driven slideshow using OpenCV/JS object detect and AdaBoost. Demos are light‑sensitive and flaky but the simulator approach and websocket API actually work.
AI-written summary · about
chapters (17)
- 0:00Intro
- 1:45Demo
- 2:22Evolution of user interfaces
- 3:25Natural user interfaces
- 4:16JavaScript
- 4:49Motivation
- 7:44Augmented Reality
- 8:46Perceptive Computing
- 11:21Simulator
- 12:05Architecture
- 12:49Streaming
- 13:04Sleep Ocean
- 14:50Code
- 15:18Draw
- 16:48LeapMotion
- 19:53ClientServer
- 26:36Summary
related talks
20mWeb based 3D Camera Simulator for Perceptual Computing
42mExploring Alternative Interactions in JavaScript
27mCreating natural simulations in a web browser
18mExploring alternative interactions in JavaScript
30mLook mum, no hands ! Mind control in JavaScript
41mFun With JavaScript and Sensors
27mUsing the Microsoft Kinect with Javascript OR Sweatin' to the Web
44mThe Input Shouldn't Matter - Building for Adaptive Input Experiences