Hands-Free Coding With Gaze Control in JavaScript
summary
Prototype uses TensorFlow.js + face‑landmarks model to read normalized iris coordinates (threshold ~0.355) and a simple UI that halves option lists until one remains, then sends keystrokes via Electron app + robot.js emulating keyboard to VS Code. Project is packaged as an open‑source gaze-detection npm and demos creating a tiny React component in under 30 seconds. Works under good lighting, has a learning curve, and cannot run as a VS Code extension due to webcam access limits.
AI-written summary · about
chapters (7)
- 0:00Introduction
- 1:34Inspiration for the project
- 4:26Hands-free coding by Josh Comeau
- 5:37How Charlie worked on her project
- 14:49Project demo
- 16:12Limitations
- 19:47Conclusion
related talks
25mHands-free Coding with Gaze Control in JavaScript
42mExploring Alternative Interactions in JavaScript
30mLook mum, no hands ! Mind control in JavaScript
14mLook ma, no hands! - How to program without using your hands
26mSelf-Portraits in JavaScript
45mMind control in JavaScript - Experimenting with alternative interactions
19mHand gesture-controlled robot through the Internet
18mExploring alternative interactions in JavaScript