Flying a drone with gestures, bananas & Web APIs

on YouTube ↗45m

" summary

Hacks a Parrot Mambo Mini over Web Bluetooth and counts five practical ways to “kill” a drone, starting with packet inspection via Wireshark then switching to Bluetooth Low Energy. Uses phone accelerometer via the Generic Sensor API to mimic motion, converts bananas to keyboard events with a Makey Makey (original Arduino prototype), and replaces a Leap Motion with hand-pose (TensorFlow) for touchless control; also demos voice control with the Web Speech API — most demos succeed live.

AI-written summary · about

" chapters (15)

1. 0:00Introduction
2. 4:18Professional roles
3. 7:09Drone hacking with JavaScript
4. 11:51Web Bluetooth basics
5. 13:18Phone movements mimic drone
6. 15:45Live demo: drone with bananas
7. 19:25Makey Makey gesture circuit
8. 21:32HCI research background
9. 24:03Drone control with hand gestures
10. 27:44Multi-user drone control
11. 31:15Accessibility challenges
12. 35:06Voice commands for drone
13. 37:28Eye-tracking drone control
14. 39:18Playful tech learning
15. 43:18Q&A

" related talks

• 29mFlying a drone with twitter, bananas & Web APIsNhlanhla Lucky Nkosi · NDC Melbourne 2025
• 33mFlying a drone with twitter, bananas & Web APIsNhlanhla Lucky Nkosi · DevFest WI 2020
• 38mFlying a drone with twitter, bananas & Web APIsNhlanhla Lucky Nkosi · NDC London 2026
• 18mFlying drones with Twitter, Bananas and WebAPIsLucky Nkosi · CodeLand 2020
• 44mFLYING A DRONE WITH TWITTER, BANANAS & WEB APISNhlanhla Lucky Nkosi · jsday 2020
• 43mTo kill a working drone: flying a drone with twitter, bananas & Web APIsNhlanhla Lucky Nkosi · JSConf Budapest 2022
• 35mDancing with RobotsJulian Cheal · JSConf Budapest 2015
• 23mFlying a drone autonomously with JSSharmiladevi · JSFoo 2015