Narrated Reality
summary
Claims a pipeline that actually ships: character‑level LSTM models trained on the Oxford English Dictionary and on COCO captions plus a million+ AskReddit questions, packaged as swappable SD‑card models and released on GitHub as neural‑snap. Builds physical devices (camera, clock, compass) using Nvidia Jetson/Raspberry Pi and thermal receipt printers; devices print narrations and appear at Science Gallery and an ITP thesis show (all three briefly working). Produces two films from AI screenplays, word.camera and Sunspring, and a followup It's No Game, with code and examples available.
AI-written summary · about
chapters (36)
- 0:00Introduction
- 0:22Game
- 0:43Borehole
- 1:01tautology
- 1:11logistic
- 2:00lexiconjur
- 4:05personal confession
- 4:47election day 2008
- 5:23presidential proclamations
- 6:02Treasury Department
- 6:44Freelancing
- 7:15Horizontal Writing
- 7:46Diagonalization
- 9:10Coding
- 9:53Word Camera
- 11:32Image Output
- 12:40Physical Devices
- 14:07Deep Learning
- 14:24LSTM
- 14:53Image Captioning
- 15:56Neural Snap
- 16:56Devices
- 17:47Clock
- 18:57Output
- 19:44Camera
- 20:02Compass
- 20:48Outputs
- 21:19Dialogue Model
- 22:01Sunspring
- 24:58Unasked Questions
- 26:29Lavalier Mic
- 27:12Project Word Car
- 28:28Project Word Camera
- 29:04Its No Game
- 30:12Word Camera Demo
- 34:17Dialog Demo
related talks
20mRoss Goodwin, Technologist, Sunspring, NYC 2017
01h 03mIt's All About AI
40mKeynote: Open-source Multimodal AI in the Wild
44mThe Limits of Imagination : An Open Source journey
34mI, Human
25mDecoding Algorithmic Artistry: Visual Generative AI
49mKeynote 4: Here Come The Robots - Python and Machine Learning
01h 04mMachines, Learning, and Machine Learning