Implementing the Web on Native With Linked Literate Programming
summary
Implements the W3C getUserMedia camera API on native iOS using Expo and AI agents that read spec sections and Web Platform Tests, linking code to spec with lightweight comments (the string "at ref lp"). Agent work starts on an iOS simulator without camera, later validates on a real iPhone; the test harness reaches 246 of 246 tests passing. Uses linked literate programming with getUserMedia, native modules, WebGPU demos and depth-sensing prototyping, and reports higher token/time cost for underspecified demos.
AI-written summary · about
chapters (15)
- 0:00Introduction: When Agents Write the Code
- 0:48The Problem of Lost Intent
- 1:48What Is Linked Literate Programming?
- 2:47Coverage, Accuracy, and Intent
- 3:46Why Web Specs Make Great Inputs for AI
- 4:31Demo: Bringing the Web Camera API to iPhone
- 5:09Using Web APIs as a Cross-Platform Abstraction
- 6:16Building getUserMedia with Specs and Tests
- 7:12From Simulator to Real Device Testing
- 8:08Running Browser Camera Demos in Native Apps
- 9:14WebGPU, AI Vision, and Camera Processing
- 10:07Extending the Approach to WebXR and Depth Sensing
- 11:06The Surprising Cost of Building Demos
- 11:55Why Detailed Specs Make AI More Effective
- 12:09Final Thoughts on Linked Literate Programming
related talks
31mExpo for web
34mWhy we need a better browser
28mWeb Is The New Native
21mFrom iOS to Web in Two Weeks: How AI Coding Is Redefining the Product Engineer
31mBreaking the Limits of PWAs with JavaScript APIs
32mBuilding Web-Controlled AR Experiences at the NYTimes
40mWhats next for the Web
51mGoing Web Native