Every API is a Tool for Agents with Code Mode
summary
Claim: dumping OpenAPI into LLM context hits a 2.3M token wall; solution is agents generating and running TypeScript against a typed SDK inside sandboxed Dynamic Worker Loaders. Live demo builds a 20-endpoint project‑management API, shows one‑round‑trip workflows, and runs untrusted LLM‑generated code in V8 isolates with ~1ms cold starts. Results: massive token savings, composable control flow, and practical safety controls for network and resource access.
AI-written summary · about
chapters (23)
- 0:00Intro
- 0:41Beyond the Glass Box: Giving AI Agents Hands
- 1:16Your 20% Off 🤫
- 1:53The Evolution of MCP: From Bundle Tools to Global Sharing
- 3:30The Context Limit Nightmare: Cloudflare’s 2.3M Token Problem
- 4:41The Core Thesis: Context Limits are an Agent Problem
- 5:05Progressive Disclosure 101: CLI Bash & Self-Documentation
- 5:30The Brittle Reality of Semantic Tool Search
- 6:02Code Mode Unveiled: Discovering Tools on Demand
- 8:20Hidden Inefficiencies: Why Search Costs 17,000 Tokens
- 9:52Typed SDKs: Generating Reliable Pipelines for LLMs
- 11:55The Safety Dilemma: Running Untrusted AI-Generated Code
- 13:04Control Flow Mastery: Solving Brittle AI Workflows
- 14:52Massive Token Efficiency: One Round Trip to Rule Them All
- 16:28Architecture Suicide? The History of Sandboxing
- 18:29Dynamic Worker Loaders: The Ultimate Agent Sandbox
- 20:30Network Lockdown: Controlling Fetch in Isolate Environments
- 21:40Live Demo: Managing Enterprise Projects via Code Mode
- 24:27MCP Evolution: Bringing Server-Side Complexity to AI
- 26:27Scaling to Cloudflare: Managing 2,600 Global Endpoints
- 27:44Action Demo: Deploying Infrastructure via AI Chat
- 31:38Final Thoughts: The Future of Agents & Hiring
- 32:21⁉️ Q&A: Handling Massive Specs & API Discovery Patterns
related talks
26mAPIs in Agentic world
35mUnleash Your Inner API Architect: Build Agents That Deliver
29mThe missing layer: What your APIs need before agents can use them
27mAPI context Is the new contract for an agent-native SDLC
40mAPI Lifecycle: Smarter Design and Governance With Open Tooling
23mDesigning APIs Both Humans and AI Love
26mCan AI Build Your Next API Integration
29mBeyond OpenAPI and AsyncAPI: AI agents wrote the spec, code, and tests - now w…
