Stop Making LLMs Deterministic: A Spec-Driven Software Factory
summary
Allegro pilots a spec-driven factory that treats the spec as source of truth and generates code via a multi-agent pipeline (planning, Geneva coding agent, test-out, guardians) running on GCP with Anthropic models through Vertex and spec repo on GitHub. A structured graph-shaped spec (markdown nodes with assertions, tenets, explicit dependencies) cuts token use, surfaces 513 decisions in product catalog (305 product, 208 technical) and enables a run that costs ~$500, takes 12 hours and produces ~80% generated code while flagging the missing 20% for human fixes. Bootstraps, workspace briefs, compile-tests, and a graph validator reduce variance and reveal decision gaps.
AI-written summary · about
chapters (21)
- 0:00Introduction
- 2:01The agentic software factory at Allegro
- 3:03Maturity levels and the spec-driven goal
- 4:38Pilot scope and technology stack
- 5:59Core specifications
- 6:40The multi-agent pipeline
- 9:16The specification as the source of truth
- 10:01Improving the coding agent
- 11:03Specification as a graph
- 11:22Extracting a graph from prose
- 12:02Comparing specification strategies
- 12:49The structured Markdown graph
- 13:45Testing dependency impact
- 14:56A production specification example
- 15:26Assertions, tenets, and dependencies
- 16:42Generated briefs, files, tests, and validation
- 18:38The spec-driven workflow
- 19:03Reviews that expose missing decisions
- 20:16Pilot results: cost and delivery time
- 21:28Next steps
- 22:06Key takeaways
related talks
37mSpec Driven Development: AI Assisted Coding With Doc at the Core
01h 04mSpec-Driven Development: Agentic Coding at FAANG Scale and Quality
47mSpec-Driven Development with AI Agents From High-Level Requirements to Working SW
56mIs Spec Kit the future for software development
01h 13mSpec-Driven Development: The Fast Track to 10x?
28mHow To Use Spec-Driven Development for Production Workflows
45mSpec-Driven Development in the Age of Agents
50mSpec-driven Development using Coding Agents
