THE LAST FRONTIER AND BEYOND
summary
Explains a runtime schema representation for Scala ADTs that avoids compile-time derivation limits (shapeless, Magnolia) and solves wire-format evolution by composing explicit migration steps with defaults and renames into the current schema. Uses those alternative schemas to derive alternative readers able to read old and future message versions, preserving backward and forward compatibility. Shows concrete targets: JSON, Avro, Protobuf, property‑test generators, pretty printers and SQL migration scripts, with runtime derivation incurred once at bootstrap.
AI-written summary · about
chapters (7)
- 0:00Start
- 3:13Compile-time derivation
- 12:15Isomorphisms
- 17:11The evolution problem recap
- 18:31Migration steps
- 20:58Upgrading/downgrading schemes
- 22:50Deriving readers
related talks
44mSerialization Protocols with Scala
25mFrom Guesswork to Governance: Bringing API Discipline to Data Streaming
43mUnshaped Protos: Beyond Code Generation for Protocol Buffers
28mAutomating API Busywork with Scala
36mScale By The Bay 2018 Unconference: Devon Stewart
33mEvolving GraphQL Schemas
43mFrom Tower of Babel to Babel Fish: Evolving Kafka Architecture With Schema Registry
24m2 Fast 2 Furious: migrating Medium's architecture...