Making tech boring to keep data exciting
summary
Climate Policy Radar describes concrete moves: migrating from AWS Step Functions to Prefect and Snowflake, replacing brittle end‑of‑pipeline checks with DBT CI tests and a candidate→publish cloning workflow, adding SLAs and Slack alerts, and turning a 29 hours to 15 minutes recovery into an idempotent join in Snowflake. Expect specifics about orchestration that supports recovery, actionable quality signals, incremental cutovers instead of shadow pipelines, and examples like regex classifiers kept for speed and interpretability.
AI-written summary · about
chapters (6)
- 0:00Introduction
- 2:50Boring solutions for real problems
- 5:58Incremental delivery
- 11:24Pipeline observability
- 18:51Resiliency over heroics
- 27:40Summary
related talks
30mA Devops Approach to Data: A Tale Through the Trenches in Search of a Cloud Data Revolution
38mKeeping pace with data infrastructure so it doesn't outrun you
45mResilient Predictive Data Pipelines
16mTransforming Public Sector Observability
38mData Secrets from a Platform Engineer
33mAutomating Data Analytics: Collect, Transform and Deploy - Lead With Change
57mCloud Adoption Patterns
31mHow to Implement DataOps using