dbt: A Software Engineering Approach To The Analytics Workflow
summary
dbt is an open‑source SQL-first transformation framework that adds git-based version control, CI/CD, declarative tests (YAML) and lineage to cloud warehouses like BigQuery, Snowflake and local DuckDB. Spotify migrates over 100 projects with 50+ analytics engineers, uses dbt to stage, test and deploy models, and measures cost and SLOs; teams report avoiding bespoke Python pipelines that balloon into boilerplate. Roadmap items include multi-project deployments, a Python SDK, declarative declarative testing and an embedded DBT Runner for programmatic DAG control.
AI-written summary · about
chapters (6)
- 0:00Start
- 16:49Declarative Code
- 32:56Discovery
- 33:44Transformation
- 34:42Deployment
- 37:51Maintenance-Costs
related talks
23mDelivering Modern Data Stacks With dbt to Operationalise Analytics
51mFrom SQLi Hammer to Full-fledged Software Engineer
19mRobust CI Workflow with dbt for Data Warehouse Optimization
01h 42mFall in Love with Data Transformation: DBT as Your Weapon
41mModular & Reusable: A Recipe to Scaling Data Across a Portfolio
51mFrom SQLi Hammer to Full-fledged Software Engineer
28mHow Open Source Enables Innovation A Case Study with dbt and Lightdash
21mSnowflake and dbt -- Our Journey to the Cloud