~/talk

Build Your CICD Pipeline On Snowflake With Datavault Builder

on YouTube 27m
Talkat Big Data LDN 2022 · 2022-09-21..09-22· [data-engineering]

speaker

name:Petr Beles
links:none on file

resources

video:https://youtu.be/c8l1p3V-LJQ
slides:none on file

summary

Claim: Datavault Builder stores model and metadata as per-object JSON files, sorts them for line-by-line Git diffs, and uses a comparison engine to generate forward and rollback deployment scripts. It uses Zero Copy Cloning on Snowflake to create per-developer sandboxes with one SQL command, spins IDE instances via Docker, and runs pipelines in Jenkins or Azure DevOps. REST APIs run loads and automated regression tests; the approach works on Snowflake and other databases but sandboxing is fastest there.

AI-written summary · about

chapters (6)

  1. 0:00Introduction and agenda
  2. 3:33Three CI CD challenges
  3. 9:12Model-driven CI CD solution
  4. 15:15Sandboxing with Snowflake
  5. 21:16Key takeaways and summary
  6. 23:45Q&A session

related talks

~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.