~/talk

Data: The Land DevOps Forgot

on YouTube 33m
Talkat GOTO Copenhagen 2024 · 2024-09-30..10-04· [data-visualization, devops-and-delivery]

speaker

name:Michael Nygard
website:http://www.michaelnygard.com/

resources

video:https://youtu.be/SfIvrtDsE3Q
slides:none on file

summary

Nubank moves 50 petabytes through 300,000 nightly jobs and 7 million lines of Scala for 100 million customers, and replaces monolithic ETL that runs 14+ hours with a domain-driven data mesh backed by Spark, Iceberg tables, a commercial data catalog and AI regex classification. A self-service platform adds observability, guard rails, SLOs, lineage and cost visibility; CI build time falls from six hours to ~3.5 minutes and teams gain autonomous deployment and measurable quality improvements, rollout showing promising results.

AI-written summary · about

chapters (10)

  1. 0:00Intro
  2. 2:45Operational vs analytic
  3. 7:28The opposite of DevOps
  4. 8:07New paradigm required
  5. 9:35Data Mesh
  6. 18:50Supporting the data owner
  7. 22:10Platforms create incentives
  8. 28:55Make the need visceral
  9. 31:17Summary
  10. 33:07Outro

related talks

~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.