Enabling Data centric Teams

on YouTube ↗39m

" summary

Argues that opening raw data and enabling domain teams to experiment shortens time to insight and lowers costs, with concrete tooling and patterns: JupyterHub on cloud for shared, scalable notebooks and runnable demos, Plotly Dash apps to turn notebooks into dashboards, and a cloud data lake (CSV/Parquet) plus simple analytics DB and API for cross-team access. Claims many domain-built notebooks are production-ready and replacing per-seat SaaS can save tens of thousands.

AI-written summary · about

" chapters (15)

1. 0:00Introduction and speaker intro
2. 1:28Speaker background and motivation
3. 5:58Data engineering philosophy and challenges
4. 8:08Enabling data-centric teams approach
5. 11:47Decentralized data architecture benefits
6. 13:16Overcoming enablement hurdles
7. 16:30Jupyter framework for collaboration
8. 18:15Live demo of Jupyter visualization
9. 22:31Final recommendations and call to action
10. 23:16Q&A session part one
11. 25:29Q&A project ideas and tools
12. 28:06Q&A data validation and maintenance
13. 30:41Q&A overcoming organizational resistance
14. 33:35Q&A decentralized vs centralized debate
15. 36:19Contact information and closing

" related talks

• 24mMake data central featureAntoni Ivanov · DSC Europe 23
• 49mExperimenting with Large Data Volumes Using NotebooksGilmar Souza · QCon São Paulo 2018
• 12mDesigning Your Data-Centric OrganizationJosh Klahr · Strata Conference New York + Hadoop World 2013
• 17mDemocratising data analyticsChristian Thiel, Edoardo Gatti · hub.berlin 2022
• 25mOvercoming 5 Hurdles to Using Jupyter Notebooks for Data Science, by the JetBrai...Alena Guzharina · PyCon DE & PyData Berlin 2022
• 39mData Mesh: Why, What and HowZhamak Dehghani · Craft Conference 2021
• 34mThe Data Analytics Platform or How to Make Data Science in a Box PossibleKrzysztof Adamski · KubeCon + CloudNativeCon Europe 2019
• 46mData Exploration & Experimentation with Notebooks in AzureIan Griffiths · SQLBits 2020