DataEngBytes 2023 - SYD-T1-08 - Rishu Saxena & John Cosgrove

on YouTube ↗29m

" summary

Coalesce plugs into Snowflake and runs metadata-only transformations inside the customer account, generating SQL/Snowpark (Roughly 200 lines per SCD2 pattern) rather than moving data out. The GUI templatizes common patterns, provides built-in SCD2 templates and surrogate/hashing options, shows execution DAGs and a deploy dashboard with CI/CD and API hooks, and offers column-level lineage so model changes propagate and jobs run without hidden compute.

AI-written summary · about

" chapters (8)

1. 0:00Modern data stack challenges
2. 3:12Data structure in cloud era
3. 8:30Customer-centric data modeling
4. 13:23Data as revenue driver
5. 16:30Warehouse vs data lake
6. 18:55Coalesce philosophy & Snowflake
7. 24:50Scalable pipelines with Coalesce
8. 28:41Q&A

" related talks

• 32mDataEngBytes 2023 - BRI-T1-10 Rishu Saxena & John CosgroveRishu Saxena, John Cosgrove · DataEngBytes Brisbane 2023
• 24mDataEngBytes 2023 - MEL-T3-03 - Akira Wang & Abdi FarahAkira Wang, Abdi Farah · DataEngBytes Melbourne 2023
• 19mDataEngBytes 2023 - MEL-T1-04 - Michael HyattMichael Hyatt · DataEngBytes Melbourne 2023
• 20mDataEngBytes 2023 PER-T1-10 - Matthew CarterMatthew Carter · DataEngBytes Perth 2023
• 27mDataOps & Full Snowflake Automation In 1 ClickTony Hajdari · Big Data LDN 2022
• 18mDataEngBytes 2023 - MEL-T3-02 - Alexei de LauwAlexei de Lauw · DataEngBytes Melbourne 2023
• 24mA Single Data Platform for All of Your WorkloadsStephen Weingartner · DataEngBytes 2021
• 01h 17mData Engineering in the AI Era: Building a Robust Foundation for AI ApplicationsArtemiy Kozyr · DSC Europe 24