Owning Your Own (Data) Lake House

on YouTube ↗41m

" summary

Demonstrates an Amazon Redshift lake house that queries S3, Redshift and RDS without moving data by using Redshift Spectrum to push down SQL, federated queries to hit Postgres stores, and a Parquet export (UNLOAD) to write enriched results back to S3. Shows a working demo with the public 150M Amazon reviews set, loading 2014–15 into Redshift, leaving older years in S3, and returning correct UNIONed counts across both systems via JDBC/ODBC clients.

AI-written summary · about

" chapters (6)

1. 0:00Introduction and background
2. 1:23Data trends in industry
3. 14:38What is a data lake house
4. 24:49Demo: Querying data lake with Redshift
5. 35:54Choosing tools for analytics
6. 36:57Q&A session

" related talks

• 24mModernizing the Data WarehouseLuis Caro, PhD · AWS Summit AMER 2020
• 28mModernize Your Data WarehouseAneesh Chandra PN · AWS Summit Online EMEA 2020
• 42mHow innovation happens on Amazon RedshiftEric Ferreira · Percona Live Open Source Database Conference 2017
• 22mReference architectures for Amazon Redshift data warehousesAsser Moustafa · AWS Summit Online – Americas 2021
• 59mModern data lakes with Lake Formation, Amazon Redshift & AWS GlueRaghavarao Sodabathaina, Changbin Gong · AWS Summit Atlanta 2022
• 23mOne day with RedshiftBojan Sovilj · Data Science Conference 4.0
• 25mBuild open format data lakehouseSatish Mane, Rajeev Jahswal · Conf42 Cloud Native 2023
• 42mTransform your data approach: Develop a modern data strategyBlair Layton, Saeed Barghi · AWS Summit Singapore 2022