Modern data lakes with Lake Formation, Amazon Redshift & AWS Glue
summary
A concrete blueprint for a cloud data lake that pairs Amazon S3 storage with Glue for ETL and cataloging, Lake Formation for column-level fine-grained access, and Redshift (plus Redshift Spectrum) for historical aggregations. Uses DMS for CDC from databases, Kinesis or MSK for streaming (Firehose for near‑real‑time delivery), AppFlow for SaaS, and Snowball/Snowmobile for bulk import. Recommends raw/landing/curated zones, Glue Studio low‑code and serverless Redshift previews, and examples like handling 100 orders per minute with CDC and real‑time alerts.
AI-written summary · about
chapters (9)
- 0:00Introduction and agenda
- 1:47Trends in data lakes and analytics
- 9:44Modern data lake architecture on AWS
- 26:23Deep dive into AWS Glue
- 35:59Lake Formation for security and governance
- 38:08Amazon Redshift capabilities
- 39:55Reference architecture for data lakes
- 41:19Example use case walkthrough
- 57:00Q&A and closing
related talks
56mUnderstanding and achieving a modern data architecture
28mTurn Data Into Insights
28mDeep Dive Into AWS Lake Formation
19mBuilding modern data lakes on Amazon S3
47mConstruyendo Lagos de Datos y Analíticos en AWS + Datos Abiertos
43mManaging a Data Lake on AWS
30mHarness the power of your data with the AWS Lake House Architecture
43mData warehousing reinvented for today's needs