Building modern data lakes on Amazon S3
summary
Amazon recommends building a lake on S3 with 11 nines durability and seven storage classes plus S3 Intelligent‑Tiering, then running analytics with Amazon S3 + Athena + Glue + Lake Formation and purpose‑built engines like EMR, Redshift, and Elasticsearch. Data movement uses Snowcone/Snowball/Snowmobile, DataSync, Transfer Acceleration, Transfer Family and Storage Gateway; Kinesis handles streaming. AWS reports tens of thousands of lakes on S3, strong consistency launched at re:Invent, and recent PrivateLink integration shows rapid customer uptake.
AI-written summary · about
chapters (5)
- 0:00Introduction to data lakes
- 2:24Challenges and architectures
- 4:40Data movement strategies
- 16:31Closing remarks
- 16:46Partner ecosystem discussion
related talks
21mBreakdown Data Silos: Why Amazon S3 Is The Best Place To Build Your Data Lake
34mBest Practices for Implementing a Data Lake in Amazon S3
43mManaging a Data Lake on AWS
59mModern data lakes with Lake Formation, Amazon Redshift & AWS Glue
31mBest practices for building your data lake on Amazon S3
56mUnderstanding and achieving a modern data architecture
28mTurn Data Into Insights
28mDeep Dive Into AWS Lake Formation