Breakdown data silos - Build a data lake on Amazon S3
summary
Amazon S3 claims 11 nines durability and hosts tens of thousands of data lakes while offering 17 ingestion methods including Snowball, Snowmobile and DataSync and managed streams like Kinesis Firehose. Performance guidance lists 3500 PUT and 5500 GET per prefix and recommends Parquet/ORC and ranged downloads for parallel reads. Cost controls include S3 Intelligent-Tiering with new archive access tiers priced like Glacier, plus features like Access Points, Block Public Access, Object Lock, S3 Select, strong read‑after‑write and list consistency, and integrations with Glue, Athena, Redshift, EMR and Lake Formation.
AI-written summary · about
chapters (11)
- 0:00Introduction to data silos
- 1:44Why build a data lake on S3
- 3:32Choosing storage classes
- 5:15S3 intelligent tiering updates
- 6:18Optimizing S3 performance
- 8:03Ingesting data into S3
- 9:50Securing the data lake
- 11:58Making data available for analytics
- 13:23S3 strong consistency
- 14:04AWS Lake Formation overview
- 15:09Conclusion and Q&A
related talks
21mBreakdown Data Silos: Why Amazon S3 Is The Best Place To Build Your Data Lake
34mBest Practices for Implementing a Data Lake in Amazon S3
34mBest Practices for Implementing a Data Lake in Amazon S3
43mManaging a Data Lake on AWS
11mSimplify and evolve your data lake on Amazon S3 and optimize costs
59mModern data lakes with Lake Formation, Amazon Redshift & AWS Glue
30mRaw Data to Business Insights: What You Need to Build a Modern Data Lake
28mTurn Data Into Insights