How Apache Iceberg Really Works
summary
Explains Apache Iceberg’s architecture and implementation details as a table format for lakehouse platforms, covering how Iceberg organizes data and metadata for modern data lakes. Discusses specific components and design choices used to build scalable, reliable storage and querying (the talk focuses on Iceberg internals rather than high-level marketing).
AI-written summary · about
chapters (12)
- 0:00Introduction
- 3:23Hive problems and Iceberg
- 6:54Transactions in Iceberg
- 10:55Consistency and isolation
- 14:06Iceberg metadata
- 17:38How transactions work
- 20:27Copy-on-Write vs Merge-on-Read
- 23:57Partitioning and statistics
- 26:43Catalog role in Iceberg
- 32:37Engine integration
- 35:05Why Iceberg is popular
- 35:35Q&A
related talks
37mApache Iceberg: An Architectural Look Under the Covers
01h 12mHands-on with Apache Iceberg
31mHow Apache Iceberg Enables Multi-Engine Data Platforms
41mTip of the Iceberg
01h 04mAn Extremely Technical Overview of How Apache Iceberg Planning Actually Works
52mApache Iceberg - An Architectural Look Under the Covers
46mTake the Polar Plunge: A Fearless Introduction to Apache Iceberg™
25mHow to build a platform for AI and analytics based on Apache Iceberg