Setting Up Iceberg Tables in Snowflake
summary
Step‑by‑step recipe for running Apache Iceberg on Snowflake with code repo promised (lab failed live) showing how to: setup Snowflake external Iceberg tables, register a catalog, and query snapshots; explains schema evolution and time travel and schema evolution use cases, recommends target parquet file sizes (128–512 MB) and partitioning (year/month) and cites a real case that cut ETL from eight hours to two and reduced storage by ~40%.
AI-written summary · about
chapters (24)
- 0:00Introduction
- 1:08Speaker background
- 3:14GitLab and values
- 6:49Modern data challenges
- 8:37Data storage formats evolution
- 11:07Apache Iceberg importance
- 12:55Session agenda
- 13:58Iceberg tables benefits
- 17:56Classic lake vs Iceberg
- 19:41Iceberg architecture
- 22:31Catalogs role
- 24:16Snowflake overview
- 27:31Snowflake + Iceberg benefits
- 30:49Lab setup prerequisites
- 32:35Iceberg partitioning best practices
- 37:43File size optimization
- 39:31Advanced features troubleshooting
- 39:53Schema evolution
- 41:39Time travel capabilities
- 43:27Versioning snapshots
- 44:55Slow query troubleshooting
- 46:21Iceberg in Snowflake
- 47:44Resources support
- 48:26Q&A
related talks
01h 12mHands-on with Apache Iceberg
41mTip of the Iceberg
46mTake the Polar Plunge: A Fearless Introduction to Apache Iceberg™
39mIntroducing Apache Iceberg: Tables Designed for Object Stores
31mHow Apache Iceberg Enables Multi-Engine Data Platforms
25mHow to build a platform for AI and analytics based on Apache Iceberg
52mApache Iceberg - An Architectural Look Under the Covers
50mDesigning a scalable data platform based on Apache Spark/Iceberg