Apache Arrow - The columnar format! What's that?
summary
Apache Arrow explains the in-memory columnar data format and platform for fast analytics and data movement across systems. It covers Arrow's physical memory layouts and logical types, IPC/serialization, canonical extension types, and tensor/multidimensional array structures, with concrete examples showing how buffers are represented in memory.
AI-written summary · about
chapters (9)
- 0:00Introduction
- 1:02What is Apache Arrow?
- 6:13Columnar format explained
- 8:42Primitive in-memory layouts
- 12:37Variable-size data
- 15:42String view in Apache Arrow
- 19:19Nested and list layouts
- 22:07Standardization and adoption
- 24:24Q&A
related talks
35mPractical Applications of Apache Arrow
33mArrow in Flight - New Developments in Data Connectivity
01h 04mWhere We’re Going, We Don’t Need Rows: Columnar Data Connectivity with Apache Arrow ADBC
34mApache Arrow as a full stack data engineering solution
42mState of the Apache Arrow Ecosystem:How your project can leverage Arrow!
32mThe expanding Apache Arrow universe
46mEfficient Data formats for Analytics with Parquet and Arrow
42mColumnar Storage: Redefining Data Management for the Modern Era