Interview
summary
Describes how Apache Arrow couples transport and in-memory processing to cut serialization/deserialization overhead, and how Dremio uses Arrow as its linchpin for much lower cloud compute costs. Explains the practical need for a table abstraction on top of file-based data lakes and why Apache iceberg is preferred inside the Apache foundation. Emphasizes measurable efficiency gains that let teams process more data for the same budget.
AI-written summary · about
related talks
45mApache Arrow: In Pursuit of Speed
33mArrow in Flight - New Developments in Data Connectivity
01h 02mApache Arrow: High-Performance Columnar Data Framework
34mApache Arrow as a full stack data engineering solution
31mOpen Standards and Lakehouse AI Development
39mTaming the language border (...)
22mAccelerating Analytics with Apache Arrow
46mEfficient Data formats for Analytics with Parquet and Arrow