Backstage interview
summary
Overview of concrete outcomes and tools: Apache Parquet as a columnar on‑disk format supports encryption, a new content defined chunking feature in the C++ implementation that cuts duplication (Hugging Face reports a 10% decrease in written volume), a planned variant type that lets evolving JSON be shredded into real columns, a byte‑array delta encoding for common string prefixes, and a Parquet C++ rollout tied into Arrow with ~300 CI jobs and an active pyarrow type‑annotations PR.
AI-written summary · about
related talks
37mApache Parquet : the standard, efficient file format for tabular data
32mConnecting PyData to other Big Data Landscapes using Arrow and Parquet
29mEfficient and portable DataFrame storage with Apache Parquet
46mA 101 in Time Series Analytics with Apache Arrow, Pandas and Parquet
28m10 years of Parquet- what's next?
42mColumnar Storage: Redefining Data Management for the Modern Era
33mA 101 in time series analytics with Apache Arrow, Pandas and Parquet
24mPolyglot data with python: Introducing Pandas and Apache Arrow