Accelerating geospatial computing using Apache Arrow
summary
geoarrow extends Apache Arrow to store spatial types in columnar form and run spatial queries over many files using Parquet and Arrow datasets; it reads remote S3-hosted data, runs dplyr-style queries in parallel and batchwise to handle bigger-than-memory workloads, and offers read_geoparquet() for round-trip sf objects. Results move across languages without copying via zero-copy Arrow arrays, enabling handoff to Rust, Python, or other R packages. The system is functional but still under development.
AI-written summary · about
related talks
22mAccelerating Analytics with Apache Arrow
32mConnecting PyData to other Big Data Landscapes using Arrow and Parquet
33mArrow in Flight - New Developments in Data Connectivity
25mSpeed Up Data Access with PyArrow Apache Arrow Data is the new API
35mPractical Applications of Apache Arrow
42mState of the Apache Arrow Ecosystem:How your project can leverage Arrow!
32mThe expanding Apache Arrow universe
33mFree Your Esoteric Data Using Apache Arrow and Python