Dask Powering lower end PC
summary
A brief report claims Dask makes it possible to process datasets larger than memory on modest hardware by replacing eager loads with lazy evaluation and breaking data into chunked partitions that get scheduled and indexed on demand The project uses Python parallel computing primitives and can scale to clusters but also runs on a single machine and reportedly resolves an out-of-memory error on a 16 GB RAM laptop without buying extra hardware
AI-written summary · about
related talks
01h 23mData Science at Scale with Dask
01h 24mData Science at Scale with Dask
01h 22mUsing Dask for Parallel Computing in Python
01h 26mDask tutorial
01h 03mDask: Next Steps in Parallel Python
18mUsing Dask to Distribute Machine Learning Jobs
01h 17mScaling PyData with Dask
44mUsing Dask for Parallel Computing in Python