Spark Session Scheduler
summary
Describes a Spark session scheduler built on Apache Mesos that provides fine-grained resource allocation to Spark applications to handle rapidly changing memory and CPU needs and multi-user environments. It enforces overall process limits, supports controlled task preemption to reclaim resources, and claims to avoid execution overhead; source code will be released soon.
AI-written summary · about