-
Type:
Improvement
-
Status: Resolved
-
Priority:
Major
-
Resolution: Fixed
-
Affects Version/s: None
-
Fix Version/s: 1.6.0
-
Component/s: Spark Core
-
Labels:None
-
Target Version/s:
We need to document the new off-heap memory limit configurations which were added in Spark 1.6, add simple configuration validation (for instance, you shouldn't be able to enable off-heap execution when the off-heap memory limit is zero), and alias the old and confusing `spark.unsafe.offHeap` configuration to something that lives in the `spark.memory` namespace.