-
Type:
Bug
-
Status: Resolved
-
Priority:
Minor
-
Resolution: Fixed
-
Affects Version/s: 1.5.2
-
Component/s: Spark Core
-
Labels:None
-
Flags:Patch
The maxSplitSize should be computed as:
val maxSplitSize = Math.ceil(totalLen * 1.0 / minPartitions).toLong