[SPARK-15512] repartition(0) should raise IllegalArgumentException.

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.0.0
• Component/s: Spark Core
• Assignee: Dongjoon Hyun
• Reporter: Dongjoon Hyun
• Created: 24/May/16 21:47
• Updated: 30/Jul/16 11:39
• Resolved: 25/May/16 01:55

Description

Previously, SPARK-8893 added the positive partition constrains on repartition/coalesce operations in general.

This PR adds one missing part for that and adds explicit two testcases.

*Before*

repartition(0)

scala> sc.parallelize(1 to 5).coalesce(0).collect()
java.lang.IllegalArgumentException: requirement failed: Number of partitions (0) must be positive.
...
scala> sc.parallelize(1 to 5).repartition(0).collect()
res1: Array[Int] = Array()

*After*

repartition(0)

scala> sc.parallelize(1 to 5).coalesce(0).collect()
java.lang.IllegalArgumentException: requirement failed: Number of partitions (0) must be positive.
...
scala> sc.parallelize(1 to 5).repartition(0).collect()
java.lang.IllegalArgumentException: requirement failed: Number of partitions (0) must be positive.
...

Issue Links

• is duplicated by: SPARK-16797 Repartiton call w/ 0 partitions drops data
• relates to: SPARK-8893 Require positive partition counts in RDD.repartition
• links to: [Github] Pull Request #13282 (dongjoon-hyun)