[SPARK-8373] When an RDD has no partition, Python sum will throw "Can not reduce() empty RDD"

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.2.0
• Fix Version/s: 1.4.1, 1.5.0
• Component/s: PySpark
• Target Version/s: 1.4.1, 1.5.0
• Assignee: Shixiong Zhu
• Reporter: Shixiong Zhu
• Created: 15/Jun/15 08:31
• Updated: 18/Jun/15 02:29
• Resolved: 17/Jun/15 21:00

Description

The issue is because "sum" uses "reduce". Replacing it with "fold" will fix it.

Issue Links

• relates to: SPARK-6878 Sum on empty RDD fails with exception
• links to: [Github] Pull Request #6826 (zsxwing)
• links to: [Github] Pull Request #6867 (zsxwing)