[SPARK-5441] SerDeUtil Pair RDD to python conversion doesn't accept empty RDDs

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.1.1, 1.2.0
• Fix Version/s: 1.2.2, 1.3.0
• Component/s: PySpark
• Labels: backport-needed
• Target Version/s: 1.1.2, 1.2.2, 1.3.0
• Assignee: Michael Nazario
• Reporter: Michael Nazario
• Created: 28/Jan/15 00:07
• Updated: 17/Feb/15 00:40
• Resolved: 17/Feb/15 00:40

Description

SerDeUtil.pairRDDToPython and SerDeUtil.pythonToPairRDD rely on rdd.first() which throws an exception if the RDD is empty. We should be able to handle the empty RDD case because this doesn't prevent a valid RDD from being created.

Issue Links

• links to: [Github] Pull Request #4236 (mnazario)