[SPARK-1026] PySpark using deprecated mapPartitionsWithSplit

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 0.9.0
• Fix Version/s: 0.9.0
• Component/s: PySpark, Spark Core
• Assignee: Josh Rosen
• Reporter: Mark Hamstra
• Created: 14/Jan/14 08:56
• Updated: 23/Jan/14 21:08
• Resolved: 23/Jan/14 21:08

Description

In the Scala API, mapPartitionsWithSplit has been deprecated for a long time and really should be removed. However, PySpark uses mapPartitionsWithSplit instead of mapPartitionsWithIndex, so mapPartitionsWithSplit now can't be removed until it has first been deprecated in PySpark for at least one release.