[SPARK-12678] MapPartitionsRDD should clear reference to prev RDD

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 1.6.1, 2.0.0
• Component/s: Spark Core
• Labels: easyfix
• Assignee: Guillaume Poulin
• Reporter: Guillaume Poulin
• Created: 06/Jan/16 19:11
• Updated: 07/Jan/16 05:36
• Resolved: 07/Jan/16 05:36

Description

When `MapPartitionsRDD.clearDependencies()` is called, `MapPartitionsRDD` keep a reference to `prev` which may cause a memory leak.

Issue Links

• links to: [Github] Pull Request #10623 (gpoulin)