[SPARK-2033] Automatically cleanup checkpoint

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.0.0
• Fix Version/s: 1.4.0
• Component/s: Spark Core
• Target Version/s: 1.4.0
• Assignee: Guoqiang Li
• Reporter: Guoqiang Li
• Created: 05/Jun/14 09:24
• Updated: 14/Apr/15 19:57
• Resolved: 14/Apr/15 19:57

Description

Now we use ContextCleaner asynchronous cleanup RDD, shuffle, and broadcast. But no checkpoint.

Issue Links

• relates to: SPARK-2418 Custom checkpointing with an external function as parameter
• links to: [Github] Pull Request #855 (witgo)