[SPARK-2323] Exception in accumulator update should not crash DAGScheduler & SparkContext

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 1.0.2, 1.1.0
• Target Version/s: 1.1.0
• Assignee: Reynold Xin
• Reporter: Reynold Xin
• Created: 30/Jun/14 08:03
• Updated: 05/Aug/14 03:40
• Resolved: 05/Aug/14 03:40

Description

Right now a misbehaved accumulator update can destroy DAGScheduler because of uncaught exceptions in handleTaskCompletion.

Issue Links

• is related to: SPARK-2322 Exception in resultHandler could crash DAGScheduler and shutdown SparkContext
• links to: [Github] Pull Request #1772 (rxin)