[SPARK-25568] Continue to update the remaining accumulators when failing to update one accumulator

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.3.2, 2.4.0
• Fix Version/s: 2.2.3, 2.3.3, 2.4.0
• Component/s: Spark Core
• Assignee: Shixiong Zhu
• Reporter: Shixiong Zhu
• Created: 28/Sep/18 20:51
• Updated: 30/Sep/18 01:23
• Resolved: 30/Sep/18 01:23

Description

Currently when failing to update an accumulator, DAGScheduler.updateAccumulators will skip the remaining accumulators. We should try to update the remaining accumulators if possible so that they can still report correct values.

Issue Links

• links to: [Github] Pull Request #22586 (zsxwing)