[SPARK-11047] Internal accumulators miss the internal flag when replaying events in the history server

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 1.5.0
• Fix Version/s: 1.5.2, 1.6.0
• Component/s: Spark Core
• Target Version/s: 1.5.2, 1.6.0
• Assignee: Carson Wang
• Reporter: Carson Wang
• Created: 10/Oct/15 07:34
• Updated: 15/Oct/15 17:36
• Resolved: 15/Oct/15 17:36

Description

Internal accumulators don't write the internal flag to event log. So on the history server Web UI, all accumulators are not internal. This causes incorrect peak execution memory and unwanted accumulator table displayed on the stage page.

Issue Links

• links to: [Github] Pull Request #9061 (carsonwang)