[SPARK-26219] Executor summary is not getting updated for failure jobs in history server UI

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.3.2, 2.4.0
• Fix Version/s: 2.4.1, 3.0.0
• Component/s: Spark Core
• Assignee: shahid
• Reporter: shahid
• Created: 29/Nov/18 18:21
• Updated: 03/Dec/18 23:15
• Resolved: 30/Nov/18 23:25

Description

Test step to reproduce:

bin/spark-shell --master yarn --conf spark.executor.instances=3
sc.parallelize(1 to 10000, 10).map{ x => throw new RuntimeException("Bad executor")}.collect() 

1)Open the application from History UI
2) Go to the executor tab

From History UI:

From Live UI:

Issue Links

• links to: [Github] Pull Request #23181 (shahidki31)
• links to: [Github] Pull Request #23181 (shahidki31)
• links to: [Github] Pull Request #23191 (shahidki31)