[SPARK-25533] Inconsistent message for Completed Jobs in the JobUI, when there are failed jobs, compared to spark2.2

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.3.1
• Fix Version/s: 2.3.3, 2.4.0
• Component/s: Web UI
• Assignee: shahid
• Reporter: shahid
• Created: 25/Sep/18 19:19
• Updated: 27/Sep/18 17:38
• Resolved: 27/Sep/18 17:38

Description

Test steps:

 1) bin/spark-shell

sc.parallelize(1 to 5, 5).collect()
sc.parallelize(1 to 5, 2).map{ x => throw new RuntimeException("Fail Job")}.collect()

Output in spark - 2.3.1:

Output in spark - 2.2.1:

Issue Links

• links to: [Github] Pull Request #22549 (shahidki31)