[SPARK-24414] Stages page doesn't show all task attempts when failures

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 2.3.0
• Fix Version/s: 2.3.1, 2.4.0
• Component/s: Web UI
• Assignee: Marcelo Masiero Vanzin
• Reporter: Thomas Graves
• Created: 29/May/18 19:06
• Updated: 24/Sep/18 05:04
• Resolved: 31/May/18 17:05

Description

If you have task failures, the StagePage doesn't render all the task attempts properly.  It seems to make the table the size of the total number of successful tasks rather then including all the failed tasks.

Even though the table size is smaller, if you sort by various columns you can see all the tasks are actually there, it just seems the size of the table is wrong.

Issue Links

• is related to: SPARK-25503 [Spark Job History] Total task message in stage page is ambiguous
• links to: [Github] Pull Request #21457 (vanzin)