[SPARK-29689] [WEB-UI] When task failed during reading shuffle data or other failure, enable show total shuffle read size

• Type: Improvement
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 3.1.0
• Component/s: Web UI
• Assignee: Unassigned
• Reporter: feiwang
• Created: 31/Oct/19 15:16
• Updated: 16/Mar/20 22:54

Description

As shown in the attachment, if task failed during reading shuffle data or because of executor loss, its shuffle read size would be shown as 0.

But this size is important for user, it can help detect data skew.

Issue Links

• links to: GitHub Pull Request #26348