[TEZ-4589] Counter for the overall duration of succeeded/failed/killed task attempts

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.10.5
• Assignee: László Bodor
• Reporter: László Bodor
• Created: 21/Nov/24 07:08
• Updated: 23/Nov/24 14:25
• Resolved: 23/Nov/24 14:25

Description

We need to track the number of failed task attempts, otherwise, there is a chance they remain "invisible" in case of a successful DAG with performance degradation. From the counters, ideally, we should be able to the the overall time spent in the FAILED attempts.

UPDATE: we already have NUM_FAILED_TASKS, which might be misleading, as it's just attempts, anyway, still need to aggregate the time

Issue Links

• links to: GitHub Pull Request #382