[MAPREDUCE-6892] Issues with the count of failed/killed tasks in the jhist file

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.0.0-beta1
• Component/s: client, jobhistoryserver
• Hadoop Flags: Incompatible change, Reviewed
• Release Note: This adds some new job counters, the number of failed MAP/REDUCE tasks and the number of killed MAP/REDUCE tasks.
• Assignee: Peter Bacsko
• Reporter: Peter Bacsko
• Created: 24/May/17 09:43
• Updated: 28/Sep/17 17:23
• Resolved: 30/Aug/17 17:12

Description

Recently we encountered some issues with the value of failed tasks. After parsing the jhist file, JobInfo.getFailedMaps() returned 0, but actually there were failures.

Another minor thing is that you cannot get the number of killed tasks (although this can be calculated).

The root cause is that JobUnsuccessfulCompletionEvent contains only the successful map/reduce task counts. Number of failed (or killed) tasks are not stored.