[MAPREDUCE-3858] Task attempt failure during commit results in task never completing

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 0.23.1
• Component/s: mrv2
• Target Version/s: 0.23.1
• Hadoop Flags: Reviewed
• Assignee: Thomas White
• Reporter: Thomas White
• Created: 14/Feb/12 01:21
• Updated: 17/May/13 21:02
• Resolved: 14/Feb/12 22:55

Description

On a terasort job a task attempt failed during the commit phase. Another attempt was rescheduled, but when it tried to commit it failed.

attempt_1329019187148_0083_r_000586_0 already given a go for committing the task output, so killing attempt_1329019187148_0083_r_000586_1

The job hung as new attempts kept getting scheduled only to fail during commit.

Issue Links

• is related to: MAPREDUCE-5255 Reduce task preemption results in task never completing , incomplete fix to MAPREDUCE-3858 ?