[HADOOP-3386] the job directory of a failed task may stay forever on a tasktracker node

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Cannot Reproduce
• Assignee: Unassigned
• Reporter: Zheng Shao
• Created: 14/May/08 07:01
• Updated: 29/Dec/11 06:56
• Resolved: 29/Dec/11 06:56

Description

See https://issues.apache.org/jira/browse/HADOOP-3370 for details of the problem.

A tasktracker only cleans out the job dir when the job tracker sends a "KILLJOB" action in the heartbeat response message.

However, in a corner case, the job tracker will NOT send the "KILLJOB" action to the task tracker. The case is when there is only failed tasks of this job on this task tracker; no successful tasks of this job is on this task tracker.

In this case, jobtracker.trackerToTaskMap will not contain an entry of this task tracker to any tasks of this job. As a result, the job tracker will not send a KILLJOB action to the task tracker.

Issue Links

• is related to: HADOOP-3370 failed tasks may stay forever in TaskTracker.runningJobs