Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-3386

the job directory of a failed task may stay forever on a tasktracker node

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Cannot Reproduce
    • None
    • None
    • None
    • None

    Description

      See https://issues.apache.org/jira/browse/HADOOP-3370 for details of the problem.

      A tasktracker only cleans out the job dir when the job tracker sends a "KILLJOB" action in the heartbeat response message.

      However, in a corner case, the job tracker will NOT send the "KILLJOB" action to the task tracker. The case is when there is only failed tasks of this job on this task tracker; no successful tasks of this job is on this task tracker.

      In this case, jobtracker.trackerToTaskMap will not contain an entry of this task tracker to any tasks of this job. As a result, the job tracker will not send a KILLJOB action to the task tracker.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              zshao Zheng Shao
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: