Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-182

lost task trackers should not update status of completed jobs

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.1.1
    • Fix Version/s: 0.2.0
    • Component/s: None
    • Labels:
      None

      Description

      When a Task Tracker is lost (by not sending a heartbeat for 10 minutes), the JobTracker marks the tasks that were active on that node as failed. There are two issues:
      1. No task from a completed or failed job should be modified.
      2. No reduces should be marked as failed, since their output is in dfs and therefore not only on the dead node.

        Attachments

        1. lost-tracker.patch
          13 kB
          Owen O'Malley

          Activity

            People

            • Assignee:
              omalley Owen O'Malley
              Reporter:
              omalley Owen O'Malley
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: