Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-127

Task trackers don't register with the job tracker until after they clean out their working directory

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Invalid
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      When TaskTrackers are started, they immediately start deleting their working directory, which can take 30+ minutes. Unfortunately, that means they don't register themselves with the JobTracker for a long time, so it looks like the cluster is "missing".

        Activity

        Hide
        Harsh J added a comment -

        Should we register before we clean then? Frankly I've not seen this slow startups recently, even with several of our users running huge loads of tasks it never has shown up given that we keep it clean along the way.

        Do reopen if this is still an issue. I do not think it is anymore, and has gone stale.

        Show
        Harsh J added a comment - Should we register before we clean then? Frankly I've not seen this slow startups recently, even with several of our users running huge loads of tasks it never has shown up given that we keep it clean along the way. Do reopen if this is still an issue. I do not think it is anymore, and has gone stale.

          People

          • Assignee:
            Owen O'Malley
            Reporter:
            Owen O'Malley
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development