Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-639

task cleanup messages can get lost, causing task trackers to keep tasks forever

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.7.2
    • 0.9.2
    • None
    • None

    Description

      If the pollForTaskWithClosedJob call from a job tracker to a task tracker times out when a job completes, the tasks are never cleaned up. This can cause the mini m/r cluster to hang on shutdown, but also is a resource leak.

      Attachments

        1. HADOOP-639_1.patch
          35 kB
          Arun Murthy
        2. HADOOP-639_2_20061130.patch
          35 kB
          Arun Murthy
        3. HADOOP-639_3_20061201.patch
          35 kB
          Arun Murthy
        4. HADOOP-639_4_20061205.patch
          35 kB
          Arun Murthy
        5. HADOOP-639_5_20061207.patch
          38 kB
          Arun Murthy

        Issue Links

        blocks

        Bug - A problem which impairs or prevents the functions of the product. HADOOP-737 TaskTracker's job cleanup loop should check for finished job before deleting local directories

        • Critical - Crashes, loss of data, severe memory leak.
        • Closed

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            acmurthy Arun Murthy
            omalley Owen O'Malley
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment