Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-639

task cleanup messages can get lost, causing task trackers to keep tasks forever

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.7.2
    • 0.9.2
    • None
    • None

    Description

      If the pollForTaskWithClosedJob call from a job tracker to a task tracker times out when a job completes, the tasks are never cleaned up. This can cause the mini m/r cluster to hang on shutdown, but also is a resource leak.

      Attachments

        1. HADOOP-639_1.patch
          35 kB
          Arun Murthy
        2. HADOOP-639_2_20061130.patch
          35 kB
          Arun Murthy
        3. HADOOP-639_3_20061201.patch
          35 kB
          Arun Murthy
        4. HADOOP-639_4_20061205.patch
          35 kB
          Arun Murthy
        5. HADOOP-639_5_20061207.patch
          38 kB
          Arun Murthy

        Issue Links

          blocks

          Bug - A problem which impairs or prevents the functions of the product. HADOOP-737 TaskTracker's job cleanup loop should check for finished job before deleting local directories

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Activity

            People

              acmurthy Arun Murthy
              omalley Owen O'Malley
              Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: