Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-5248

Job directories could remain undeleted in some scenarios after job completes.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • None
    • 0.20.0
    • None
    • None

    Description

      I observed a couple of times that when a job has completed, its job directories were not cleaned up. In discussion, it seems like there is a condition when only reduces from a job are run on a machine and no maps, the TT does not get a signal from the JT to delete the files and could be left behind. FYI, JVM reuse was enabled at the time. I can confirm that 'KillJobAction' was not received by the TT.

      Attachments

        1. 5248.patch
          0.9 kB
          Devaraj Das
        2. 5248-testcase.patch
          4 kB
          Devaraj Das

        Issue Links

          is blocked by

          Bug - A problem which impairs or prevents the functions of the product. HADOOP-5247 NPEs in JobTracker and JobClient when mapred.jobtracker.completeuserjobs.maximum is set to zero.

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed

          Activity

            People

              ddas Devaraj Das
              yhemanth Hemanth Yamijala
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: