Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-757

JobConf will not be deleted from the logs folder if job retires from finalizeJob()

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • None
    • None
    • jobtracker
    • None

    Description

      MAPREDUCE-130 fixed the case where the job is retired from the retire jobs thread. But jobs can also retire when the num-job-per-user limit is exceeded. In such cases the conf file will not be deleted.

      Attachments

        1. MAPREDUCE-757-v1.0.patch
          20 kB
          Amar Kamat
        2. MAPREDUCE-757-v2.0.patch
          8 kB
          Amar Kamat
        3. MAPREDUCE-757-v2.0-branch-0.20.patch
          0.7 kB
          Amar Kamat

        Issue Links

          Activity

            amar_kamat Amar Kamat added a comment -

            Attaching a patch that factors out the code to do with job-expiry. The testcases are changes to do some fast testing. Result of test-patch
            [exec] +1 overall.
            [exec]
            [exec] +1 @author. The patch does not contain any @author tags.
            [exec]
            [exec] +1 tests included. The patch appears to include 6 new or modified tests.
            [exec]
            [exec] +1 javadoc. The javadoc tool did not generate any warning messages.
            [exec]
            [exec] +1 javac. The applied patch does not increase the total number of javac compiler warnings.
            [exec]
            [exec] +1 findbugs. The patch does not introduce any new Findbugs warnings.
            [exec]
            [exec] +1 release audit. The applied patch does not increase the total number of release audit warnings.

            Testing and running ant tests now.

            amar_kamat Amar Kamat added a comment - Attaching a patch that factors out the code to do with job-expiry. The testcases are changes to do some fast testing. Result of test-patch [exec] +1 overall. [exec] [exec] +1 @author. The patch does not contain any @author tags. [exec] [exec] +1 tests included. The patch appears to include 6 new or modified tests. [exec] [exec] +1 javadoc. The javadoc tool did not generate any warning messages. [exec] [exec] +1 javac. The applied patch does not increase the total number of javac compiler warnings. [exec] [exec] +1 findbugs. The patch does not introduce any new Findbugs warnings. [exec] [exec] +1 release audit. The applied patch does not increase the total number of release audit warnings. Testing and running ant tests now.
            amar_kamat Amar Kamat added a comment -

            Should be addressed in MAPREDUCE-814.

            amar_kamat Amar Kamat added a comment - Should be addressed in MAPREDUCE-814 .
            amar_kamat Amar Kamat added a comment -

            Fixing just the missing part. Added a test case. Result of test-patch
            [exec] +1 overall.
            [exec]
            [exec] +1 @author. The patch does not contain any @author tags.
            [exec]
            [exec] +1 tests included. The patch appears to include 6 new or modified tests.
            [exec]
            [exec] +1 javadoc. The javadoc tool did not generate any warning messages.
            [exec]
            [exec] +1 javac. The applied patch does not increase the total number of javac compiler warnings.
            [exec]
            [exec] +1 findbugs. The patch does not introduce any new Findbugs warnings.
            [exec]
            [exec] +1 release audit. The applied patch does not increase the total number of release audit warnings.

            Running ant tests.

            amar_kamat Amar Kamat added a comment - Fixing just the missing part. Added a test case. Result of test-patch [exec] +1 overall. [exec] [exec] +1 @author. The patch does not contain any @author tags. [exec] [exec] +1 tests included. The patch appears to include 6 new or modified tests. [exec] [exec] +1 javadoc. The javadoc tool did not generate any warning messages. [exec] [exec] +1 javac. The applied patch does not increase the total number of javac compiler warnings. [exec] [exec] +1 findbugs. The patch does not introduce any new Findbugs warnings. [exec] [exec] +1 release audit. The applied patch does not increase the total number of release audit warnings. Running ant tests.
            amar_kamat Amar Kamat added a comment -

            ant tests and contrib tests passed.

            amar_kamat Amar Kamat added a comment - ant tests and contrib tests passed.
            amar_kamat Amar Kamat added a comment -

            Attaching a patch for branch 0.20.

            amar_kamat Amar Kamat added a comment - Attaching a patch for branch 0.20.
            amar_kamat Amar Kamat added a comment -

            Attached a short term fix for now.

            amar_kamat Amar Kamat added a comment - Attached a short term fix for now.
            amar_kamat Amar Kamat added a comment -

            Incorporated in MAPREDUCE-817.

            amar_kamat Amar Kamat added a comment - Incorporated in MAPREDUCE-817 .

            People

              amar_kamat Amar Kamat
              amar_kamat Amar Kamat
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: