Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4699

TestFairScheduler & TestCapacityScheduler fails due to JobHistory exception

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: 1.1.1
    • Fix Version/s: 1.1.2
    • Component/s: None
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      TestFairScheduler fails due to exception from mapred.JobHistory

      null
      java.lang.NullPointerException
      	at org.apache.hadoop.mapred.JobHistory$JobInfo.logJobPriority(JobHistory.java:1975)
      	at org.apache.hadoop.mapred.JobInProgress.setPriority(JobInProgress.java:895)
      	at org.apache.hadoop.mapred.TestFairScheduler.testFifoPool(TestFairScheduler.java:2617)
      

      TestCapacityScheduler fails due to

      java.lang.NullPointerException
          at org.apache.hadoop.mapred.JobHistory$JobInfo.logJobPriority(JobHistory.java:1976)
          at org.apache.hadoop.mapred.JobInProgress.setPriority(JobInProgress.java:895)
          at org.apache.hadoop.mapred.TestCapacityScheduler$FakeTaskTrackerManager.setPriority(TestCapacityScheduler.java:653)
          at org.apache.hadoop.mapred.TestCapacityScheduler.testHighPriorityJobInitialization(TestCapacityScheduler.java:2666)
      

      Update UtilsForTest::getJobTracker to call initialize()/initializeFileSystem() to match behaviour in pre-safe mode constructor.

      1. mapreduce-4699.patch
        2 kB
        Gopal V
      2. MAPREDUCE4699.txt
        3 kB
        Siddharth Seth

        Activity

        Hide
        Matt Foley added a comment -

        Closed upon successful release of 1.1.2.

        Show
        Matt Foley added a comment - Closed upon successful release of 1.1.2.
        Hide
        Siddharth Seth added a comment -

        Committed. Thanks Gopal!

        Show
        Siddharth Seth added a comment - Committed. Thanks Gopal!
        Hide
        Siddharth Seth added a comment -

        The current patch looks good for the CapacityScheduler test. Updating the patch with similar changes for TestFairScheduler - and committing.

        Show
        Siddharth Seth added a comment - The current patch looks good for the CapacityScheduler test. Updating the patch with similar changes for TestFairScheduler - and committing.
        Hide
        Matt Foley added a comment -

        moved target version to 1.2.0 upon publishing 1.1.1 RC.

        Show
        Matt Foley added a comment - moved target version to 1.2.0 upon publishing 1.1.1 RC.
        Hide
        Matt Foley added a comment -

        Is this a test bug or a code bug?

        Show
        Matt Foley added a comment - Is this a test bug or a code bug?
        Hide
        Siddharth Seth added a comment -

        TestFairScheduler is still broken. That doesn't make use of UtilsForTests.

        Show
        Siddharth Seth added a comment - TestFairScheduler is still broken. That doesn't make use of UtilsForTests.
        Hide
        Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12547456/mapreduce-4699.patch
        against trunk revision .

        -1 patch. The patch command could not apply the patch.

        Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2902//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12547456/mapreduce-4699.patch against trunk revision . -1 patch . The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2902//console This message is automatically generated.
        Hide
        Gopal V added a comment -

        This patch is necessitated by the following changset to JobTracker

        https://github.com/apache/hadoop-common/commit/31476670aa3de8b553aa6345cf56c67968f9dabc

        Show
        Gopal V added a comment - This patch is necessitated by the following changset to JobTracker https://github.com/apache/hadoop-common/commit/31476670aa3de8b553aa6345cf56c67968f9dabc
        Hide
        Gopal V added a comment -

        Patch to call JobTracker init in the helper class

        Show
        Gopal V added a comment - Patch to call JobTracker init in the helper class
        Hide
        Gopal V added a comment -

        this.fileManager is NULL in JobHistory, looks like JobHistory.init() was not called.

        Show
        Gopal V added a comment - this.fileManager is NULL in JobHistory, looks like JobHistory.init() was not called.

          People

          • Assignee:
            Gopal V
            Reporter:
            Gopal V
          • Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development