Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-6911

TestMapreduceConfigFields.testCompareXmlAgainstConfigurationClass fails consistently

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.9.0, 2.8.2
    • Fix Version/s: 2.9.0, 2.8.2
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      mapred-default.xml has 2 properties missing in  interface org.apache.hadoop.mapreduce.MRJobConfig  interface org.apache.hadoop.mapreduce.MRConfig  class org.apache.hadoop.mapreduce.v2.jobhistory.JHAdminConfig  class org.apache.hadoop.mapred.ShuffleHandler  class org.apache.hadoop.mapreduce.lib.output.FileOutputFormat  class org.apache.hadoop.mapreduce.lib.input.FileInputFormat  class org.apache.hadoop.mapreduce.Job  class org.apache.hadoop.mapreduce.lib.input.NLineInputFormat  class org.apache.hadoop.mapred.JobConf  class org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
      
        mapreduce.jobtracker.system.dir
        mapreduce.jobtracker.staging.root.dir
      
      1. MAPREDUCE-6911.001.patch
        1 kB
        Eric Badger
      2. MAPREDUCE-6911-branch-2.001.patch
        1 kB
        Eric Badger

        Issue Links

          Activity

          Hide
          ebadger Eric Badger added a comment -

          This was broken by MAPREDUCE-6909. Looks like the test can't find any usage of the configs

          Show
          ebadger Eric Badger added a comment - This was broken by MAPREDUCE-6909 . Looks like the test can't find any usage of the configs
          Hide
          ebadger Eric Badger added a comment -

          Attaching a patch that adds the properties to the skip list

          Show
          ebadger Eric Badger added a comment - Attaching a patch that adds the properties to the skip list
          Hide
          ebadger Eric Badger added a comment -

          Forgot to name the patch against branch-2 so here's the same patch with the correct name so that hadoopqa will run correctly (hopefully)

          Show
          ebadger Eric Badger added a comment - Forgot to name the patch against branch-2 so here's the same patch with the correct name so that hadoopqa will run correctly (hopefully)
          Hide
          hadoopqa Hadoop QA added a comment -
          +1 overall



          Vote Subsystem Runtime Comment
          0 reexec 20m 24s Docker mode activated.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
          +1 mvninstall 7m 41s branch-2 passed
          +1 compile 0m 20s branch-2 passed with JDK v1.8.0_131
          +1 compile 0m 24s branch-2 passed with JDK v1.7.0_131
          +1 checkstyle 0m 18s branch-2 passed
          +1 mvnsite 0m 30s branch-2 passed
          +1 mvneclipse 0m 15s branch-2 passed
          +1 findbugs 0m 46s branch-2 passed
          +1 javadoc 0m 15s branch-2 passed with JDK v1.8.0_131
          +1 javadoc 0m 17s branch-2 passed with JDK v1.7.0_131
          +1 mvninstall 0m 23s the patch passed
          +1 compile 0m 17s the patch passed with JDK v1.8.0_131
          +1 javac 0m 17s the patch passed
          +1 compile 0m 23s the patch passed with JDK v1.7.0_131
          +1 javac 0m 23s the patch passed
          +1 checkstyle 0m 15s the patch passed
          +1 mvnsite 0m 26s the patch passed
          +1 mvneclipse 0m 12s the patch passed
          +1 whitespace 0m 0s The patch has no whitespace issues.
          +1 findbugs 0m 53s the patch passed
          +1 javadoc 0m 12s the patch passed with JDK v1.8.0_131
          +1 javadoc 0m 15s the patch passed with JDK v1.7.0_131
          +1 unit 8m 40s hadoop-mapreduce-client-app in the patch passed with JDK v1.7.0_131.
          +1 asflicense 0m 18s The patch does not generate ASF License warnings.
          53m 20s



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:5e40efe
          JIRA Issue MAPREDUCE-6911
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12875824/MAPREDUCE-6911-branch-2.001.patch
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
          uname Linux 86624306a131 3.13.0-117-generic #164-Ubuntu SMP Fri Apr 7 11:05:26 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision branch-2 / b803641
          Default Java 1.7.0_131
          Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_131 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_131
          findbugs v3.0.0
          JDK v1.7.0_131 Test Results https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/7018/testReport/
          modules C: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app U: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app
          Console output https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/7018/console
          Powered by Apache Yetus 0.4.0 http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - +1 overall Vote Subsystem Runtime Comment 0 reexec 20m 24s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. +1 mvninstall 7m 41s branch-2 passed +1 compile 0m 20s branch-2 passed with JDK v1.8.0_131 +1 compile 0m 24s branch-2 passed with JDK v1.7.0_131 +1 checkstyle 0m 18s branch-2 passed +1 mvnsite 0m 30s branch-2 passed +1 mvneclipse 0m 15s branch-2 passed +1 findbugs 0m 46s branch-2 passed +1 javadoc 0m 15s branch-2 passed with JDK v1.8.0_131 +1 javadoc 0m 17s branch-2 passed with JDK v1.7.0_131 +1 mvninstall 0m 23s the patch passed +1 compile 0m 17s the patch passed with JDK v1.8.0_131 +1 javac 0m 17s the patch passed +1 compile 0m 23s the patch passed with JDK v1.7.0_131 +1 javac 0m 23s the patch passed +1 checkstyle 0m 15s the patch passed +1 mvnsite 0m 26s the patch passed +1 mvneclipse 0m 12s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 findbugs 0m 53s the patch passed +1 javadoc 0m 12s the patch passed with JDK v1.8.0_131 +1 javadoc 0m 15s the patch passed with JDK v1.7.0_131 +1 unit 8m 40s hadoop-mapreduce-client-app in the patch passed with JDK v1.7.0_131. +1 asflicense 0m 18s The patch does not generate ASF License warnings. 53m 20s Subsystem Report/Notes Docker Image:yetus/hadoop:5e40efe JIRA Issue MAPREDUCE-6911 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12875824/MAPREDUCE-6911-branch-2.001.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux 86624306a131 3.13.0-117-generic #164-Ubuntu SMP Fri Apr 7 11:05:26 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision branch-2 / b803641 Default Java 1.7.0_131 Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_131 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_131 findbugs v3.0.0 JDK v1.7.0_131 Test Results https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/7018/testReport/ modules C: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app U: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app Console output https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/7018/console Powered by Apache Yetus 0.4.0 http://yetus.apache.org This message was automatically generated.
          Hide
          jlowe Jason Lowe added a comment -

          +1 lgtm. Committing this.

          Show
          jlowe Jason Lowe added a comment - +1 lgtm. Committing this.
          Hide
          jlowe Jason Lowe added a comment -

          Thanks, Eric! I committed this to branch-2, branch-2.8, and branch-2.8.2.

          Show
          jlowe Jason Lowe added a comment - Thanks, Eric! I committed this to branch-2, branch-2.8, and branch-2.8.2.

            People

            • Assignee:
              ebadger Eric Badger
              Reporter:
              ebadger Eric Badger
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development