Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-6696

Add a configuration to limit the number of map tasks allowed per job.

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.8.0
    • Fix Version/s: 2.9.0, 3.0.0-alpha1
    • Component/s: job submission
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      Add a configuration "mapreduce.job.max.map" to limit the number of map tasks allowed per job. It will be useful for Hadoop admin to save Hadoop cluster resource by preventing users from submitting big mapreduce jobs. A mapredeuce job with too many mappers may fail with OOM after running for long time. It will be a big waste.

      1. MAPREDUCE-6696.000.patch
        5 kB
        zhihai xu
      2. MAPREDUCE-6696.001.patch
        5 kB
        zhihai xu
      3. MAPREDUCE-6696.002.patch
        5 kB
        zhihai xu
      4. MAPREDUCE-6696.003.patch
        5 kB
        zhihai xu
      5. MAPREDUCE-6696.004.patch
        5 kB
        zhihai xu

        Activity

        Hide
        zxu zhihai xu added a comment -

        Jian He thanks for reviewing and committing the patch!

        Show
        zxu zhihai xu added a comment - Jian He thanks for reviewing and committing the patch!
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Hadoop-trunk-Commit #9829 (See https://builds.apache.org/job/Hadoop-trunk-Commit/9829/)
        MAPREDUCE-6696. Add a configuration to limit the number of map tasks (jianhe: rev 21d2b90213e8e188bcac31f9360c5176ac89d083)

        • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestLocalJobSubmission.java
        • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
        • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java
        • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/JobSubmitter.java
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-trunk-Commit #9829 (See https://builds.apache.org/job/Hadoop-trunk-Commit/9829/ ) MAPREDUCE-6696 . Add a configuration to limit the number of map tasks (jianhe: rev 21d2b90213e8e188bcac31f9360c5176ac89d083) hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestLocalJobSubmission.java hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/JobSubmitter.java
        Hide
        jianhe Jian He added a comment -

        Committed to trunk, branch-2, thanks Zhihai !

        Show
        jianhe Jian He added a comment - Committed to trunk, branch-2, thanks Zhihai !
        Hide
        jianhe Jian He added a comment -

        lgtm, +1

        Show
        jianhe Jian He added a comment - lgtm, +1
        Hide
        zxu zhihai xu added a comment -

        Also it looks like the check style issue is not a real issue. because all configuration definitions in MRJobConfig use "public static final", this patch follows the same rule. I don't why check style script reported this issue.

        Show
        zxu zhihai xu added a comment - Also it looks like the check style issue is not a real issue. because all configuration definitions in MRJobConfig use "public static final", this patch follows the same rule. I don't why check style script reported this issue.
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 11s Docker mode activated.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
        0 mvndep 0m 9s Maven dependency ordering for branch
        +1 mvninstall 7m 18s trunk passed
        +1 compile 1m 44s trunk passed
        +1 checkstyle 0m 35s trunk passed
        +1 mvnsite 1m 0s trunk passed
        +1 mvneclipse 0m 24s trunk passed
        +1 findbugs 1m 21s trunk passed
        +1 javadoc 0m 35s trunk passed
        0 mvndep 0m 9s Maven dependency ordering for patch
        +1 mvninstall 0m 49s the patch passed
        +1 compile 1m 44s the patch passed
        +1 javac 1m 44s the patch passed
        -1 checkstyle 0m 33s hadoop-mapreduce-project/hadoop-mapreduce-client: patch generated 2 new + 539 unchanged - 1 fixed = 541 total (was 540)
        +1 mvnsite 0m 48s the patch passed
        +1 mvneclipse 0m 19s the patch passed
        +1 whitespace 0m 0s Patch has no whitespace issues.
        +1 xml 0m 2s The patch has no ill-formed XML file.
        +1 findbugs 1m 29s the patch passed
        +1 javadoc 0m 32s the patch passed
        +1 unit 2m 11s hadoop-mapreduce-client-core in the patch passed.
        -1 unit 106m 10s hadoop-mapreduce-client-jobclient in the patch failed.
        +1 asflicense 0m 23s Patch does not generate ASF License warnings.
        129m 16s



        Reason Tests
        Failed junit tests hadoop.mapred.TestMiniMRChildTask



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:2c91fd8
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12804964/MAPREDUCE-6696.004.patch
        JIRA Issue MAPREDUCE-6696
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml
        uname Linux d5321a7ae7f0 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / 141873c
        Default Java 1.8.0_91
        findbugs v3.0.0
        checkstyle https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6514/artifact/patchprocess/diff-checkstyle-hadoop-mapreduce-project_hadoop-mapreduce-client.txt
        unit https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6514/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt
        unit test logs https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6514/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt
        Test Results https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6514/testReport/
        modules C: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient U: hadoop-mapreduce-project/hadoop-mapreduce-client
        Console output https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6514/console
        Powered by Apache Yetus 0.2.0 http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 11s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. 0 mvndep 0m 9s Maven dependency ordering for branch +1 mvninstall 7m 18s trunk passed +1 compile 1m 44s trunk passed +1 checkstyle 0m 35s trunk passed +1 mvnsite 1m 0s trunk passed +1 mvneclipse 0m 24s trunk passed +1 findbugs 1m 21s trunk passed +1 javadoc 0m 35s trunk passed 0 mvndep 0m 9s Maven dependency ordering for patch +1 mvninstall 0m 49s the patch passed +1 compile 1m 44s the patch passed +1 javac 1m 44s the patch passed -1 checkstyle 0m 33s hadoop-mapreduce-project/hadoop-mapreduce-client: patch generated 2 new + 539 unchanged - 1 fixed = 541 total (was 540) +1 mvnsite 0m 48s the patch passed +1 mvneclipse 0m 19s the patch passed +1 whitespace 0m 0s Patch has no whitespace issues. +1 xml 0m 2s The patch has no ill-formed XML file. +1 findbugs 1m 29s the patch passed +1 javadoc 0m 32s the patch passed +1 unit 2m 11s hadoop-mapreduce-client-core in the patch passed. -1 unit 106m 10s hadoop-mapreduce-client-jobclient in the patch failed. +1 asflicense 0m 23s Patch does not generate ASF License warnings. 129m 16s Reason Tests Failed junit tests hadoop.mapred.TestMiniMRChildTask Subsystem Report/Notes Docker Image:yetus/hadoop:2c91fd8 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12804964/MAPREDUCE-6696.004.patch JIRA Issue MAPREDUCE-6696 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml uname Linux d5321a7ae7f0 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 141873c Default Java 1.8.0_91 findbugs v3.0.0 checkstyle https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6514/artifact/patchprocess/diff-checkstyle-hadoop-mapreduce-project_hadoop-mapreduce-client.txt unit https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6514/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt unit test logs https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6514/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt Test Results https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6514/testReport/ modules C: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient U: hadoop-mapreduce-project/hadoop-mapreduce-client Console output https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6514/console Powered by Apache Yetus 0.2.0 http://yetus.apache.org This message was automatically generated.
        Hide
        zxu zhihai xu added a comment -

        The test failures are not related to my change. It is already reported at https://issues.apache.org/jira/browse/MAPREDUCE-6702

        Show
        zxu zhihai xu added a comment - The test failures are not related to my change. It is already reported at https://issues.apache.org/jira/browse/MAPREDUCE-6702
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 12s Docker mode activated.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
        0 mvndep 0m 6s Maven dependency ordering for branch
        +1 mvninstall 6m 14s trunk passed
        +1 compile 1m 31s trunk passed
        +1 checkstyle 0m 32s trunk passed
        +1 mvnsite 0m 55s trunk passed
        +1 mvneclipse 0m 22s trunk passed
        +1 findbugs 1m 5s trunk passed
        +1 javadoc 0m 35s trunk passed
        0 mvndep 0m 6s Maven dependency ordering for patch
        +1 mvninstall 0m 41s the patch passed
        +1 compile 1m 27s the patch passed
        +1 javac 1m 27s the patch passed
        -1 checkstyle 0m 29s hadoop-mapreduce-project/hadoop-mapreduce-client: patch generated 2 new + 539 unchanged - 1 fixed = 541 total (was 540)
        +1 mvnsite 0m 47s the patch passed
        +1 mvneclipse 0m 19s the patch passed
        +1 whitespace 0m 0s Patch has no whitespace issues.
        +1 xml 0m 1s The patch has no ill-formed XML file.
        +1 findbugs 1m 19s the patch passed
        +1 javadoc 0m 28s the patch passed
        +1 unit 1m 55s hadoop-mapreduce-client-core in the patch passed.
        -1 unit 107m 31s hadoop-mapreduce-client-jobclient in the patch failed.
        +1 asflicense 0m 26s Patch does not generate ASF License warnings.
        127m 44s



        Reason Tests
        Failed junit tests hadoop.mapred.TestMiniMRChildTask



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:2c91fd8
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12804872/MAPREDUCE-6696.003.patch
        JIRA Issue MAPREDUCE-6696
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml
        uname Linux 11759b34e3cc 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / 1597630
        Default Java 1.8.0_91
        findbugs v3.0.0
        checkstyle https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6513/artifact/patchprocess/diff-checkstyle-hadoop-mapreduce-project_hadoop-mapreduce-client.txt
        unit https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6513/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt
        unit test logs https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6513/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt
        Test Results https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6513/testReport/
        modules C: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient U: hadoop-mapreduce-project/hadoop-mapreduce-client
        Console output https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6513/console
        Powered by Apache Yetus 0.2.0 http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 12s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. 0 mvndep 0m 6s Maven dependency ordering for branch +1 mvninstall 6m 14s trunk passed +1 compile 1m 31s trunk passed +1 checkstyle 0m 32s trunk passed +1 mvnsite 0m 55s trunk passed +1 mvneclipse 0m 22s trunk passed +1 findbugs 1m 5s trunk passed +1 javadoc 0m 35s trunk passed 0 mvndep 0m 6s Maven dependency ordering for patch +1 mvninstall 0m 41s the patch passed +1 compile 1m 27s the patch passed +1 javac 1m 27s the patch passed -1 checkstyle 0m 29s hadoop-mapreduce-project/hadoop-mapreduce-client: patch generated 2 new + 539 unchanged - 1 fixed = 541 total (was 540) +1 mvnsite 0m 47s the patch passed +1 mvneclipse 0m 19s the patch passed +1 whitespace 0m 0s Patch has no whitespace issues. +1 xml 0m 1s The patch has no ill-formed XML file. +1 findbugs 1m 19s the patch passed +1 javadoc 0m 28s the patch passed +1 unit 1m 55s hadoop-mapreduce-client-core in the patch passed. -1 unit 107m 31s hadoop-mapreduce-client-jobclient in the patch failed. +1 asflicense 0m 26s Patch does not generate ASF License warnings. 127m 44s Reason Tests Failed junit tests hadoop.mapred.TestMiniMRChildTask Subsystem Report/Notes Docker Image:yetus/hadoop:2c91fd8 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12804872/MAPREDUCE-6696.003.patch JIRA Issue MAPREDUCE-6696 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml uname Linux 11759b34e3cc 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 1597630 Default Java 1.8.0_91 findbugs v3.0.0 checkstyle https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6513/artifact/patchprocess/diff-checkstyle-hadoop-mapreduce-project_hadoop-mapreduce-client.txt unit https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6513/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt unit test logs https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6513/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt Test Results https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6513/testReport/ modules C: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient U: hadoop-mapreduce-project/hadoop-mapreduce-client Console output https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6513/console Powered by Apache Yetus 0.2.0 http://yetus.apache.org This message was automatically generated.
        Hide
        zxu zhihai xu added a comment -

        Thanks Jian He! These are good suggestions. I uploaded a new patch MAPREDUCE-6696.003.patch which addressed all your comments, Please review it thanks.

        Show
        zxu zhihai xu added a comment - Thanks Jian He ! These are good suggestions. I uploaded a new patch MAPREDUCE-6696 .003.patch which addressed all your comments, Please review it thanks.
        Hide
        jianhe Jian He added a comment -

        also, may be throw IllegalArgumentException instead of RuntimeException ?

        Show
        jianhe Jian He added a comment - also, may be throw IllegalArgumentException instead of RuntimeException ?
        Hide
        jianhe Jian He added a comment -

        I see, thanks for your explanation. patch looks good to me, minor nit:
        may be useful to print the current number of map tasks too in the exception message ? just to be more clear.

        new RuntimeException("The number of map tasks exceeded limit " +
                    maxMaps);
        
        Show
        jianhe Jian He added a comment - I see, thanks for your explanation. patch looks good to me, minor nit: may be useful to print the current number of map tasks too in the exception message ? just to be more clear. new RuntimeException( "The number of map tasks exceeded limit " + maxMaps);
        Hide
        zxu zhihai xu added a comment - - edited

        Thanks for the review Jian He! good finding yes, JobImpl#checkTaskLimits was the very initial code for the task limit, but this will happen at AM so it still will waste some resource (AM container). Yes, MRJobConfig.NUM_MAPS is giving a hint about but my patch is based on InputFormat.getSplits, which will exactly match the number of mappers of the MapReduce Job:

               LOG.debug("Creating splits at " + jtFs.makeQualified(submitJobDir));
              int maps = writeSplits(job, submitJobDir);
              conf.setInt(MRJobConfig.NUM_MAPS, maps);
              LOG.info("number of splits:" + maps);
        

        writeSplits will call InputFormat.getSplits and writeJobSplitMetaInfo to create file "job.splitmetainfo". JobImpl called by AM will read file "job.splitmetainfo" by calling createSplits and readSplitMetaInfo to get input split info.

           /** 
           * Logically split the set of input files for the job.  
           * 
           * <p>Each {@link InputSplit} is then assigned to an individual {@link Mapper}
           * for processing.</p>
           *
           * <p><i>Note</i>: The split is a <i>logical</i> split of the inputs and the
           * input files are not physically split into chunks. For e.g. a split could
           * be <i>&lt;input-file-path, start, offset&gt;</i> tuple.
           * 
           * @param job job configuration.
           * @param numSplits the desired number of splits, a hint.
           * @return an array of {@link InputSplit}s for the job.
           */
          InputSplit[] getSplits(JobConf job, int numSplits) throws IOException;
        

        My patch will reject the job during submission, which can save AM container resource.

        Show
        zxu zhihai xu added a comment - - edited Thanks for the review Jian He ! good finding yes, JobImpl#checkTaskLimits was the very initial code for the task limit, but this will happen at AM so it still will waste some resource (AM container). Yes, MRJobConfig.NUM_MAPS is giving a hint about but my patch is based on InputFormat.getSplits, which will exactly match the number of mappers of the MapReduce Job: LOG.debug( "Creating splits at " + jtFs.makeQualified(submitJobDir)); int maps = writeSplits(job, submitJobDir); conf.setInt(MRJobConfig.NUM_MAPS, maps); LOG.info( "number of splits:" + maps); writeSplits will call InputFormat.getSplits and writeJobSplitMetaInfo to create file "job.splitmetainfo". JobImpl called by AM will read file "job.splitmetainfo" by calling createSplits and readSplitMetaInfo to get input split info. /** * Logically split the set of input files for the job. * * <p>Each {@link InputSplit} is then assigned to an individual {@link Mapper} * for processing.</p> * * <p><i>Note</i>: The split is a <i>logical</i> split of the inputs and the * input files are not physically split into chunks. For e.g. a split could * be <i>&lt;input-file-path, start, offset&gt;</i> tuple. * * @param job job configuration. * @param numSplits the desired number of splits, a hint. * @ return an array of {@link InputSplit}s for the job. */ InputSplit[] getSplits(JobConf job, int numSplits) throws IOException; My patch will reject the job during submission, which can save AM container resource.
        Hide
        jianhe Jian He added a comment -

        I think the MRJobConfig.NUM_MAPS is giving a hint about, not the actual, number of maps.
        Btw, seems JobImpl#checkTaskLimits was the very initial code for the task limit. I guess it was removed when YARN got created based on git history

        Show
        jianhe Jian He added a comment - I think the MRJobConfig.NUM_MAPS is giving a hint about, not the actual, number of maps. Btw, seems JobImpl#checkTaskLimits was the very initial code for the task limit. I guess it was removed when YARN got created based on git history
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 12s Docker mode activated.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
        0 mvndep 0m 11s Maven dependency ordering for branch
        +1 mvninstall 10m 30s trunk passed
        +1 compile 2m 19s trunk passed
        +1 checkstyle 0m 40s trunk passed
        +1 mvnsite 1m 13s trunk passed
        +1 mvneclipse 0m 30s trunk passed
        +1 findbugs 1m 35s trunk passed
        +1 javadoc 0m 48s trunk passed
        0 mvndep 0m 10s Maven dependency ordering for patch
        +1 mvninstall 1m 3s the patch passed
        +1 compile 2m 18s the patch passed
        +1 javac 2m 18s the patch passed
        -1 checkstyle 0m 37s hadoop-mapreduce-project/hadoop-mapreduce-client: patch generated 2 new + 539 unchanged - 1 fixed = 541 total (was 540)
        +1 mvnsite 1m 9s the patch passed
        +1 mvneclipse 0m 25s the patch passed
        +1 whitespace 0m 0s Patch has no whitespace issues.
        +1 xml 0m 2s The patch has no ill-formed XML file.
        +1 findbugs 1m 51s the patch passed
        +1 javadoc 0m 40s the patch passed
        +1 unit 2m 37s hadoop-mapreduce-client-core in the patch passed.
        -1 unit 98m 5s hadoop-mapreduce-client-jobclient in the patch failed.
        +1 asflicense 0m 40s Patch does not generate ASF License warnings.
        128m 34s



        Reason Tests
        Failed junit tests hadoop.mapreduce.v2.TestSpeculativeExecution
          hadoop.mapreduce.security.ssl.TestEncryptedShuffle
          hadoop.mapred.TestMiniMRChildTask
          hadoop.mapreduce.v2.TestSpeculativeExecutionWithMRApp
          hadoop.mapred.TestJobSysDirWithDFS
          hadoop.mapred.TestMiniMRClientCluster
          hadoop.mapred.TestClusterMRNotification
          hadoop.mapred.TestMRTimelineEventHandling
          hadoop.mapreduce.v2.TestMRJobsWithHistoryService
          hadoop.mapreduce.security.TestBinaryTokenFile
          hadoop.mapreduce.v2.TestNonExistentJob
          hadoop.mapreduce.v2.TestMiniMRProxyUser
          hadoop.mapred.TestNetworkedJob
          hadoop.mapreduce.v2.TestMROldApiJobs
          hadoop.mapred.TestClusterMapReduceTestCase
          hadoop.mapred.TestReduceFetchFromPartialMem
          hadoop.mapreduce.lib.output.TestJobOutputCommitter
          hadoop.mapreduce.TestLargeSort
          hadoop.mapreduce.v2.TestMRAppWithCombiner
          hadoop.hdfs.TestNNBench
          hadoop.mapreduce.v2.TestMRJobsWithProfiler
          hadoop.mapred.TestLocalJobSubmission
          hadoop.mapreduce.TestMapReduceLazyOutput
          hadoop.mapreduce.v2.TestUberAM
          hadoop.mapreduce.security.TestMRCredentials
          hadoop.mapred.TestMerge
          hadoop.mapreduce.v2.TestMRAMWithNonNormalizedCapabilities
          hadoop.mapreduce.v2.TestRMNMInfo
          hadoop.mapreduce.TestChild
          hadoop.mapreduce.TestMRJobClient
          hadoop.mapred.join.TestDatamerge
          hadoop.mapreduce.v2.TestMRJobs
        Timed out junit tests org.apache.hadoop.mapreduce.lib.jobcontrol.TestMapReduceJobControl
          org.apache.hadoop.mapred.TestMiniMRWithDFSWithDistinctUsers



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:2c91fd8
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12804504/MAPREDUCE-6696.002.patch
        JIRA Issue MAPREDUCE-6696
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml
        uname Linux d84f2baf7f94 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / fa3bc34
        Default Java 1.8.0_91
        findbugs v3.0.0
        checkstyle https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6511/artifact/patchprocess/diff-checkstyle-hadoop-mapreduce-project_hadoop-mapreduce-client.txt
        unit https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6511/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt
        unit test logs https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6511/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt
        Test Results https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6511/testReport/
        modules C: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient U: hadoop-mapreduce-project/hadoop-mapreduce-client
        Console output https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6511/console
        Powered by Apache Yetus 0.2.0 http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 12s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. 0 mvndep 0m 11s Maven dependency ordering for branch +1 mvninstall 10m 30s trunk passed +1 compile 2m 19s trunk passed +1 checkstyle 0m 40s trunk passed +1 mvnsite 1m 13s trunk passed +1 mvneclipse 0m 30s trunk passed +1 findbugs 1m 35s trunk passed +1 javadoc 0m 48s trunk passed 0 mvndep 0m 10s Maven dependency ordering for patch +1 mvninstall 1m 3s the patch passed +1 compile 2m 18s the patch passed +1 javac 2m 18s the patch passed -1 checkstyle 0m 37s hadoop-mapreduce-project/hadoop-mapreduce-client: patch generated 2 new + 539 unchanged - 1 fixed = 541 total (was 540) +1 mvnsite 1m 9s the patch passed +1 mvneclipse 0m 25s the patch passed +1 whitespace 0m 0s Patch has no whitespace issues. +1 xml 0m 2s The patch has no ill-formed XML file. +1 findbugs 1m 51s the patch passed +1 javadoc 0m 40s the patch passed +1 unit 2m 37s hadoop-mapreduce-client-core in the patch passed. -1 unit 98m 5s hadoop-mapreduce-client-jobclient in the patch failed. +1 asflicense 0m 40s Patch does not generate ASF License warnings. 128m 34s Reason Tests Failed junit tests hadoop.mapreduce.v2.TestSpeculativeExecution   hadoop.mapreduce.security.ssl.TestEncryptedShuffle   hadoop.mapred.TestMiniMRChildTask   hadoop.mapreduce.v2.TestSpeculativeExecutionWithMRApp   hadoop.mapred.TestJobSysDirWithDFS   hadoop.mapred.TestMiniMRClientCluster   hadoop.mapred.TestClusterMRNotification   hadoop.mapred.TestMRTimelineEventHandling   hadoop.mapreduce.v2.TestMRJobsWithHistoryService   hadoop.mapreduce.security.TestBinaryTokenFile   hadoop.mapreduce.v2.TestNonExistentJob   hadoop.mapreduce.v2.TestMiniMRProxyUser   hadoop.mapred.TestNetworkedJob   hadoop.mapreduce.v2.TestMROldApiJobs   hadoop.mapred.TestClusterMapReduceTestCase   hadoop.mapred.TestReduceFetchFromPartialMem   hadoop.mapreduce.lib.output.TestJobOutputCommitter   hadoop.mapreduce.TestLargeSort   hadoop.mapreduce.v2.TestMRAppWithCombiner   hadoop.hdfs.TestNNBench   hadoop.mapreduce.v2.TestMRJobsWithProfiler   hadoop.mapred.TestLocalJobSubmission   hadoop.mapreduce.TestMapReduceLazyOutput   hadoop.mapreduce.v2.TestUberAM   hadoop.mapreduce.security.TestMRCredentials   hadoop.mapred.TestMerge   hadoop.mapreduce.v2.TestMRAMWithNonNormalizedCapabilities   hadoop.mapreduce.v2.TestRMNMInfo   hadoop.mapreduce.TestChild   hadoop.mapreduce.TestMRJobClient   hadoop.mapred.join.TestDatamerge   hadoop.mapreduce.v2.TestMRJobs Timed out junit tests org.apache.hadoop.mapreduce.lib.jobcontrol.TestMapReduceJobControl   org.apache.hadoop.mapred.TestMiniMRWithDFSWithDistinctUsers Subsystem Report/Notes Docker Image:yetus/hadoop:2c91fd8 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12804504/MAPREDUCE-6696.002.patch JIRA Issue MAPREDUCE-6696 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml uname Linux d84f2baf7f94 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / fa3bc34 Default Java 1.8.0_91 findbugs v3.0.0 checkstyle https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6511/artifact/patchprocess/diff-checkstyle-hadoop-mapreduce-project_hadoop-mapreduce-client.txt unit https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6511/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt unit test logs https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6511/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt Test Results https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6511/testReport/ modules C: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient U: hadoop-mapreduce-project/hadoop-mapreduce-client Console output https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6511/console Powered by Apache Yetus 0.2.0 http://yetus.apache.org This message was automatically generated.
        Hide
        zxu zhihai xu added a comment - - edited

        All these test failures are not related to my changes:

        TestMRCJCFileOutputCommitter is passed in my local build also the failure for TestMRCJCFileOutputCommitter is due to test environment problem:

        2016-05-17 17:29:33,792 WARN  [main] util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(60)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable.
        

        TestMiniMRChildTask and TestMiniMRChildTask.testTaskOldEnv failure happened at launchContainer which already pass job submission phase after my code change.

        2016-05-17 17:45:48,781 WARN  [ContainersLauncher #1] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(245)) - Exception from container-launch with container ID: container_1463507138005_0001_01_000002 and exit code: 127
        ExitCodeException exitCode=127: nice: bash: No such file or directory
        
        	at org.apache.hadoop.util.Shell.runCommand(Shell.java:946)
        	at org.apache.hadoop.util.Shell.run(Shell.java:850)
        	at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1144)
        	at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:227)
        	at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:385)
        	at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:281)
        	at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:89)
        	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        	at java.lang.Thread.run(Thread.java:745)
        
        Show
        zxu zhihai xu added a comment - - edited All these test failures are not related to my changes: TestMRCJCFileOutputCommitter is passed in my local build also the failure for TestMRCJCFileOutputCommitter is due to test environment problem: 2016-05-17 17:29:33,792 WARN [main] util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(60)) - Unable to load native -hadoop library for your platform... using builtin-java classes where applicable. TestMiniMRChildTask and TestMiniMRChildTask.testTaskOldEnv failure happened at launchContainer which already pass job submission phase after my code change. 2016-05-17 17:45:48,781 WARN [ContainersLauncher #1] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(245)) - Exception from container-launch with container ID: container_1463507138005_0001_01_000002 and exit code: 127 ExitCodeException exitCode=127: nice: bash: No such file or directory at org.apache.hadoop.util.Shell.runCommand(Shell.java:946) at org.apache.hadoop.util.Shell.run(Shell.java:850) at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1144) at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:227) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:385) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:281) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:89) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang. Thread .run( Thread .java:745)
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 11s Docker mode activated.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
        0 mvndep 0m 7s Maven dependency ordering for branch
        +1 mvninstall 5m 58s trunk passed
        +1 compile 1m 28s trunk passed
        +1 checkstyle 0m 30s trunk passed
        +1 mvnsite 0m 51s trunk passed
        +1 mvneclipse 0m 22s trunk passed
        +1 findbugs 1m 5s trunk passed
        +1 javadoc 0m 33s trunk passed
        0 mvndep 0m 7s Maven dependency ordering for patch
        +1 mvninstall 0m 39s the patch passed
        +1 compile 1m 27s the patch passed
        +1 javac 1m 27s the patch passed
        -1 checkstyle 0m 28s hadoop-mapreduce-project/hadoop-mapreduce-client: patch generated 2 new + 539 unchanged - 1 fixed = 541 total (was 540)
        +1 mvnsite 0m 46s the patch passed
        +1 mvneclipse 0m 18s the patch passed
        +1 whitespace 0m 0s Patch has no whitespace issues.
        +1 xml 0m 1s The patch has no ill-formed XML file.
        +1 findbugs 1m 15s the patch passed
        +1 javadoc 0m 29s the patch passed
        +1 unit 1m 55s hadoop-mapreduce-client-core in the patch passed.
        -1 unit 102m 26s hadoop-mapreduce-client-jobclient in the patch failed.
        +1 asflicense 0m 24s Patch does not generate ASF License warnings.
        122m 2s



        Reason Tests
        Failed junit tests hadoop.mapred.TestMRCJCFileOutputCommitter
          hadoop.mapred.TestMiniMRChildTask



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:2c91fd8
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12804448/MAPREDUCE-6696.001.patch
        JIRA Issue MAPREDUCE-6696
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml
        uname Linux 7ff4c2a0c4af 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / 34fddd1
        Default Java 1.8.0_91
        findbugs v3.0.0
        checkstyle https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6510/artifact/patchprocess/diff-checkstyle-hadoop-mapreduce-project_hadoop-mapreduce-client.txt
        unit https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6510/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt
        unit test logs https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6510/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt
        Test Results https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6510/testReport/
        modules C: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient U: hadoop-mapreduce-project/hadoop-mapreduce-client
        Console output https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6510/console
        Powered by Apache Yetus 0.2.0 http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 11s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. 0 mvndep 0m 7s Maven dependency ordering for branch +1 mvninstall 5m 58s trunk passed +1 compile 1m 28s trunk passed +1 checkstyle 0m 30s trunk passed +1 mvnsite 0m 51s trunk passed +1 mvneclipse 0m 22s trunk passed +1 findbugs 1m 5s trunk passed +1 javadoc 0m 33s trunk passed 0 mvndep 0m 7s Maven dependency ordering for patch +1 mvninstall 0m 39s the patch passed +1 compile 1m 27s the patch passed +1 javac 1m 27s the patch passed -1 checkstyle 0m 28s hadoop-mapreduce-project/hadoop-mapreduce-client: patch generated 2 new + 539 unchanged - 1 fixed = 541 total (was 540) +1 mvnsite 0m 46s the patch passed +1 mvneclipse 0m 18s the patch passed +1 whitespace 0m 0s Patch has no whitespace issues. +1 xml 0m 1s The patch has no ill-formed XML file. +1 findbugs 1m 15s the patch passed +1 javadoc 0m 29s the patch passed +1 unit 1m 55s hadoop-mapreduce-client-core in the patch passed. -1 unit 102m 26s hadoop-mapreduce-client-jobclient in the patch failed. +1 asflicense 0m 24s Patch does not generate ASF License warnings. 122m 2s Reason Tests Failed junit tests hadoop.mapred.TestMRCJCFileOutputCommitter   hadoop.mapred.TestMiniMRChildTask Subsystem Report/Notes Docker Image:yetus/hadoop:2c91fd8 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12804448/MAPREDUCE-6696.001.patch JIRA Issue MAPREDUCE-6696 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml uname Linux 7ff4c2a0c4af 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 34fddd1 Default Java 1.8.0_91 findbugs v3.0.0 checkstyle https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6510/artifact/patchprocess/diff-checkstyle-hadoop-mapreduce-project_hadoop-mapreduce-client.txt unit https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6510/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt unit test logs https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6510/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt Test Results https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6510/testReport/ modules C: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient U: hadoop-mapreduce-project/hadoop-mapreduce-client Console output https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6510/console Powered by Apache Yetus 0.2.0 http://yetus.apache.org This message was automatically generated.
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 13s Docker mode activated.
        +1 @author 0m 1s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
        0 mvndep 0m 22s Maven dependency ordering for branch
        -1 mvninstall 0m 8s root in trunk failed.
        +1 compile 2m 1s trunk passed with JDK v1.8.0_91
        -1 compile 0m 12s hadoop-mapreduce-client in trunk failed with JDK v1.7.0_101.
        +1 checkstyle 0m 40s trunk passed
        -1 mvnsite 0m 12s hadoop-mapreduce-client-core in trunk failed.
        -1 mvnsite 0m 12s hadoop-mapreduce-client-jobclient in trunk failed.
        +1 mvneclipse 0m 24s trunk passed
        -1 findbugs 0m 10s hadoop-mapreduce-client-core in trunk failed.
        -1 findbugs 0m 10s hadoop-mapreduce-client-jobclient in trunk failed.
        +1 javadoc 0m 33s trunk passed with JDK v1.8.0_91
        +1 javadoc 0m 36s trunk passed with JDK v1.7.0_101
        0 mvndep 0m 10s Maven dependency ordering for patch
        -1 mvninstall 0m 10s hadoop-mapreduce-client-core in the patch failed.
        -1 mvninstall 0m 9s hadoop-mapreduce-client-jobclient in the patch failed.
        +1 compile 1m 54s the patch passed with JDK v1.8.0_91
        +1 javac 1m 54s the patch passed
        -1 compile 0m 11s hadoop-mapreduce-client in the patch failed with JDK v1.7.0_101.
        -1 javac 0m 11s hadoop-mapreduce-client in the patch failed with JDK v1.7.0_101.
        -1 checkstyle 0m 35s hadoop-mapreduce-project/hadoop-mapreduce-client: patch generated 2 new + 539 unchanged - 1 fixed = 541 total (was 540)
        -1 mvnsite 0m 12s hadoop-mapreduce-client-core in the patch failed.
        -1 mvnsite 0m 12s hadoop-mapreduce-client-jobclient in the patch failed.
        +1 mvneclipse 0m 25s the patch passed
        +1 whitespace 0m 0s Patch has no whitespace issues.
        +1 xml 0m 0s The patch has no ill-formed XML file.
        -1 findbugs 0m 10s hadoop-mapreduce-client-core in the patch failed.
        -1 findbugs 0m 10s hadoop-mapreduce-client-jobclient in the patch failed.
        +1 javadoc 0m 33s the patch passed with JDK v1.8.0_91
        +1 javadoc 0m 37s the patch passed with JDK v1.7.0_101
        +1 unit 2m 4s hadoop-mapreduce-client-core in the patch passed with JDK v1.8.0_91.
        -1 unit 0m 19s hadoop-mapreduce-client-jobclient in the patch failed with JDK v1.8.0_91.
        -1 unit 0m 10s hadoop-mapreduce-client-core in the patch failed with JDK v1.7.0_101.
        -1 unit 0m 10s hadoop-mapreduce-client-jobclient in the patch failed with JDK v1.7.0_101.
        +1 asflicense 0m 35s Patch does not generate ASF License warnings.
        15m 29s



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:cf2ee45
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12804303/MAPREDUCE-6696.001.patch
        JIRA Issue MAPREDUCE-6696
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml
        uname Linux 107d463c67f0 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / 730bc74
        Default Java 1.7.0_101
        Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_91 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_101
        mvninstall https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6504/artifact/patchprocess/branch-mvninstall-root.txt
        compile https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6504/artifact/patchprocess/branch-compile-hadoop-mapreduce-project_hadoop-mapreduce-client-jdk1.7.0_101.txt
        mvnsite https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6504/artifact/patchprocess/branch-mvnsite-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-core.txt
        mvnsite https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6504/artifact/patchprocess/branch-mvnsite-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt
        findbugs https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6504/artifact/patchprocess/branch-findbugs-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-core.txt
        findbugs https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6504/artifact/patchprocess/branch-findbugs-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt
        mvninstall https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6504/artifact/patchprocess/patch-mvninstall-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-core.txt
        mvninstall https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6504/artifact/patchprocess/patch-mvninstall-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt
        compile https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6504/artifact/patchprocess/patch-compile-hadoop-mapreduce-project_hadoop-mapreduce-client-jdk1.7.0_101.txt
        javac https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6504/artifact/patchprocess/patch-compile-hadoop-mapreduce-project_hadoop-mapreduce-client-jdk1.7.0_101.txt
        checkstyle https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6504/artifact/patchprocess/diff-checkstyle-hadoop-mapreduce-project_hadoop-mapreduce-client.txt
        mvnsite https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6504/artifact/patchprocess/patch-mvnsite-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-core.txt
        mvnsite https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6504/artifact/patchprocess/patch-mvnsite-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt
        findbugs https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6504/artifact/patchprocess/patch-findbugs-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-core.txt
        findbugs https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6504/artifact/patchprocess/patch-findbugs-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt
        unit https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6504/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient-jdk1.8.0_91.txt
        unit https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6504/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-core-jdk1.7.0_101.txt
        unit https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6504/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient-jdk1.7.0_101.txt
        JDK v1.7.0_101 Test Results https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6504/testReport/
        modules C: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient U: hadoop-mapreduce-project/hadoop-mapreduce-client
        Console output https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6504/console
        Powered by Apache Yetus 0.2.0 http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 13s Docker mode activated. +1 @author 0m 1s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. 0 mvndep 0m 22s Maven dependency ordering for branch -1 mvninstall 0m 8s root in trunk failed. +1 compile 2m 1s trunk passed with JDK v1.8.0_91 -1 compile 0m 12s hadoop-mapreduce-client in trunk failed with JDK v1.7.0_101. +1 checkstyle 0m 40s trunk passed -1 mvnsite 0m 12s hadoop-mapreduce-client-core in trunk failed. -1 mvnsite 0m 12s hadoop-mapreduce-client-jobclient in trunk failed. +1 mvneclipse 0m 24s trunk passed -1 findbugs 0m 10s hadoop-mapreduce-client-core in trunk failed. -1 findbugs 0m 10s hadoop-mapreduce-client-jobclient in trunk failed. +1 javadoc 0m 33s trunk passed with JDK v1.8.0_91 +1 javadoc 0m 36s trunk passed with JDK v1.7.0_101 0 mvndep 0m 10s Maven dependency ordering for patch -1 mvninstall 0m 10s hadoop-mapreduce-client-core in the patch failed. -1 mvninstall 0m 9s hadoop-mapreduce-client-jobclient in the patch failed. +1 compile 1m 54s the patch passed with JDK v1.8.0_91 +1 javac 1m 54s the patch passed -1 compile 0m 11s hadoop-mapreduce-client in the patch failed with JDK v1.7.0_101. -1 javac 0m 11s hadoop-mapreduce-client in the patch failed with JDK v1.7.0_101. -1 checkstyle 0m 35s hadoop-mapreduce-project/hadoop-mapreduce-client: patch generated 2 new + 539 unchanged - 1 fixed = 541 total (was 540) -1 mvnsite 0m 12s hadoop-mapreduce-client-core in the patch failed. -1 mvnsite 0m 12s hadoop-mapreduce-client-jobclient in the patch failed. +1 mvneclipse 0m 25s the patch passed +1 whitespace 0m 0s Patch has no whitespace issues. +1 xml 0m 0s The patch has no ill-formed XML file. -1 findbugs 0m 10s hadoop-mapreduce-client-core in the patch failed. -1 findbugs 0m 10s hadoop-mapreduce-client-jobclient in the patch failed. +1 javadoc 0m 33s the patch passed with JDK v1.8.0_91 +1 javadoc 0m 37s the patch passed with JDK v1.7.0_101 +1 unit 2m 4s hadoop-mapreduce-client-core in the patch passed with JDK v1.8.0_91. -1 unit 0m 19s hadoop-mapreduce-client-jobclient in the patch failed with JDK v1.8.0_91. -1 unit 0m 10s hadoop-mapreduce-client-core in the patch failed with JDK v1.7.0_101. -1 unit 0m 10s hadoop-mapreduce-client-jobclient in the patch failed with JDK v1.7.0_101. +1 asflicense 0m 35s Patch does not generate ASF License warnings. 15m 29s Subsystem Report/Notes Docker Image:yetus/hadoop:cf2ee45 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12804303/MAPREDUCE-6696.001.patch JIRA Issue MAPREDUCE-6696 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml uname Linux 107d463c67f0 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 730bc74 Default Java 1.7.0_101 Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_91 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_101 mvninstall https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6504/artifact/patchprocess/branch-mvninstall-root.txt compile https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6504/artifact/patchprocess/branch-compile-hadoop-mapreduce-project_hadoop-mapreduce-client-jdk1.7.0_101.txt mvnsite https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6504/artifact/patchprocess/branch-mvnsite-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-core.txt mvnsite https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6504/artifact/patchprocess/branch-mvnsite-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt findbugs https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6504/artifact/patchprocess/branch-findbugs-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-core.txt findbugs https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6504/artifact/patchprocess/branch-findbugs-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt mvninstall https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6504/artifact/patchprocess/patch-mvninstall-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-core.txt mvninstall https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6504/artifact/patchprocess/patch-mvninstall-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt compile https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6504/artifact/patchprocess/patch-compile-hadoop-mapreduce-project_hadoop-mapreduce-client-jdk1.7.0_101.txt javac https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6504/artifact/patchprocess/patch-compile-hadoop-mapreduce-project_hadoop-mapreduce-client-jdk1.7.0_101.txt checkstyle https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6504/artifact/patchprocess/diff-checkstyle-hadoop-mapreduce-project_hadoop-mapreduce-client.txt mvnsite https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6504/artifact/patchprocess/patch-mvnsite-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-core.txt mvnsite https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6504/artifact/patchprocess/patch-mvnsite-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt findbugs https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6504/artifact/patchprocess/patch-findbugs-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-core.txt findbugs https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6504/artifact/patchprocess/patch-findbugs-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt unit https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6504/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient-jdk1.8.0_91.txt unit https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6504/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-core-jdk1.7.0_101.txt unit https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6504/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient-jdk1.7.0_101.txt JDK v1.7.0_101 Test Results https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6504/testReport/ modules C: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient U: hadoop-mapreduce-project/hadoop-mapreduce-client Console output https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6504/console Powered by Apache Yetus 0.2.0 http://yetus.apache.org This message was automatically generated.
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 13m 46s Docker mode activated.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
        0 mvndep 0m 49s Maven dependency ordering for branch
        +1 mvninstall 8m 44s trunk passed
        +1 compile 2m 9s trunk passed with JDK v1.8.0_91
        +1 compile 2m 13s trunk passed with JDK v1.7.0_101
        +1 checkstyle 0m 42s trunk passed
        +1 mvnsite 1m 10s trunk passed
        +1 mvneclipse 0m 32s trunk passed
        +1 findbugs 1m 49s trunk passed
        +1 javadoc 0m 46s trunk passed with JDK v1.8.0_91
        +1 javadoc 0m 47s trunk passed with JDK v1.7.0_101
        0 mvndep 0m 11s Maven dependency ordering for patch
        +1 mvninstall 0m 58s the patch passed
        +1 compile 2m 9s the patch passed with JDK v1.8.0_91
        +1 javac 2m 9s the patch passed
        +1 compile 2m 9s the patch passed with JDK v1.7.0_101
        +1 javac 2m 9s the patch passed
        -1 checkstyle 0m 38s hadoop-mapreduce-project/hadoop-mapreduce-client: patch generated 3 new + 540 unchanged - 0 fixed = 543 total (was 540)
        +1 mvnsite 1m 6s the patch passed
        +1 mvneclipse 0m 28s the patch passed
        +1 whitespace 0m 0s Patch has no whitespace issues.
        +1 xml 0m 0s The patch has no ill-formed XML file.
        +1 findbugs 2m 15s the patch passed
        +1 javadoc 0m 41s the patch passed with JDK v1.8.0_91
        +1 javadoc 0m 42s the patch passed with JDK v1.7.0_101
        +1 unit 2m 39s hadoop-mapreduce-client-core in the patch passed with JDK v1.8.0_91.
        -1 unit 121m 55s hadoop-mapreduce-client-jobclient in the patch failed with JDK v1.8.0_91.
        +1 unit 2m 52s hadoop-mapreduce-client-core in the patch passed with JDK v1.7.0_101.
        -1 unit 122m 22s hadoop-mapreduce-client-jobclient in the patch failed with JDK v1.7.0_101.
        +1 asflicense 0m 35s Patch does not generate ASF License warnings.
        296m 35s



        Reason Tests
        JDK v1.8.0_91 Failed junit tests hadoop.mapred.TestMiniMRChildTask
        JDK v1.7.0_101 Failed junit tests hadoop.mapred.TestMiniMRChildTask



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:cf2ee45
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12804123/MAPREDUCE-6696.000.patch
        JIRA Issue MAPREDUCE-6696
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml
        uname Linux 6fb764a0c200 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / ad94411
        Default Java 1.7.0_101
        Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_91 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_101
        findbugs v3.0.0
        checkstyle https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6498/artifact/patchprocess/diff-checkstyle-hadoop-mapreduce-project_hadoop-mapreduce-client.txt
        unit https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6498/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient-jdk1.8.0_91.txt
        unit https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6498/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient-jdk1.7.0_101.txt
        unit test logs https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6498/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient-jdk1.8.0_91.txt https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6498/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient-jdk1.7.0_101.txt
        JDK v1.7.0_101 Test Results https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6498/testReport/
        modules C: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient U: hadoop-mapreduce-project/hadoop-mapreduce-client
        Console output https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6498/console
        Powered by Apache Yetus 0.2.0 http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 13m 46s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. 0 mvndep 0m 49s Maven dependency ordering for branch +1 mvninstall 8m 44s trunk passed +1 compile 2m 9s trunk passed with JDK v1.8.0_91 +1 compile 2m 13s trunk passed with JDK v1.7.0_101 +1 checkstyle 0m 42s trunk passed +1 mvnsite 1m 10s trunk passed +1 mvneclipse 0m 32s trunk passed +1 findbugs 1m 49s trunk passed +1 javadoc 0m 46s trunk passed with JDK v1.8.0_91 +1 javadoc 0m 47s trunk passed with JDK v1.7.0_101 0 mvndep 0m 11s Maven dependency ordering for patch +1 mvninstall 0m 58s the patch passed +1 compile 2m 9s the patch passed with JDK v1.8.0_91 +1 javac 2m 9s the patch passed +1 compile 2m 9s the patch passed with JDK v1.7.0_101 +1 javac 2m 9s the patch passed -1 checkstyle 0m 38s hadoop-mapreduce-project/hadoop-mapreduce-client: patch generated 3 new + 540 unchanged - 0 fixed = 543 total (was 540) +1 mvnsite 1m 6s the patch passed +1 mvneclipse 0m 28s the patch passed +1 whitespace 0m 0s Patch has no whitespace issues. +1 xml 0m 0s The patch has no ill-formed XML file. +1 findbugs 2m 15s the patch passed +1 javadoc 0m 41s the patch passed with JDK v1.8.0_91 +1 javadoc 0m 42s the patch passed with JDK v1.7.0_101 +1 unit 2m 39s hadoop-mapreduce-client-core in the patch passed with JDK v1.8.0_91. -1 unit 121m 55s hadoop-mapreduce-client-jobclient in the patch failed with JDK v1.8.0_91. +1 unit 2m 52s hadoop-mapreduce-client-core in the patch passed with JDK v1.7.0_101. -1 unit 122m 22s hadoop-mapreduce-client-jobclient in the patch failed with JDK v1.7.0_101. +1 asflicense 0m 35s Patch does not generate ASF License warnings. 296m 35s Reason Tests JDK v1.8.0_91 Failed junit tests hadoop.mapred.TestMiniMRChildTask JDK v1.7.0_101 Failed junit tests hadoop.mapred.TestMiniMRChildTask Subsystem Report/Notes Docker Image:yetus/hadoop:cf2ee45 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12804123/MAPREDUCE-6696.000.patch JIRA Issue MAPREDUCE-6696 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml uname Linux 6fb764a0c200 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / ad94411 Default Java 1.7.0_101 Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_91 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_101 findbugs v3.0.0 checkstyle https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6498/artifact/patchprocess/diff-checkstyle-hadoop-mapreduce-project_hadoop-mapreduce-client.txt unit https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6498/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient-jdk1.8.0_91.txt unit https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6498/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient-jdk1.7.0_101.txt unit test logs https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6498/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient-jdk1.8.0_91.txt https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6498/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient-jdk1.7.0_101.txt JDK v1.7.0_101 Test Results https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6498/testReport/ modules C: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient U: hadoop-mapreduce-project/hadoop-mapreduce-client Console output https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6498/console Powered by Apache Yetus 0.2.0 http://yetus.apache.org This message was automatically generated.
        Hide
        zxu zhihai xu added a comment -

        I attached a patch MAPREDUCE-6696.000.patch, which added a configuration "mapreduce.job.max.map" to limit the number of map tasks. The default value is -1, which means no limit.

        Show
        zxu zhihai xu added a comment - I attached a patch MAPREDUCE-6696 .000.patch, which added a configuration "mapreduce.job.max.map" to limit the number of map tasks. The default value is -1, which means no limit.

          People

          • Assignee:
            zxu zhihai xu
            Reporter:
            zxu zhihai xu
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development