Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-6776

yarn.app.mapreduce.client.job.max-retries should have a more useful default

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.8.0
    • Fix Version/s: 2.9.0, 3.0.0-alpha2
    • Component/s: client
    • Labels:
      None
    • Hadoop Flags:
      Incompatible change, Reviewed
    • Release Note:
      The default value of yarn.app.mapreduce.client.job.max-retries has been changed from 0 to 3. This will help protect clients from failures that are transient. True failures may take slightly longer now due to the retries.

      Description

      The default is 0, so any communication failure results in a client failure. Oozie doesn't like that. If the RM is failing over and Oozie gets a communication failure, it assumes the target job has failed. I propose raising the default to something modest like 3 or 5. The default retry interval is 2s.

      1. MAPREDUCE-6776.003.patch
        6 kB
        Miklos Szegedi
      2. MAPREDUCE-6776.002.patch
        5 kB
        Miklos Szegedi
      3. MAPREDUCE-6776.001.patch
        4 kB
        Miklos Szegedi

        Activity

        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10570 (See https://builds.apache.org/job/Hadoop-trunk-Commit/10570/)
        MAPREDUCE-6776. yarn.app.mapreduce.client.job.max-retries should have a (rkanter: rev f3f37e6fb8172f6434e06eb9a137c0c155b3952e)

        • (edit) hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
        • (edit) hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java
        • (edit) hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/JobClientUnitTest.java
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10570 (See https://builds.apache.org/job/Hadoop-trunk-Commit/10570/ ) MAPREDUCE-6776 . yarn.app.mapreduce.client.job.max-retries should have a (rkanter: rev f3f37e6fb8172f6434e06eb9a137c0c155b3952e) (edit) hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml (edit) hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java (edit) hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/JobClientUnitTest.java
        Hide
        rkanter Robert Kanter added a comment -

        Thanks Miklos Szegedi and everyone. Committed to trunk and branch-2!

        Show
        rkanter Robert Kanter added a comment - Thanks Miklos Szegedi and everyone. Committed to trunk and branch-2!
        Hide
        kasha Karthik Kambatla added a comment -

        I think we should put this in branch-2, but mark it incompatible as Hitesh suggested.

        Show
        kasha Karthik Kambatla added a comment - I think we should put this in branch-2, but mark it incompatible as Hitesh suggested.
        Hide
        rkanter Robert Kanter added a comment -

        Vinod Kumar Vavilapalli, do you think we should change this in branch-2?

        Show
        rkanter Robert Kanter added a comment - Vinod Kumar Vavilapalli , do you think we should change this in branch-2?
        Hide
        hitesh Hitesh Shah added a comment -

        FWIW, I do agree that this is a useful behavioral change that makes sense to push to branch-2 but might be better to call it out as incompatible but at the same release note it carefully to indicate that it will improve user experience and not have any detrimental impact apart from the retry delay in some edge cases.

        Show
        hitesh Hitesh Shah added a comment - FWIW, I do agree that this is a useful behavioral change that makes sense to push to branch-2 but might be better to call it out as incompatible but at the same release note it carefully to indicate that it will improve user experience and not have any detrimental impact apart from the retry delay in some edge cases.
        Hide
        hitesh Hitesh Shah added a comment -

        From a practical sense, this is not really an incompatible change as there is some internal behavioral aspects that are being changed to retry 3 times instead of no retries.

        However, from a pure theoretical compat perspective, a public default value is being changed as well as the value in mapred-default.xml. Tests which might be earlier doing some verification would expect immediate failures whereas now it might be reconnect or fail after 6 seconds or so.

        I suggest pushing this to trunk for sure as we are still in the alpha stage of releases. As for branch-2, I would check with the 2.8 release manager.

        Show
        hitesh Hitesh Shah added a comment - From a practical sense, this is not really an incompatible change as there is some internal behavioral aspects that are being changed to retry 3 times instead of no retries. However, from a pure theoretical compat perspective, a public default value is being changed as well as the value in mapred-default.xml. Tests which might be earlier doing some verification would expect immediate failures whereas now it might be reconnect or fail after 6 seconds or so. I suggest pushing this to trunk for sure as we are still in the alpha stage of releases. As for branch-2, I would check with the 2.8 release manager.
        Hide
        rkanter Robert Kanter added a comment - - edited

        Ya, looks like YARN-5377 is for TestQueuingContainerManager, so that's not related.

        LGTM +1

        Hitesh Shah, are you sure this should count as an incompatible change? I know, it changes a default value, but it should be transparent to the caller (in fact, it should make things better).

        Show
        rkanter Robert Kanter added a comment - - edited Ya, looks like YARN-5377 is for TestQueuingContainerManager , so that's not related. LGTM +1 Hitesh Shah , are you sure this should count as an incompatible change? I know, it changes a default value, but it should be transparent to the caller (in fact, it should make things better).
        Hide
        haibochen Haibo Chen added a comment -

        The latest patch LGTM (non-binding)

        Show
        haibochen Haibo Chen added a comment - The latest patch LGTM (non-binding)
        Hide
        miklos.szegedi@cloudera.com Miklos Szegedi added a comment -

        The unit test failure must have been intermittent and unrelated. I verified locally and it works well. (org.apache.hadoop.yarn.server.nodemanager.containermanager.queuing.TestQueuingContainerManager)

        Show
        miklos.szegedi@cloudera.com Miklos Szegedi added a comment - The unit test failure must have been intermittent and unrelated. I verified locally and it works well. (org.apache.hadoop.yarn.server.nodemanager.containermanager.queuing.TestQueuingContainerManager)
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 15s Docker mode activated.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 2 new or modified test files.
        0 mvndep 0m 15s Maven dependency ordering for branch
        +1 mvninstall 7m 14s trunk passed
        +1 compile 7m 23s trunk passed
        +1 checkstyle 1m 34s trunk passed
        +1 mvnsite 1m 25s trunk passed
        +1 mvneclipse 0m 43s trunk passed
        +1 findbugs 1m 52s trunk passed
        +1 javadoc 0m 50s trunk passed
        0 mvndep 0m 13s Maven dependency ordering for patch
        +1 mvninstall 1m 6s the patch passed
        +1 compile 6m 44s the patch passed
        +1 javac 6m 44s the patch passed
        -1 checkstyle 1m 33s root: The patch generated 2 new + 548 unchanged - 3 fixed = 550 total (was 551)
        +1 mvnsite 1m 25s the patch passed
        +1 mvneclipse 0m 42s the patch passed
        +1 whitespace 0m 0s The patch has no whitespace issues.
        +1 xml 0m 1s The patch has no ill-formed XML file.
        +1 findbugs 2m 14s the patch passed
        +1 javadoc 0m 50s the patch passed
        -1 unit 15m 5s hadoop-yarn-server-nodemanager in the patch failed.
        +1 unit 2m 46s hadoop-mapreduce-client-core in the patch passed.
        +1 unit 116m 54s hadoop-mapreduce-client-jobclient in the patch passed.
        +1 asflicense 0m 33s The patch does not generate ASF License warnings.
        172m 36s



        Reason Tests
        Failed junit tests hadoop.yarn.server.nodemanager.containermanager.queuing.TestQueuingContainerManager



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:9560f25
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12830611/MAPREDUCE-6776.003.patch
        JIRA Issue MAPREDUCE-6776
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml
        uname Linux 1c2c93ce5a88 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / d144398
        Default Java 1.8.0_101
        findbugs v3.0.0
        checkstyle https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6744/artifact/patchprocess/diff-checkstyle-root.txt
        unit https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6744/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager.txt
        unit test logs https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6744/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager.txt
        Test Results https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6744/testReport/
        modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient U: .
        Console output https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6744/console
        Powered by Apache Yetus 0.3.0 http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 15s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 2 new or modified test files. 0 mvndep 0m 15s Maven dependency ordering for branch +1 mvninstall 7m 14s trunk passed +1 compile 7m 23s trunk passed +1 checkstyle 1m 34s trunk passed +1 mvnsite 1m 25s trunk passed +1 mvneclipse 0m 43s trunk passed +1 findbugs 1m 52s trunk passed +1 javadoc 0m 50s trunk passed 0 mvndep 0m 13s Maven dependency ordering for patch +1 mvninstall 1m 6s the patch passed +1 compile 6m 44s the patch passed +1 javac 6m 44s the patch passed -1 checkstyle 1m 33s root: The patch generated 2 new + 548 unchanged - 3 fixed = 550 total (was 551) +1 mvnsite 1m 25s the patch passed +1 mvneclipse 0m 42s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 xml 0m 1s The patch has no ill-formed XML file. +1 findbugs 2m 14s the patch passed +1 javadoc 0m 50s the patch passed -1 unit 15m 5s hadoop-yarn-server-nodemanager in the patch failed. +1 unit 2m 46s hadoop-mapreduce-client-core in the patch passed. +1 unit 116m 54s hadoop-mapreduce-client-jobclient in the patch passed. +1 asflicense 0m 33s The patch does not generate ASF License warnings. 172m 36s Reason Tests Failed junit tests hadoop.yarn.server.nodemanager.containermanager.queuing.TestQueuingContainerManager Subsystem Report/Notes Docker Image:yetus/hadoop:9560f25 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12830611/MAPREDUCE-6776.003.patch JIRA Issue MAPREDUCE-6776 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml uname Linux 1c2c93ce5a88 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / d144398 Default Java 1.8.0_101 findbugs v3.0.0 checkstyle https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6744/artifact/patchprocess/diff-checkstyle-root.txt unit https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6744/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager.txt unit test logs https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6744/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager.txt Test Results https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6744/testReport/ modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient U: . Console output https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6744/console Powered by Apache Yetus 0.3.0 http://yetus.apache.org This message was automatically generated.
        Hide
        miklos.szegedi@cloudera.com Miklos Szegedi added a comment -

        Fixed the requests in the comments.

        Show
        miklos.szegedi@cloudera.com Miklos Szegedi added a comment - Fixed the requests in the comments.
        Hide
        haibochen Haibo Chen added a comment -

        Thanks for the patch Miklos Szegedi.
        A few nits.
        1) bq. "If the resource manager is failing over and Oozie gets a communication failure, it assumes the target job has failed"
        This seems redundant given the next sentence describes the exact situation.
        2) In your new test testGetJobRetryDefault, you are referencing the default value of max retries as 3. I think it is better to reference it as MRJobConfig.DEFAULT_MR_CLIENT_JOB_MAX_RETRIES for both maintainability and readability purposes.

        Show
        haibochen Haibo Chen added a comment - Thanks for the patch Miklos Szegedi . A few nits. 1) bq. "If the resource manager is failing over and Oozie gets a communication failure, it assumes the target job has failed" This seems redundant given the next sentence describes the exact situation. 2) In your new test testGetJobRetryDefault, you are referencing the default value of max retries as 3. I think it is better to reference it as MRJobConfig.DEFAULT_MR_CLIENT_JOB_MAX_RETRIES for both maintainability and readability purposes.
        Hide
        miklos.szegedi@cloudera.com Miklos Szegedi added a comment -

        Checkstyle is expected public static final is added to all fields.

        Show
        miklos.szegedi@cloudera.com Miklos Szegedi added a comment - Checkstyle is expected public static final is added to all fields.
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 18s Docker mode activated.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
        0 mvndep 0m 8s Maven dependency ordering for branch
        +1 mvninstall 7m 0s trunk passed
        +1 compile 1m 37s trunk passed
        +1 checkstyle 0m 33s trunk passed
        +1 mvnsite 0m 58s trunk passed
        +1 mvneclipse 0m 29s trunk passed
        +1 findbugs 1m 12s trunk passed
        +1 javadoc 0m 33s trunk passed
        0 mvndep 0m 8s Maven dependency ordering for patch
        +1 mvninstall 0m 44s the patch passed
        +1 compile 1m 33s the patch passed
        +1 javac 1m 33s the patch passed
        -1 checkstyle 0m 31s hadoop-mapreduce-project/hadoop-mapreduce-client: The patch generated 1 new + 534 unchanged - 2 fixed = 535 total (was 536)
        +1 mvnsite 0m 54s the patch passed
        +1 mvneclipse 0m 25s the patch passed
        +1 whitespace 0m 0s The patch has no whitespace issues.
        +1 xml 0m 1s The patch has no ill-formed XML file.
        +1 findbugs 1m 22s the patch passed
        +1 javadoc 0m 29s the patch passed
        +1 unit 2m 29s hadoop-mapreduce-client-core in the patch passed.
        +1 unit 115m 53s hadoop-mapreduce-client-jobclient in the patch passed.
        +1 asflicense 0m 27s The patch does not generate ASF License warnings.
        138m 30s



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:9560f25
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12830378/MAPREDUCE-6776.002.patch
        JIRA Issue MAPREDUCE-6776
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml
        uname Linux 44292b35a214 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / 4815d02
        Default Java 1.8.0_101
        findbugs v3.0.0
        checkstyle https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6741/artifact/patchprocess/diff-checkstyle-hadoop-mapreduce-project_hadoop-mapreduce-client.txt
        Test Results https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6741/testReport/
        modules C: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient U: hadoop-mapreduce-project/hadoop-mapreduce-client
        Console output https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6741/console
        Powered by Apache Yetus 0.3.0 http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 18s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. 0 mvndep 0m 8s Maven dependency ordering for branch +1 mvninstall 7m 0s trunk passed +1 compile 1m 37s trunk passed +1 checkstyle 0m 33s trunk passed +1 mvnsite 0m 58s trunk passed +1 mvneclipse 0m 29s trunk passed +1 findbugs 1m 12s trunk passed +1 javadoc 0m 33s trunk passed 0 mvndep 0m 8s Maven dependency ordering for patch +1 mvninstall 0m 44s the patch passed +1 compile 1m 33s the patch passed +1 javac 1m 33s the patch passed -1 checkstyle 0m 31s hadoop-mapreduce-project/hadoop-mapreduce-client: The patch generated 1 new + 534 unchanged - 2 fixed = 535 total (was 536) +1 mvnsite 0m 54s the patch passed +1 mvneclipse 0m 25s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 xml 0m 1s The patch has no ill-formed XML file. +1 findbugs 1m 22s the patch passed +1 javadoc 0m 29s the patch passed +1 unit 2m 29s hadoop-mapreduce-client-core in the patch passed. +1 unit 115m 53s hadoop-mapreduce-client-jobclient in the patch passed. +1 asflicense 0m 27s The patch does not generate ASF License warnings. 138m 30s Subsystem Report/Notes Docker Image:yetus/hadoop:9560f25 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12830378/MAPREDUCE-6776.002.patch JIRA Issue MAPREDUCE-6776 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml uname Linux 44292b35a214 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 4815d02 Default Java 1.8.0_101 findbugs v3.0.0 checkstyle https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6741/artifact/patchprocess/diff-checkstyle-hadoop-mapreduce-project_hadoop-mapreduce-client.txt Test Results https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6741/testReport/ modules C: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient U: hadoop-mapreduce-project/hadoop-mapreduce-client Console output https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6741/console Powered by Apache Yetus 0.3.0 http://yetus.apache.org This message was automatically generated.
        Hide
        miklos.szegedi@cloudera.com Miklos Szegedi added a comment -

        Incorporated some style changes

        Show
        miklos.szegedi@cloudera.com Miklos Szegedi added a comment - Incorporated some style changes
        Hide
        miklos.szegedi@cloudera.com Miklos Szegedi added a comment -

        org.apache.hadoop.mapreduce.TestMRJobClient succeeds locally. This could be a setup issue on the build machine.

        Show
        miklos.szegedi@cloudera.com Miklos Szegedi added a comment - org.apache.hadoop.mapreduce.TestMRJobClient succeeds locally. This could be a setup issue on the build machine.
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 17s Docker mode activated.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
        0 mvndep 0m 25s Maven dependency ordering for branch
        +1 mvninstall 7m 54s trunk passed
        +1 compile 2m 14s trunk passed
        +1 checkstyle 0m 36s trunk passed
        +1 mvnsite 1m 13s trunk passed
        +1 mvneclipse 0m 32s trunk passed
        +1 findbugs 1m 21s trunk passed
        +1 javadoc 0m 37s trunk passed
        0 mvndep 0m 8s Maven dependency ordering for patch
        +1 mvninstall 0m 54s the patch passed
        +1 compile 1m 56s the patch passed
        +1 javac 1m 56s the patch passed
        -1 checkstyle 0m 36s hadoop-mapreduce-project/hadoop-mapreduce-client: The patch generated 2 new + 537 unchanged - 1 fixed = 539 total (was 538)
        +1 mvnsite 1m 10s the patch passed
        +1 mvneclipse 0m 29s the patch passed
        +1 whitespace 0m 0s The patch has no whitespace issues.
        +1 xml 0m 2s The patch has no ill-formed XML file.
        +1 findbugs 1m 58s the patch passed
        +1 javadoc 0m 39s the patch passed
        +1 unit 2m 44s hadoop-mapreduce-client-core in the patch passed.
        -1 unit 134m 58s hadoop-mapreduce-client-jobclient in the patch failed.
        +1 asflicense 0m 30s The patch does not generate ASF License warnings.
        162m 5s



        Reason Tests
        Failed junit tests hadoop.mapreduce.TestMRJobClient
        Timed out junit tests org.apache.hadoop.mapreduce.lib.jobcontrol.TestMapReduceJobControl



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:9560f25
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12829730/MAPREDUCE-6776.001.patch
        JIRA Issue MAPREDUCE-6776
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml
        uname Linux 7aeb26234083 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / 964e546
        Default Java 1.8.0_101
        findbugs v3.0.0
        checkstyle https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6732/artifact/patchprocess/diff-checkstyle-hadoop-mapreduce-project_hadoop-mapreduce-client.txt
        unit https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6732/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt
        unit test logs https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6732/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt
        Test Results https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6732/testReport/
        modules C: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient U: hadoop-mapreduce-project/hadoop-mapreduce-client
        Console output https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6732/console
        Powered by Apache Yetus 0.3.0 http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 17s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. 0 mvndep 0m 25s Maven dependency ordering for branch +1 mvninstall 7m 54s trunk passed +1 compile 2m 14s trunk passed +1 checkstyle 0m 36s trunk passed +1 mvnsite 1m 13s trunk passed +1 mvneclipse 0m 32s trunk passed +1 findbugs 1m 21s trunk passed +1 javadoc 0m 37s trunk passed 0 mvndep 0m 8s Maven dependency ordering for patch +1 mvninstall 0m 54s the patch passed +1 compile 1m 56s the patch passed +1 javac 1m 56s the patch passed -1 checkstyle 0m 36s hadoop-mapreduce-project/hadoop-mapreduce-client: The patch generated 2 new + 537 unchanged - 1 fixed = 539 total (was 538) +1 mvnsite 1m 10s the patch passed +1 mvneclipse 0m 29s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 xml 0m 2s The patch has no ill-formed XML file. +1 findbugs 1m 58s the patch passed +1 javadoc 0m 39s the patch passed +1 unit 2m 44s hadoop-mapreduce-client-core in the patch passed. -1 unit 134m 58s hadoop-mapreduce-client-jobclient in the patch failed. +1 asflicense 0m 30s The patch does not generate ASF License warnings. 162m 5s Reason Tests Failed junit tests hadoop.mapreduce.TestMRJobClient Timed out junit tests org.apache.hadoop.mapreduce.lib.jobcontrol.TestMapReduceJobControl Subsystem Report/Notes Docker Image:yetus/hadoop:9560f25 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12829730/MAPREDUCE-6776.001.patch JIRA Issue MAPREDUCE-6776 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml uname Linux 7aeb26234083 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 964e546 Default Java 1.8.0_101 findbugs v3.0.0 checkstyle https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6732/artifact/patchprocess/diff-checkstyle-hadoop-mapreduce-project_hadoop-mapreduce-client.txt unit https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6732/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt unit test logs https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6732/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt Test Results https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6732/testReport/ modules C: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient U: hadoop-mapreduce-project/hadoop-mapreduce-client Console output https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6732/console Powered by Apache Yetus 0.3.0 http://yetus.apache.org This message was automatically generated.
        Hide
        miklos.szegedi@cloudera.com Miklos Szegedi added a comment -

        Set a default retry count of 3.

        Show
        miklos.szegedi@cloudera.com Miklos Szegedi added a comment - Set a default retry count of 3.
        Hide
        hitesh Hitesh Shah added a comment -

        Changing this in 2.x would be an incompatible change.

        Show
        hitesh Hitesh Shah added a comment - Changing this in 2.x would be an incompatible change.

          People

          • Assignee:
            miklos.szegedi@cloudera.com Miklos Szegedi
            Reporter:
            templedf Daniel Templeton
          • Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development