Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-4496

Improve HA ResourceManager Failover detection on the client

    Details

      Description

      HDFS deployments can currently use the RequestHedgingProxyProvider to improve Namenode failover detection in the client. It does this by concurrently trying all namenodes and picks the namenode that returns the fastest with a successful response as the active node.

      It would be useful to have a similar ProxyProvider for the Yarn RM (it can possibly be done by converging some the class hierarchies to use the same ProxyProvider)

      This would especially be useful for large YARN deployments with multiple standby RMs where clients will be able to pick the active RM without having to traverse a list of configured RMs.

      1. YARN-4496.6.patch
        22 kB
        Jian He
      2. YARN-4496.5.patch
        22 kB
        Jian He
      3. YARN-4496.4.patch
        22 kB
        Jian He
      4. YARN-4496.3.patch
        23 kB
        Jian He
      5. YARN-4496.2.patch
        23 kB
        Jian He
      6. YARN-4496.1.patch
        23 kB
        Jian He

        Issue Links

          Activity

          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-trunk-Commit #9172 (See https://builds.apache.org/job/Hadoop-trunk-Commit/9172/)
          YARN-4496. Improve HA ResourceManager Failover detection on the client. (xgong: rev 618bfd6ac2a5b62d39e9bed80f75362bafc0ef28)

          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-tests/src/test/java/org/apache/hadoop/yarn/server/MiniYARNCluster.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/TestNodeStatusUpdater.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/client/ConfiguredRMFailoverProxyProvider.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/client/RequestHedgingRMFailoverProxyProvider.java
          • hadoop-yarn-project/CHANGES.txt
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/TestHedgingRequestRMFailoverProxyProvider.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/client/RMProxy.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-trunk-Commit #9172 (See https://builds.apache.org/job/Hadoop-trunk-Commit/9172/ ) YARN-4496 . Improve HA ResourceManager Failover detection on the client. (xgong: rev 618bfd6ac2a5b62d39e9bed80f75362bafc0ef28) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-tests/src/test/java/org/apache/hadoop/yarn/server/MiniYARNCluster.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/TestNodeStatusUpdater.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/client/ConfiguredRMFailoverProxyProvider.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/client/RequestHedgingRMFailoverProxyProvider.java hadoop-yarn-project/CHANGES.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/TestHedgingRequestRMFailoverProxyProvider.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/client/RMProxy.java
          Hide
          xgong Xuan Gong added a comment -

          Committed into trunk/branch-2. Thanks, Jian for working on this. And Thanks, Arun for the review.

          Show
          xgong Xuan Gong added a comment - Committed into trunk/branch-2. Thanks, Jian for working on this. And Thanks, Arun for the review.
          Hide
          xgong Xuan Gong added a comment -

          +1 lgtm. Checking this in

          Show
          xgong Xuan Gong added a comment - +1 lgtm. Checking this in
          Hide
          jianhe Jian He added a comment -

          test failures are not related

          Show
          jianhe Jian He added a comment - test failures are not related
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 0s Docker mode activated.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 3 new or modified test files.
          0 mvndep 0m 45s Maven dependency ordering for branch
          +1 mvninstall 8m 15s trunk passed
          +1 compile 2m 9s trunk passed with JDK v1.8.0_66
          +1 compile 2m 25s trunk passed with JDK v1.7.0_91
          +1 checkstyle 0m 31s trunk passed
          +1 mvnsite 1m 52s trunk passed
          +1 mvneclipse 0m 54s trunk passed
          +1 findbugs 3m 31s trunk passed
          +1 javadoc 1m 20s trunk passed with JDK v1.8.0_66
          +1 javadoc 1m 34s trunk passed with JDK v1.7.0_91
          0 mvndep 0m 35s Maven dependency ordering for patch
          +1 mvninstall 1m 35s the patch passed
          +1 compile 2m 8s the patch passed with JDK v1.8.0_66
          +1 javac 2m 8s the patch passed
          +1 compile 2m 25s the patch passed with JDK v1.7.0_91
          +1 javac 2m 25s the patch passed
          -1 checkstyle 0m 32s hadoop-yarn-project/hadoop-yarn: patch generated 3 new + 11 unchanged - 0 fixed = 14 total (was 11)
          +1 mvnsite 1m 50s the patch passed
          +1 mvneclipse 0m 51s the patch passed
          +1 whitespace 0m 0s Patch has no whitespace issues.
          +1 findbugs 4m 12s the patch passed
          +1 javadoc 1m 15s the patch passed with JDK v1.8.0_66
          +1 javadoc 1m 24s the patch passed with JDK v1.7.0_91
          +1 unit 2m 3s hadoop-yarn-common in the patch passed with JDK v1.8.0_66.
          -1 unit 8m 45s hadoop-yarn-server-nodemanager in the patch failed with JDK v1.8.0_66.
          -1 unit 6m 38s hadoop-yarn-server-tests in the patch failed with JDK v1.8.0_66.
          -1 unit 64m 38s hadoop-yarn-client in the patch failed with JDK v1.8.0_66.
          +1 unit 2m 9s hadoop-yarn-common in the patch passed with JDK v1.7.0_91.
          -1 unit 8m 56s hadoop-yarn-server-nodemanager in the patch failed with JDK v1.7.0_91.
          -1 unit 6m 42s hadoop-yarn-server-tests in the patch failed with JDK v1.7.0_91.
          -1 unit 64m 40s hadoop-yarn-client in the patch failed with JDK v1.7.0_91.
          +1 asflicense 0m 20s Patch does not generate ASF License warnings.
          206m 43s



          Reason Tests
          JDK v1.8.0_66 Failed junit tests hadoop.yarn.server.TestMiniYarnClusterNodeUtilization
            hadoop.yarn.server.TestContainerManagerSecurity
            hadoop.yarn.client.TestGetGroups
          JDK v1.8.0_66 Timed out junit tests org.apache.hadoop.yarn.client.cli.TestYarnCLI
            org.apache.hadoop.yarn.client.api.impl.TestAMRMClient
            org.apache.hadoop.yarn.client.api.impl.TestYarnClient
            org.apache.hadoop.yarn.client.api.impl.TestNMClient
          JDK v1.7.0_91 Failed junit tests hadoop.yarn.server.TestMiniYarnClusterNodeUtilization
            hadoop.yarn.server.TestContainerManagerSecurity
            hadoop.yarn.client.TestGetGroups
          JDK v1.7.0_91 Timed out junit tests org.apache.hadoop.yarn.client.cli.TestYarnCLI
            org.apache.hadoop.yarn.client.api.impl.TestAMRMClient
            org.apache.hadoop.yarn.client.api.impl.TestYarnClient
            org.apache.hadoop.yarn.client.api.impl.TestNMClient



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:0ca8df7
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12783711/YARN-4496.6.patch
          JIRA Issue YARN-4496
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
          uname Linux c6ab7104ad25 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision trunk / f3427d3
          Default Java 1.7.0_91
          Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_66 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_91
          findbugs v3.0.0
          checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/10362/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/10362/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager-jdk1.8.0_66.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/10362/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests-jdk1.8.0_66.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/10362/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client-jdk1.8.0_66.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/10362/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager-jdk1.7.0_91.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/10362/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests-jdk1.7.0_91.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/10362/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client-jdk1.7.0_91.txt
          unit test logs https://builds.apache.org/job/PreCommit-YARN-Build/10362/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests-jdk1.8.0_66.txt https://builds.apache.org/job/PreCommit-YARN-Build/10362/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client-jdk1.8.0_66.txt https://builds.apache.org/job/PreCommit-YARN-Build/10362/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests-jdk1.7.0_91.txt https://builds.apache.org/job/PreCommit-YARN-Build/10362/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client-jdk1.7.0_91.txt
          JDK v1.7.0_91 Test Results https://builds.apache.org/job/PreCommit-YARN-Build/10362/testReport/
          modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-tests hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client U: hadoop-yarn-project/hadoop-yarn
          Max memory used 76MB
          Powered by Apache Yetus 0.2.0-SNAPSHOT http://yetus.apache.org
          Console output https://builds.apache.org/job/PreCommit-YARN-Build/10362/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 0s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 3 new or modified test files. 0 mvndep 0m 45s Maven dependency ordering for branch +1 mvninstall 8m 15s trunk passed +1 compile 2m 9s trunk passed with JDK v1.8.0_66 +1 compile 2m 25s trunk passed with JDK v1.7.0_91 +1 checkstyle 0m 31s trunk passed +1 mvnsite 1m 52s trunk passed +1 mvneclipse 0m 54s trunk passed +1 findbugs 3m 31s trunk passed +1 javadoc 1m 20s trunk passed with JDK v1.8.0_66 +1 javadoc 1m 34s trunk passed with JDK v1.7.0_91 0 mvndep 0m 35s Maven dependency ordering for patch +1 mvninstall 1m 35s the patch passed +1 compile 2m 8s the patch passed with JDK v1.8.0_66 +1 javac 2m 8s the patch passed +1 compile 2m 25s the patch passed with JDK v1.7.0_91 +1 javac 2m 25s the patch passed -1 checkstyle 0m 32s hadoop-yarn-project/hadoop-yarn: patch generated 3 new + 11 unchanged - 0 fixed = 14 total (was 11) +1 mvnsite 1m 50s the patch passed +1 mvneclipse 0m 51s the patch passed +1 whitespace 0m 0s Patch has no whitespace issues. +1 findbugs 4m 12s the patch passed +1 javadoc 1m 15s the patch passed with JDK v1.8.0_66 +1 javadoc 1m 24s the patch passed with JDK v1.7.0_91 +1 unit 2m 3s hadoop-yarn-common in the patch passed with JDK v1.8.0_66. -1 unit 8m 45s hadoop-yarn-server-nodemanager in the patch failed with JDK v1.8.0_66. -1 unit 6m 38s hadoop-yarn-server-tests in the patch failed with JDK v1.8.0_66. -1 unit 64m 38s hadoop-yarn-client in the patch failed with JDK v1.8.0_66. +1 unit 2m 9s hadoop-yarn-common in the patch passed with JDK v1.7.0_91. -1 unit 8m 56s hadoop-yarn-server-nodemanager in the patch failed with JDK v1.7.0_91. -1 unit 6m 42s hadoop-yarn-server-tests in the patch failed with JDK v1.7.0_91. -1 unit 64m 40s hadoop-yarn-client in the patch failed with JDK v1.7.0_91. +1 asflicense 0m 20s Patch does not generate ASF License warnings. 206m 43s Reason Tests JDK v1.8.0_66 Failed junit tests hadoop.yarn.server.TestMiniYarnClusterNodeUtilization   hadoop.yarn.server.TestContainerManagerSecurity   hadoop.yarn.client.TestGetGroups JDK v1.8.0_66 Timed out junit tests org.apache.hadoop.yarn.client.cli.TestYarnCLI   org.apache.hadoop.yarn.client.api.impl.TestAMRMClient   org.apache.hadoop.yarn.client.api.impl.TestYarnClient   org.apache.hadoop.yarn.client.api.impl.TestNMClient JDK v1.7.0_91 Failed junit tests hadoop.yarn.server.TestMiniYarnClusterNodeUtilization   hadoop.yarn.server.TestContainerManagerSecurity   hadoop.yarn.client.TestGetGroups JDK v1.7.0_91 Timed out junit tests org.apache.hadoop.yarn.client.cli.TestYarnCLI   org.apache.hadoop.yarn.client.api.impl.TestAMRMClient   org.apache.hadoop.yarn.client.api.impl.TestYarnClient   org.apache.hadoop.yarn.client.api.impl.TestNMClient Subsystem Report/Notes Docker Image:yetus/hadoop:0ca8df7 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12783711/YARN-4496.6.patch JIRA Issue YARN-4496 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux c6ab7104ad25 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / f3427d3 Default Java 1.7.0_91 Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_66 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_91 findbugs v3.0.0 checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/10362/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/10362/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager-jdk1.8.0_66.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/10362/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests-jdk1.8.0_66.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/10362/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client-jdk1.8.0_66.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/10362/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager-jdk1.7.0_91.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/10362/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests-jdk1.7.0_91.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/10362/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client-jdk1.7.0_91.txt unit test logs https://builds.apache.org/job/PreCommit-YARN-Build/10362/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests-jdk1.8.0_66.txt https://builds.apache.org/job/PreCommit-YARN-Build/10362/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client-jdk1.8.0_66.txt https://builds.apache.org/job/PreCommit-YARN-Build/10362/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests-jdk1.7.0_91.txt https://builds.apache.org/job/PreCommit-YARN-Build/10362/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client-jdk1.7.0_91.txt JDK v1.7.0_91 Test Results https://builds.apache.org/job/PreCommit-YARN-Build/10362/testReport/ modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-tests hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client U: hadoop-yarn-project/hadoop-yarn Max memory used 76MB Powered by Apache Yetus 0.2.0-SNAPSHOT http://yetus.apache.org Console output https://builds.apache.org/job/PreCommit-YARN-Build/10362/console This message was automatically generated.
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 0s Docker mode activated.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 3 new or modified test files.
          0 mvndep 0m 48s Maven dependency ordering for branch
          +1 mvninstall 7m 47s trunk passed
          +1 compile 1m 56s trunk passed with JDK v1.8.0_66
          +1 compile 2m 8s trunk passed with JDK v1.7.0_91
          +1 checkstyle 0m 28s trunk passed
          +1 mvnsite 1m 44s trunk passed
          +1 mvneclipse 0m 53s trunk passed
          +1 findbugs 3m 11s trunk passed
          +1 javadoc 1m 12s trunk passed with JDK v1.8.0_66
          +1 javadoc 1m 27s trunk passed with JDK v1.7.0_91
          0 mvndep 0m 33s Maven dependency ordering for patch
          +1 mvninstall 1m 23s the patch passed
          +1 compile 1m 41s the patch passed with JDK v1.8.0_66
          -1 javac 3m 37s hadoop-yarn-project_hadoop-yarn-jdk1.8.0_66 with JDK v1.8.0_66 generated 1 new + 9 unchanged - 0 fixed = 10 total (was 9)
          +1 javac 1m 41s the patch passed
          +1 compile 2m 2s the patch passed with JDK v1.7.0_91
          -1 javac 5m 39s hadoop-yarn-project_hadoop-yarn-jdk1.7.0_91 with JDK v1.7.0_91 generated 1 new + 10 unchanged - 0 fixed = 11 total (was 10)
          +1 javac 2m 2s the patch passed
          -1 checkstyle 0m 26s hadoop-yarn-project/hadoop-yarn: patch generated 3 new + 11 unchanged - 0 fixed = 14 total (was 11)
          +1 mvnsite 1m 36s the patch passed
          +1 mvneclipse 0m 45s the patch passed
          +1 whitespace 0m 0s Patch has no whitespace issues.
          +1 findbugs 3m 51s the patch passed
          +1 javadoc 1m 4s the patch passed with JDK v1.8.0_66
          +1 javadoc 1m 20s the patch passed with JDK v1.7.0_91
          +1 unit 1m 50s hadoop-yarn-common in the patch passed with JDK v1.8.0_66.
          -1 unit 8m 21s hadoop-yarn-server-nodemanager in the patch failed with JDK v1.8.0_66.
          -1 unit 6m 36s hadoop-yarn-server-tests in the patch failed with JDK v1.8.0_66.
          -1 unit 64m 30s hadoop-yarn-client in the patch failed with JDK v1.8.0_66.
          +1 unit 2m 6s hadoop-yarn-common in the patch passed with JDK v1.7.0_91.
          -1 unit 8m 55s hadoop-yarn-server-nodemanager in the patch failed with JDK v1.7.0_91.
          -1 unit 6m 40s hadoop-yarn-server-tests in the patch failed with JDK v1.7.0_91.
          -1 unit 64m 41s hadoop-yarn-client in the patch failed with JDK v1.7.0_91.
          +1 asflicense 0m 19s Patch does not generate ASF License warnings.
          201m 54s



          Reason Tests
          JDK v1.8.0_66 Failed junit tests hadoop.yarn.server.TestMiniYarnClusterNodeUtilization
            hadoop.yarn.server.TestContainerManagerSecurity
            hadoop.yarn.client.TestGetGroups
          JDK v1.8.0_66 Timed out junit tests org.apache.hadoop.yarn.client.cli.TestYarnCLI
            org.apache.hadoop.yarn.client.api.impl.TestYarnClient
            org.apache.hadoop.yarn.client.api.impl.TestAMRMClient
            org.apache.hadoop.yarn.client.api.impl.TestNMClient
          JDK v1.7.0_91 Failed junit tests hadoop.yarn.server.TestMiniYarnClusterNodeUtilization
            hadoop.yarn.server.TestContainerManagerSecurity
            hadoop.yarn.client.TestGetGroups
          JDK v1.7.0_91 Timed out junit tests org.apache.hadoop.yarn.client.cli.TestYarnCLI
            org.apache.hadoop.yarn.client.api.impl.TestYarnClient
            org.apache.hadoop.yarn.client.api.impl.TestAMRMClient
            org.apache.hadoop.yarn.client.api.impl.TestNMClient



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:0ca8df7
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12783632/YARN-4496.5.patch
          JIRA Issue YARN-4496
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
          uname Linux b111e0b32701 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision trunk / c304890
          Default Java 1.7.0_91
          Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_66 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_91
          findbugs v3.0.0
          javac hadoop-yarn-project_hadoop-yarn-jdk1.8.0_66: https://builds.apache.org/job/PreCommit-YARN-Build/10360/artifact/patchprocess/diff-compile-javac-hadoop-yarn-project_hadoop-yarn-jdk1.8.0_66.txt
          javac hadoop-yarn-project_hadoop-yarn-jdk1.7.0_91: https://builds.apache.org/job/PreCommit-YARN-Build/10360/artifact/patchprocess/diff-compile-javac-hadoop-yarn-project_hadoop-yarn-jdk1.7.0_91.txt
          checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/10360/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/10360/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager-jdk1.8.0_66.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/10360/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests-jdk1.8.0_66.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/10360/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client-jdk1.8.0_66.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/10360/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager-jdk1.7.0_91.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/10360/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests-jdk1.7.0_91.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/10360/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client-jdk1.7.0_91.txt
          unit test logs https://builds.apache.org/job/PreCommit-YARN-Build/10360/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests-jdk1.8.0_66.txt https://builds.apache.org/job/PreCommit-YARN-Build/10360/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client-jdk1.8.0_66.txt https://builds.apache.org/job/PreCommit-YARN-Build/10360/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests-jdk1.7.0_91.txt https://builds.apache.org/job/PreCommit-YARN-Build/10360/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client-jdk1.7.0_91.txt
          JDK v1.7.0_91 Test Results https://builds.apache.org/job/PreCommit-YARN-Build/10360/testReport/
          modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-tests hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client U: hadoop-yarn-project/hadoop-yarn
          Max memory used 77MB
          Powered by Apache Yetus 0.2.0-SNAPSHOT http://yetus.apache.org
          Console output https://builds.apache.org/job/PreCommit-YARN-Build/10360/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 0s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 3 new or modified test files. 0 mvndep 0m 48s Maven dependency ordering for branch +1 mvninstall 7m 47s trunk passed +1 compile 1m 56s trunk passed with JDK v1.8.0_66 +1 compile 2m 8s trunk passed with JDK v1.7.0_91 +1 checkstyle 0m 28s trunk passed +1 mvnsite 1m 44s trunk passed +1 mvneclipse 0m 53s trunk passed +1 findbugs 3m 11s trunk passed +1 javadoc 1m 12s trunk passed with JDK v1.8.0_66 +1 javadoc 1m 27s trunk passed with JDK v1.7.0_91 0 mvndep 0m 33s Maven dependency ordering for patch +1 mvninstall 1m 23s the patch passed +1 compile 1m 41s the patch passed with JDK v1.8.0_66 -1 javac 3m 37s hadoop-yarn-project_hadoop-yarn-jdk1.8.0_66 with JDK v1.8.0_66 generated 1 new + 9 unchanged - 0 fixed = 10 total (was 9) +1 javac 1m 41s the patch passed +1 compile 2m 2s the patch passed with JDK v1.7.0_91 -1 javac 5m 39s hadoop-yarn-project_hadoop-yarn-jdk1.7.0_91 with JDK v1.7.0_91 generated 1 new + 10 unchanged - 0 fixed = 11 total (was 10) +1 javac 2m 2s the patch passed -1 checkstyle 0m 26s hadoop-yarn-project/hadoop-yarn: patch generated 3 new + 11 unchanged - 0 fixed = 14 total (was 11) +1 mvnsite 1m 36s the patch passed +1 mvneclipse 0m 45s the patch passed +1 whitespace 0m 0s Patch has no whitespace issues. +1 findbugs 3m 51s the patch passed +1 javadoc 1m 4s the patch passed with JDK v1.8.0_66 +1 javadoc 1m 20s the patch passed with JDK v1.7.0_91 +1 unit 1m 50s hadoop-yarn-common in the patch passed with JDK v1.8.0_66. -1 unit 8m 21s hadoop-yarn-server-nodemanager in the patch failed with JDK v1.8.0_66. -1 unit 6m 36s hadoop-yarn-server-tests in the patch failed with JDK v1.8.0_66. -1 unit 64m 30s hadoop-yarn-client in the patch failed with JDK v1.8.0_66. +1 unit 2m 6s hadoop-yarn-common in the patch passed with JDK v1.7.0_91. -1 unit 8m 55s hadoop-yarn-server-nodemanager in the patch failed with JDK v1.7.0_91. -1 unit 6m 40s hadoop-yarn-server-tests in the patch failed with JDK v1.7.0_91. -1 unit 64m 41s hadoop-yarn-client in the patch failed with JDK v1.7.0_91. +1 asflicense 0m 19s Patch does not generate ASF License warnings. 201m 54s Reason Tests JDK v1.8.0_66 Failed junit tests hadoop.yarn.server.TestMiniYarnClusterNodeUtilization   hadoop.yarn.server.TestContainerManagerSecurity   hadoop.yarn.client.TestGetGroups JDK v1.8.0_66 Timed out junit tests org.apache.hadoop.yarn.client.cli.TestYarnCLI   org.apache.hadoop.yarn.client.api.impl.TestYarnClient   org.apache.hadoop.yarn.client.api.impl.TestAMRMClient   org.apache.hadoop.yarn.client.api.impl.TestNMClient JDK v1.7.0_91 Failed junit tests hadoop.yarn.server.TestMiniYarnClusterNodeUtilization   hadoop.yarn.server.TestContainerManagerSecurity   hadoop.yarn.client.TestGetGroups JDK v1.7.0_91 Timed out junit tests org.apache.hadoop.yarn.client.cli.TestYarnCLI   org.apache.hadoop.yarn.client.api.impl.TestYarnClient   org.apache.hadoop.yarn.client.api.impl.TestAMRMClient   org.apache.hadoop.yarn.client.api.impl.TestNMClient Subsystem Report/Notes Docker Image:yetus/hadoop:0ca8df7 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12783632/YARN-4496.5.patch JIRA Issue YARN-4496 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux b111e0b32701 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / c304890 Default Java 1.7.0_91 Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_66 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_91 findbugs v3.0.0 javac hadoop-yarn-project_hadoop-yarn-jdk1.8.0_66: https://builds.apache.org/job/PreCommit-YARN-Build/10360/artifact/patchprocess/diff-compile-javac-hadoop-yarn-project_hadoop-yarn-jdk1.8.0_66.txt javac hadoop-yarn-project_hadoop-yarn-jdk1.7.0_91: https://builds.apache.org/job/PreCommit-YARN-Build/10360/artifact/patchprocess/diff-compile-javac-hadoop-yarn-project_hadoop-yarn-jdk1.7.0_91.txt checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/10360/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/10360/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager-jdk1.8.0_66.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/10360/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests-jdk1.8.0_66.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/10360/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client-jdk1.8.0_66.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/10360/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager-jdk1.7.0_91.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/10360/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests-jdk1.7.0_91.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/10360/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client-jdk1.7.0_91.txt unit test logs https://builds.apache.org/job/PreCommit-YARN-Build/10360/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests-jdk1.8.0_66.txt https://builds.apache.org/job/PreCommit-YARN-Build/10360/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client-jdk1.8.0_66.txt https://builds.apache.org/job/PreCommit-YARN-Build/10360/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests-jdk1.7.0_91.txt https://builds.apache.org/job/PreCommit-YARN-Build/10360/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client-jdk1.7.0_91.txt JDK v1.7.0_91 Test Results https://builds.apache.org/job/PreCommit-YARN-Build/10360/testReport/ modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-tests hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client U: hadoop-yarn-project/hadoop-yarn Max memory used 77MB Powered by Apache Yetus 0.2.0-SNAPSHOT http://yetus.apache.org Console output https://builds.apache.org/job/PreCommit-YARN-Build/10360/console This message was automatically generated.
          Hide
          jianhe Jian He added a comment -

          Fixed the javac warnings, the test failures are not related.
          Fixed the checkstyles that are worthy to be fixed.

          Show
          jianhe Jian He added a comment - Fixed the javac warnings, the test failures are not related. Fixed the checkstyles that are worthy to be fixed.
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 0s Docker mode activated.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 3 new or modified test files.
          0 mvndep 0m 59s Maven dependency ordering for branch
          +1 mvninstall 7m 39s trunk passed
          +1 compile 1m 47s trunk passed with JDK v1.8.0_66
          +1 compile 2m 7s trunk passed with JDK v1.7.0_91
          +1 checkstyle 0m 27s trunk passed
          +1 mvnsite 1m 47s trunk passed
          +1 mvneclipse 0m 52s trunk passed
          +1 findbugs 3m 15s trunk passed
          +1 javadoc 1m 11s trunk passed with JDK v1.8.0_66
          +1 javadoc 1m 28s trunk passed with JDK v1.7.0_91
          0 mvndep 0m 33s Maven dependency ordering for patch
          +1 mvninstall 1m 24s the patch passed
          +1 compile 1m 45s the patch passed with JDK v1.8.0_66
          -1 javac 3m 43s hadoop-yarn-project_hadoop-yarn-jdk1.8.0_66 with JDK v1.8.0_66 generated 1 new + 9 unchanged - 0 fixed = 10 total (was 9)
          +1 javac 1m 45s the patch passed
          +1 compile 2m 4s the patch passed with JDK v1.7.0_91
          -1 javac 5m 48s hadoop-yarn-project_hadoop-yarn-jdk1.7.0_91 with JDK v1.7.0_91 generated 1 new + 10 unchanged - 0 fixed = 11 total (was 10)
          +1 javac 2m 4s the patch passed
          -1 checkstyle 0m 27s hadoop-yarn-project/hadoop-yarn: patch generated 3 new + 11 unchanged - 0 fixed = 14 total (was 11)
          +1 mvnsite 1m 38s the patch passed
          +1 mvneclipse 0m 47s the patch passed
          +1 whitespace 0m 0s Patch has no whitespace issues.
          +1 findbugs 3m 56s the patch passed
          +1 javadoc 1m 6s the patch passed with JDK v1.8.0_66
          +1 javadoc 1m 21s the patch passed with JDK v1.7.0_91
          +1 unit 1m 53s hadoop-yarn-common in the patch passed with JDK v1.8.0_66.
          -1 unit 8m 33s hadoop-yarn-server-nodemanager in the patch failed with JDK v1.8.0_66.
          -1 unit 6m 36s hadoop-yarn-server-tests in the patch failed with JDK v1.8.0_66.
          -1 unit 64m 27s hadoop-yarn-client in the patch failed with JDK v1.8.0_66.
          +1 unit 2m 11s hadoop-yarn-common in the patch passed with JDK v1.7.0_91.
          -1 unit 8m 57s hadoop-yarn-server-nodemanager in the patch failed with JDK v1.7.0_91.
          -1 unit 6m 40s hadoop-yarn-server-tests in the patch failed with JDK v1.7.0_91.
          -1 unit 64m 41s hadoop-yarn-client in the patch failed with JDK v1.7.0_91.
          +1 asflicense 0m 19s Patch does not generate ASF License warnings.
          202m 30s



          Reason Tests
          JDK v1.8.0_66 Failed junit tests hadoop.yarn.server.TestMiniYarnClusterNodeUtilization
            hadoop.yarn.server.TestContainerManagerSecurity
            hadoop.yarn.client.TestGetGroups
          JDK v1.8.0_66 Timed out junit tests org.apache.hadoop.yarn.client.cli.TestYarnCLI
            org.apache.hadoop.yarn.client.api.impl.TestAMRMClient
            org.apache.hadoop.yarn.client.api.impl.TestYarnClient
            org.apache.hadoop.yarn.client.api.impl.TestNMClient
          JDK v1.7.0_91 Failed junit tests hadoop.yarn.server.TestMiniYarnClusterNodeUtilization
            hadoop.yarn.server.TestContainerManagerSecurity
            hadoop.yarn.client.TestGetGroups
          JDK v1.7.0_91 Timed out junit tests org.apache.hadoop.yarn.client.cli.TestYarnCLI
            org.apache.hadoop.yarn.client.api.impl.TestAMRMClient
            org.apache.hadoop.yarn.client.api.impl.TestYarnClient
            org.apache.hadoop.yarn.client.api.impl.TestNMClient



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:0ca8df7
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12783472/YARN-4496.4.patch
          JIRA Issue YARN-4496
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
          uname Linux 3afd8771a947 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision trunk / 5ff5f67
          Default Java 1.7.0_91
          Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_66 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_91
          findbugs v3.0.0
          javac hadoop-yarn-project_hadoop-yarn-jdk1.8.0_66: https://builds.apache.org/job/PreCommit-YARN-Build/10351/artifact/patchprocess/diff-compile-javac-hadoop-yarn-project_hadoop-yarn-jdk1.8.0_66.txt
          javac hadoop-yarn-project_hadoop-yarn-jdk1.7.0_91: https://builds.apache.org/job/PreCommit-YARN-Build/10351/artifact/patchprocess/diff-compile-javac-hadoop-yarn-project_hadoop-yarn-jdk1.7.0_91.txt
          checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/10351/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/10351/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager-jdk1.8.0_66.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/10351/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests-jdk1.8.0_66.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/10351/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client-jdk1.8.0_66.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/10351/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager-jdk1.7.0_91.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/10351/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests-jdk1.7.0_91.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/10351/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client-jdk1.7.0_91.txt
          unit test logs https://builds.apache.org/job/PreCommit-YARN-Build/10351/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests-jdk1.8.0_66.txt https://builds.apache.org/job/PreCommit-YARN-Build/10351/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client-jdk1.8.0_66.txt https://builds.apache.org/job/PreCommit-YARN-Build/10351/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests-jdk1.7.0_91.txt https://builds.apache.org/job/PreCommit-YARN-Build/10351/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client-jdk1.7.0_91.txt
          JDK v1.7.0_91 Test Results https://builds.apache.org/job/PreCommit-YARN-Build/10351/testReport/
          modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-tests hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client U: hadoop-yarn-project/hadoop-yarn
          Max memory used 77MB
          Powered by Apache Yetus 0.2.0-SNAPSHOT http://yetus.apache.org
          Console output https://builds.apache.org/job/PreCommit-YARN-Build/10351/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 0s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 3 new or modified test files. 0 mvndep 0m 59s Maven dependency ordering for branch +1 mvninstall 7m 39s trunk passed +1 compile 1m 47s trunk passed with JDK v1.8.0_66 +1 compile 2m 7s trunk passed with JDK v1.7.0_91 +1 checkstyle 0m 27s trunk passed +1 mvnsite 1m 47s trunk passed +1 mvneclipse 0m 52s trunk passed +1 findbugs 3m 15s trunk passed +1 javadoc 1m 11s trunk passed with JDK v1.8.0_66 +1 javadoc 1m 28s trunk passed with JDK v1.7.0_91 0 mvndep 0m 33s Maven dependency ordering for patch +1 mvninstall 1m 24s the patch passed +1 compile 1m 45s the patch passed with JDK v1.8.0_66 -1 javac 3m 43s hadoop-yarn-project_hadoop-yarn-jdk1.8.0_66 with JDK v1.8.0_66 generated 1 new + 9 unchanged - 0 fixed = 10 total (was 9) +1 javac 1m 45s the patch passed +1 compile 2m 4s the patch passed with JDK v1.7.0_91 -1 javac 5m 48s hadoop-yarn-project_hadoop-yarn-jdk1.7.0_91 with JDK v1.7.0_91 generated 1 new + 10 unchanged - 0 fixed = 11 total (was 10) +1 javac 2m 4s the patch passed -1 checkstyle 0m 27s hadoop-yarn-project/hadoop-yarn: patch generated 3 new + 11 unchanged - 0 fixed = 14 total (was 11) +1 mvnsite 1m 38s the patch passed +1 mvneclipse 0m 47s the patch passed +1 whitespace 0m 0s Patch has no whitespace issues. +1 findbugs 3m 56s the patch passed +1 javadoc 1m 6s the patch passed with JDK v1.8.0_66 +1 javadoc 1m 21s the patch passed with JDK v1.7.0_91 +1 unit 1m 53s hadoop-yarn-common in the patch passed with JDK v1.8.0_66. -1 unit 8m 33s hadoop-yarn-server-nodemanager in the patch failed with JDK v1.8.0_66. -1 unit 6m 36s hadoop-yarn-server-tests in the patch failed with JDK v1.8.0_66. -1 unit 64m 27s hadoop-yarn-client in the patch failed with JDK v1.8.0_66. +1 unit 2m 11s hadoop-yarn-common in the patch passed with JDK v1.7.0_91. -1 unit 8m 57s hadoop-yarn-server-nodemanager in the patch failed with JDK v1.7.0_91. -1 unit 6m 40s hadoop-yarn-server-tests in the patch failed with JDK v1.7.0_91. -1 unit 64m 41s hadoop-yarn-client in the patch failed with JDK v1.7.0_91. +1 asflicense 0m 19s Patch does not generate ASF License warnings. 202m 30s Reason Tests JDK v1.8.0_66 Failed junit tests hadoop.yarn.server.TestMiniYarnClusterNodeUtilization   hadoop.yarn.server.TestContainerManagerSecurity   hadoop.yarn.client.TestGetGroups JDK v1.8.0_66 Timed out junit tests org.apache.hadoop.yarn.client.cli.TestYarnCLI   org.apache.hadoop.yarn.client.api.impl.TestAMRMClient   org.apache.hadoop.yarn.client.api.impl.TestYarnClient   org.apache.hadoop.yarn.client.api.impl.TestNMClient JDK v1.7.0_91 Failed junit tests hadoop.yarn.server.TestMiniYarnClusterNodeUtilization   hadoop.yarn.server.TestContainerManagerSecurity   hadoop.yarn.client.TestGetGroups JDK v1.7.0_91 Timed out junit tests org.apache.hadoop.yarn.client.cli.TestYarnCLI   org.apache.hadoop.yarn.client.api.impl.TestAMRMClient   org.apache.hadoop.yarn.client.api.impl.TestYarnClient   org.apache.hadoop.yarn.client.api.impl.TestNMClient Subsystem Report/Notes Docker Image:yetus/hadoop:0ca8df7 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12783472/YARN-4496.4.patch JIRA Issue YARN-4496 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux 3afd8771a947 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 5ff5f67 Default Java 1.7.0_91 Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_66 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_91 findbugs v3.0.0 javac hadoop-yarn-project_hadoop-yarn-jdk1.8.0_66: https://builds.apache.org/job/PreCommit-YARN-Build/10351/artifact/patchprocess/diff-compile-javac-hadoop-yarn-project_hadoop-yarn-jdk1.8.0_66.txt javac hadoop-yarn-project_hadoop-yarn-jdk1.7.0_91: https://builds.apache.org/job/PreCommit-YARN-Build/10351/artifact/patchprocess/diff-compile-javac-hadoop-yarn-project_hadoop-yarn-jdk1.7.0_91.txt checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/10351/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/10351/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager-jdk1.8.0_66.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/10351/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests-jdk1.8.0_66.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/10351/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client-jdk1.8.0_66.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/10351/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager-jdk1.7.0_91.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/10351/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests-jdk1.7.0_91.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/10351/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client-jdk1.7.0_91.txt unit test logs https://builds.apache.org/job/PreCommit-YARN-Build/10351/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests-jdk1.8.0_66.txt https://builds.apache.org/job/PreCommit-YARN-Build/10351/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client-jdk1.8.0_66.txt https://builds.apache.org/job/PreCommit-YARN-Build/10351/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests-jdk1.7.0_91.txt https://builds.apache.org/job/PreCommit-YARN-Build/10351/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client-jdk1.7.0_91.txt JDK v1.7.0_91 Test Results https://builds.apache.org/job/PreCommit-YARN-Build/10351/testReport/ modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-tests hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client U: hadoop-yarn-project/hadoop-yarn Max memory used 77MB Powered by Apache Yetus 0.2.0-SNAPSHOT http://yetus.apache.org Console output https://builds.apache.org/job/PreCommit-YARN-Build/10351/console This message was automatically generated.
          Hide
          asuresh Arun Suresh added a comment -

          Got it... missed that... thanks for clarifying
          +1, pending jenkins

          Show
          asuresh Arun Suresh added a comment - Got it... missed that... thanks for clarifying +1, pending jenkins
          Hide
          jianhe Jian He added a comment -

          The v4 patch fixed comments from Xuan and Arun.
          thank you both for the review !

          Show
          jianhe Jian He added a comment - The v4 patch fixed comments from Xuan and Arun. thank you both for the review !
          Hide
          jianhe Jian He added a comment -

          when it is possible to evaluate it using HAUtil.isHAEnabled(conf) (like it was done before).

          Because RetryPolicy retryPolicy = RMProxy.createRetryPolicy(conf, false); this line code in RequestHedgingRMFailoverProxyProvider needs to call this method with false, but under the context of HAUtil.isHAEnabled == true.

          Show
          jianhe Jian He added a comment - when it is possible to evaluate it using HAUtil.isHAEnabled(conf) (like it was done before). Because RetryPolicy retryPolicy = RMProxy.createRetryPolicy(conf, false); this line code in RequestHedgingRMFailoverProxyProvider needs to call this method with false, but under the context of HAUtil.isHAEnabled == true.
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 0s Docker mode activated.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 3 new or modified test files.
          0 mvndep 0m 44s Maven dependency ordering for branch
          +1 mvninstall 8m 6s trunk passed
          +1 compile 2m 1s trunk passed with JDK v1.8.0_66
          +1 compile 2m 18s trunk passed with JDK v1.7.0_91
          +1 checkstyle 0m 31s trunk passed
          +1 mvnsite 2m 19s trunk passed
          +1 mvneclipse 1m 7s trunk passed
          +1 findbugs 4m 48s trunk passed
          +1 javadoc 1m 59s trunk passed with JDK v1.8.0_66
          +1 javadoc 4m 23s trunk passed with JDK v1.7.0_91
          0 mvndep 0m 44s Maven dependency ordering for patch
          +1 mvninstall 1m 57s the patch passed
          +1 compile 2m 26s the patch passed with JDK v1.8.0_66
          -1 javac 5m 7s hadoop-yarn-project_hadoop-yarn-jdk1.8.0_66 with JDK v1.8.0_66 generated 1 new + 9 unchanged - 0 fixed = 10 total (was 9)
          +1 javac 2m 26s the patch passed
          +1 compile 2m 22s the patch passed with JDK v1.7.0_91
          -1 javac 7m 29s hadoop-yarn-project_hadoop-yarn-jdk1.7.0_91 with JDK v1.7.0_91 generated 1 new + 10 unchanged - 0 fixed = 11 total (was 10)
          +1 javac 2m 22s the patch passed
          -1 checkstyle 0m 33s hadoop-yarn-project/hadoop-yarn: patch generated 3 new + 221 unchanged - 0 fixed = 224 total (was 221)
          +1 mvnsite 2m 36s the patch passed
          +1 mvneclipse 1m 5s the patch passed
          +1 whitespace 0m 0s Patch has no whitespace issues.
          +1 xml 0m 1s The patch has no ill-formed XML file.
          +1 findbugs 6m 31s the patch passed
          +1 javadoc 2m 47s the patch passed with JDK v1.8.0_66
          +1 javadoc 4m 37s the patch passed with JDK v1.7.0_91
          +1 unit 0m 23s hadoop-yarn-api in the patch passed with JDK v1.8.0_66.
          +1 unit 2m 3s hadoop-yarn-common in the patch passed with JDK v1.8.0_66.
          -1 unit 8m 44s hadoop-yarn-server-nodemanager in the patch failed with JDK v1.8.0_66.
          -1 unit 6m 20s hadoop-yarn-server-tests in the patch failed with JDK v1.8.0_66.
          -1 unit 64m 37s hadoop-yarn-client in the patch failed with JDK v1.8.0_66.
          +1 unit 0m 25s hadoop-yarn-api in the patch passed with JDK v1.7.0_91.
          +1 unit 2m 15s hadoop-yarn-common in the patch passed with JDK v1.7.0_91.
          -1 unit 9m 13s hadoop-yarn-server-nodemanager in the patch failed with JDK v1.7.0_91.
          -1 unit 6m 24s hadoop-yarn-server-tests in the patch failed with JDK v1.7.0_91.
          -1 unit 0m 23s hadoop-yarn-client in the patch failed with JDK v1.7.0_91.
          +1 asflicense 0m 23s Patch does not generate ASF License warnings.
          157m 7s



          Reason Tests
          JDK v1.8.0_66 Failed junit tests hadoop.yarn.server.TestContainerManagerSecurity
            hadoop.yarn.server.TestMiniYarnClusterNodeUtilization
            hadoop.yarn.client.TestGetGroups
          JDK v1.8.0_66 Timed out junit tests org.apache.hadoop.yarn.client.cli.TestYarnCLI
            org.apache.hadoop.yarn.client.api.impl.TestAMRMClient
            org.apache.hadoop.yarn.client.api.impl.TestYarnClient
            org.apache.hadoop.yarn.client.api.impl.TestNMClient
          JDK v1.7.0_91 Failed junit tests hadoop.yarn.server.TestContainerManagerSecurity
            hadoop.yarn.server.TestMiniYarnClusterNodeUtilization



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:0ca8df7
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12783417/YARN-4496.3.patch
          JIRA Issue YARN-4496
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml
          uname Linux 07e99f8f4402 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision trunk / 7905788
          Default Java 1.7.0_91
          Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_66 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_91
          findbugs v3.0.0
          javac hadoop-yarn-project_hadoop-yarn-jdk1.8.0_66: https://builds.apache.org/job/PreCommit-YARN-Build/10346/artifact/patchprocess/diff-compile-javac-hadoop-yarn-project_hadoop-yarn-jdk1.8.0_66.txt
          javac hadoop-yarn-project_hadoop-yarn-jdk1.7.0_91: https://builds.apache.org/job/PreCommit-YARN-Build/10346/artifact/patchprocess/diff-compile-javac-hadoop-yarn-project_hadoop-yarn-jdk1.7.0_91.txt
          checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/10346/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/10346/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager-jdk1.8.0_66.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/10346/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests-jdk1.8.0_66.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/10346/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client-jdk1.8.0_66.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/10346/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager-jdk1.7.0_91.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/10346/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests-jdk1.7.0_91.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/10346/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client-jdk1.7.0_91.txt
          unit test logs https://builds.apache.org/job/PreCommit-YARN-Build/10346/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests-jdk1.8.0_66.txt https://builds.apache.org/job/PreCommit-YARN-Build/10346/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client-jdk1.8.0_66.txt https://builds.apache.org/job/PreCommit-YARN-Build/10346/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests-jdk1.7.0_91.txt
          JDK v1.7.0_91 Test Results https://builds.apache.org/job/PreCommit-YARN-Build/10346/testReport/
          modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-tests hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client U: hadoop-yarn-project/hadoop-yarn
          Max memory used 77MB
          Powered by Apache Yetus 0.2.0-SNAPSHOT http://yetus.apache.org
          Console output https://builds.apache.org/job/PreCommit-YARN-Build/10346/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 0s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 3 new or modified test files. 0 mvndep 0m 44s Maven dependency ordering for branch +1 mvninstall 8m 6s trunk passed +1 compile 2m 1s trunk passed with JDK v1.8.0_66 +1 compile 2m 18s trunk passed with JDK v1.7.0_91 +1 checkstyle 0m 31s trunk passed +1 mvnsite 2m 19s trunk passed +1 mvneclipse 1m 7s trunk passed +1 findbugs 4m 48s trunk passed +1 javadoc 1m 59s trunk passed with JDK v1.8.0_66 +1 javadoc 4m 23s trunk passed with JDK v1.7.0_91 0 mvndep 0m 44s Maven dependency ordering for patch +1 mvninstall 1m 57s the patch passed +1 compile 2m 26s the patch passed with JDK v1.8.0_66 -1 javac 5m 7s hadoop-yarn-project_hadoop-yarn-jdk1.8.0_66 with JDK v1.8.0_66 generated 1 new + 9 unchanged - 0 fixed = 10 total (was 9) +1 javac 2m 26s the patch passed +1 compile 2m 22s the patch passed with JDK v1.7.0_91 -1 javac 7m 29s hadoop-yarn-project_hadoop-yarn-jdk1.7.0_91 with JDK v1.7.0_91 generated 1 new + 10 unchanged - 0 fixed = 11 total (was 10) +1 javac 2m 22s the patch passed -1 checkstyle 0m 33s hadoop-yarn-project/hadoop-yarn: patch generated 3 new + 221 unchanged - 0 fixed = 224 total (was 221) +1 mvnsite 2m 36s the patch passed +1 mvneclipse 1m 5s the patch passed +1 whitespace 0m 0s Patch has no whitespace issues. +1 xml 0m 1s The patch has no ill-formed XML file. +1 findbugs 6m 31s the patch passed +1 javadoc 2m 47s the patch passed with JDK v1.8.0_66 +1 javadoc 4m 37s the patch passed with JDK v1.7.0_91 +1 unit 0m 23s hadoop-yarn-api in the patch passed with JDK v1.8.0_66. +1 unit 2m 3s hadoop-yarn-common in the patch passed with JDK v1.8.0_66. -1 unit 8m 44s hadoop-yarn-server-nodemanager in the patch failed with JDK v1.8.0_66. -1 unit 6m 20s hadoop-yarn-server-tests in the patch failed with JDK v1.8.0_66. -1 unit 64m 37s hadoop-yarn-client in the patch failed with JDK v1.8.0_66. +1 unit 0m 25s hadoop-yarn-api in the patch passed with JDK v1.7.0_91. +1 unit 2m 15s hadoop-yarn-common in the patch passed with JDK v1.7.0_91. -1 unit 9m 13s hadoop-yarn-server-nodemanager in the patch failed with JDK v1.7.0_91. -1 unit 6m 24s hadoop-yarn-server-tests in the patch failed with JDK v1.7.0_91. -1 unit 0m 23s hadoop-yarn-client in the patch failed with JDK v1.7.0_91. +1 asflicense 0m 23s Patch does not generate ASF License warnings. 157m 7s Reason Tests JDK v1.8.0_66 Failed junit tests hadoop.yarn.server.TestContainerManagerSecurity   hadoop.yarn.server.TestMiniYarnClusterNodeUtilization   hadoop.yarn.client.TestGetGroups JDK v1.8.0_66 Timed out junit tests org.apache.hadoop.yarn.client.cli.TestYarnCLI   org.apache.hadoop.yarn.client.api.impl.TestAMRMClient   org.apache.hadoop.yarn.client.api.impl.TestYarnClient   org.apache.hadoop.yarn.client.api.impl.TestNMClient JDK v1.7.0_91 Failed junit tests hadoop.yarn.server.TestContainerManagerSecurity   hadoop.yarn.server.TestMiniYarnClusterNodeUtilization Subsystem Report/Notes Docker Image:yetus/hadoop:0ca8df7 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12783417/YARN-4496.3.patch JIRA Issue YARN-4496 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml uname Linux 07e99f8f4402 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 7905788 Default Java 1.7.0_91 Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_66 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_91 findbugs v3.0.0 javac hadoop-yarn-project_hadoop-yarn-jdk1.8.0_66: https://builds.apache.org/job/PreCommit-YARN-Build/10346/artifact/patchprocess/diff-compile-javac-hadoop-yarn-project_hadoop-yarn-jdk1.8.0_66.txt javac hadoop-yarn-project_hadoop-yarn-jdk1.7.0_91: https://builds.apache.org/job/PreCommit-YARN-Build/10346/artifact/patchprocess/diff-compile-javac-hadoop-yarn-project_hadoop-yarn-jdk1.7.0_91.txt checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/10346/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/10346/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager-jdk1.8.0_66.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/10346/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests-jdk1.8.0_66.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/10346/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client-jdk1.8.0_66.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/10346/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager-jdk1.7.0_91.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/10346/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests-jdk1.7.0_91.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/10346/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client-jdk1.7.0_91.txt unit test logs https://builds.apache.org/job/PreCommit-YARN-Build/10346/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests-jdk1.8.0_66.txt https://builds.apache.org/job/PreCommit-YARN-Build/10346/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client-jdk1.8.0_66.txt https://builds.apache.org/job/PreCommit-YARN-Build/10346/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests-jdk1.7.0_91.txt JDK v1.7.0_91 Test Results https://builds.apache.org/job/PreCommit-YARN-Build/10346/testReport/ modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-tests hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client U: hadoop-yarn-project/hadoop-yarn Max memory used 77MB Powered by Apache Yetus 0.2.0-SNAPSHOT http://yetus.apache.org Console output https://builds.apache.org/job/PreCommit-YARN-Build/10346/console This message was automatically generated.
          Hide
          asuresh Arun Suresh added a comment -

          This method actually uses this flag

          Correct.. but what I meant to say was, why you would want to add an extra boolean attribute to the createRetryPolicy function, when it is possible to evaluate it using HAUtil.isHAEnabled(conf) (like it was done before).

          Do you mean the startRMInThread in the test case? that thread just call a single method..

          Got it... I thought you had actually started an RM in a thread (maybe, just rename it to makeRMActive)

          Show
          asuresh Arun Suresh added a comment - This method actually uses this flag Correct.. but what I meant to say was, why you would want to add an extra boolean attribute to the createRetryPolicy function, when it is possible to evaluate it using HAUtil.isHAEnabled(conf) (like it was done before). Do you mean the startRMInThread in the test case? that thread just call a single method.. Got it... I thought you had actually started an RM in a thread (maybe, just rename it to makeRMActive)
          Hide
          jianhe Jian He added a comment -

          ok , removed that change. will track separately

          Show
          jianhe Jian He added a comment - ok , removed that change. will track separately
          Hide
          xgong Xuan Gong added a comment -

          The patch looks good.
          But can we separate these changes from this jira ? These changes are not related.

             public static final long DEFAULT_RESOURCEMANAGER_CONNECT_RETRY_INTERVAL_MS
          -      = 30 * 1000;
          +      = 5 * 1000;
          
          Show
          xgong Xuan Gong added a comment - The patch looks good. But can we separate these changes from this jira ? These changes are not related. public static final long DEFAULT_RESOURCEMANAGER_CONNECT_RETRY_INTERVAL_MS - = 30 * 1000; + = 5 * 1000;
          Hide
          jianhe Jian He added a comment - - edited

          Do we need that change ?

          This method actually uses this flag

            public static RetryPolicy createRetryPolicy(Configuration conf,
                boolean isHAEnabled) {
          

          a bit flaky due to reliance on the clock and timing

          The goal is to test client can discover active rm fast. by fast, I need to test the time interval is reasonably small.. I'll remove the 6 seconds sleep in startRMInThread which should help this situation. I think 10 seconds overall should be well enough. of course, i'm open to any suggestion

          Can we kill the RM threads before exiting the test case ?

          Do you mean the startRMInThread in the test case? that thread just call a single method. If that method fails, the test will fail

          Show
          jianhe Jian He added a comment - - edited Do we need that change ? This method actually uses this flag public static RetryPolicy createRetryPolicy(Configuration conf, boolean isHAEnabled) { a bit flaky due to reliance on the clock and timing The goal is to test client can discover active rm fast. by fast, I need to test the time interval is reasonably small.. I'll remove the 6 seconds sleep in startRMInThread which should help this situation. I think 10 seconds overall should be well enough. of course, i'm open to any suggestion Can we kill the RM threads before exiting the test case ? Do you mean the startRMInThread in the test case? that thread just call a single method. If that method fails, the test will fail
          Hide
          asuresh Arun Suresh added a comment -

          Agreed.. Couple of minor comments:

          1. I noticed that you had changed the RMProxy.createRetryPolicy method to allow setting a boolean flag for HA. Do we need that change ? since I see that you are calling HAUtils.isHAEnabled() whenever you are calling createRetryPolicy anyway.
          2. Can we kill the RM threads before exiting the test case ?

          minor nit :

          1. the test case looks good, but am worried it might be a bit flaky due to reliance on the clock and timing.. anyway it can be refactored ?
          Show
          asuresh Arun Suresh added a comment - Agreed.. Couple of minor comments: I noticed that you had changed the RMProxy.createRetryPolicy method to allow setting a boolean flag for HA. Do we need that change ? since I see that you are calling HAUtils.isHAEnabled() whenever you are calling createRetryPolicy anyway. Can we kill the RM threads before exiting the test case ? minor nit : the test case looks good, but am worried it might be a bit flaky due to reliance on the clock and timing.. anyway it can be refactored ?
          Hide
          jianhe Jian He added a comment -

          yeah, I actually tried to make them common when I started writing the patch initially. but because of some other logic divergence, making them common requires nontrival refactoring on RM and maybe hdfs too. I'd like to keep them as is and open a jira separately

          Show
          jianhe Jian He added a comment - yeah, I actually tried to make them common when I started writing the patch initially. but because of some other logic divergence, making them common requires nontrival refactoring on RM and maybe hdfs too. I'd like to keep them as is and open a jira separately
          Hide
          asuresh Arun Suresh added a comment -

          Thanks for the patch Jian He !!

          It looks good generally, although, my initial thought process was to actually merge both the Namenode and RM proxy hierarchies. Currently, it looks like the common ancestor is the FailoverProxyProvider class. Unfortunately, for YARN, we have a RMFailoverProxyProvider which extends it and adds an init() method, which in the NN hierarchy, everything is done in the constructor. I was wondering if we could possibly avoid using the init method and somehow make ConfiguredFailoverProxyProvider and RequestHedgingProxyProvider common enough so that it can be used by both RM and NN.. and avoid some code duplication too.

          Thoughts ?

          Show
          asuresh Arun Suresh added a comment - Thanks for the patch Jian He !! It looks good generally, although, my initial thought process was to actually merge both the Namenode and RM proxy hierarchies. Currently, it looks like the common ancestor is the FailoverProxyProvider class. Unfortunately, for YARN, we have a RMFailoverProxyProvider which extends it and adds an init() method, which in the NN hierarchy, everything is done in the constructor. I was wondering if we could possibly avoid using the init method and somehow make ConfiguredFailoverProxyProvider and RequestHedgingProxyProvider common enough so that it can be used by both RM and NN.. and avoid some code duplication too. Thoughts ?
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 0s Docker mode activated.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 3 new or modified test files.
          0 mvndep 0m 54s Maven dependency ordering for branch
          +1 mvninstall 7m 35s trunk passed
          +1 compile 1m 54s trunk passed with JDK v1.8.0_66
          +1 compile 2m 9s trunk passed with JDK v1.7.0_91
          +1 checkstyle 0m 29s trunk passed
          +1 mvnsite 2m 16s trunk passed
          +1 mvneclipse 1m 5s trunk passed
          +1 findbugs 4m 36s trunk passed
          +1 javadoc 1m 53s trunk passed with JDK v1.8.0_66
          +1 javadoc 4m 16s trunk passed with JDK v1.7.0_91
          0 mvndep 0m 42s Maven dependency ordering for patch
          +1 mvninstall 1m 50s the patch passed
          +1 compile 1m 51s the patch passed with JDK v1.8.0_66
          -1 javac 4m 24s hadoop-yarn-project_hadoop-yarn-jdk1.8.0_66 with JDK v1.8.0_66 generated 1 new + 9 unchanged - 0 fixed = 10 total (was 9)
          +1 javac 1m 51s the patch passed
          +1 compile 2m 14s the patch passed with JDK v1.7.0_91
          -1 javac 6m 38s hadoop-yarn-project_hadoop-yarn-jdk1.7.0_91 with JDK v1.7.0_91 generated 1 new + 10 unchanged - 0 fixed = 11 total (was 10)
          +1 javac 2m 14s the patch passed
          -1 checkstyle 0m 35s hadoop-yarn-project/hadoop-yarn: patch generated 3 new + 221 unchanged - 0 fixed = 224 total (was 221)
          +1 mvnsite 2m 22s the patch passed
          +1 mvneclipse 1m 1s the patch passed
          +1 whitespace 0m 0s Patch has no whitespace issues.
          +1 xml 0m 0s The patch has no ill-formed XML file.
          +1 findbugs 6m 2s the patch passed
          +1 javadoc 2m 7s the patch passed with JDK v1.8.0_66
          +1 javadoc 4m 27s the patch passed with JDK v1.7.0_91
          +1 unit 0m 24s hadoop-yarn-api in the patch passed with JDK v1.8.0_66.
          +1 unit 2m 7s hadoop-yarn-common in the patch passed with JDK v1.8.0_66.
          -1 unit 9m 7s hadoop-yarn-server-nodemanager in the patch failed with JDK v1.8.0_66.
          -1 unit 6m 41s hadoop-yarn-server-tests in the patch failed with JDK v1.8.0_66.
          -1 unit 64m 56s hadoop-yarn-client in the patch failed with JDK v1.8.0_66.
          +1 unit 0m 25s hadoop-yarn-api in the patch passed with JDK v1.7.0_91.
          +1 unit 2m 21s hadoop-yarn-common in the patch passed with JDK v1.7.0_91.
          -1 unit 9m 16s hadoop-yarn-server-nodemanager in the patch failed with JDK v1.7.0_91.
          -1 unit 6m 46s hadoop-yarn-server-tests in the patch failed with JDK v1.7.0_91.
          -1 unit 64m 53s hadoop-yarn-client in the patch failed with JDK v1.7.0_91.
          +1 asflicense 0m 19s Patch does not generate ASF License warnings.
          219m 33s



          Reason Tests
          JDK v1.8.0_66 Failed junit tests hadoop.yarn.server.TestMiniYarnClusterNodeUtilization
            hadoop.yarn.server.TestContainerManagerSecurity
            hadoop.yarn.client.TestGetGroups
          JDK v1.8.0_66 Timed out junit tests org.apache.hadoop.yarn.client.cli.TestYarnCLI
            org.apache.hadoop.yarn.client.api.impl.TestAMRMClient
            org.apache.hadoop.yarn.client.api.impl.TestYarnClient
            org.apache.hadoop.yarn.client.api.impl.TestNMClient
          JDK v1.7.0_91 Failed junit tests hadoop.yarn.server.TestMiniYarnClusterNodeUtilization
            hadoop.yarn.server.TestContainerManagerSecurity
            hadoop.yarn.client.TestGetGroups
          JDK v1.7.0_91 Timed out junit tests org.apache.hadoop.yarn.client.cli.TestYarnCLI
            org.apache.hadoop.yarn.client.api.impl.TestAMRMClient
            org.apache.hadoop.yarn.client.api.impl.TestYarnClient
            org.apache.hadoop.yarn.client.api.impl.TestNMClient



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:0ca8df7
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12783293/YARN-4496.2.patch
          JIRA Issue YARN-4496
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml
          uname Linux 07b6fe8e7835 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision trunk / 57d0a94
          Default Java 1.7.0_91
          Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_66 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_91
          findbugs v3.0.0
          javac hadoop-yarn-project_hadoop-yarn-jdk1.8.0_66: https://builds.apache.org/job/PreCommit-YARN-Build/10339/artifact/patchprocess/diff-compile-javac-hadoop-yarn-project_hadoop-yarn-jdk1.8.0_66.txt
          javac hadoop-yarn-project_hadoop-yarn-jdk1.7.0_91: https://builds.apache.org/job/PreCommit-YARN-Build/10339/artifact/patchprocess/diff-compile-javac-hadoop-yarn-project_hadoop-yarn-jdk1.7.0_91.txt
          checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/10339/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/10339/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager-jdk1.8.0_66.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/10339/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests-jdk1.8.0_66.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/10339/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client-jdk1.8.0_66.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/10339/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager-jdk1.7.0_91.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/10339/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests-jdk1.7.0_91.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/10339/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client-jdk1.7.0_91.txt
          unit test logs https://builds.apache.org/job/PreCommit-YARN-Build/10339/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests-jdk1.8.0_66.txt https://builds.apache.org/job/PreCommit-YARN-Build/10339/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client-jdk1.8.0_66.txt https://builds.apache.org/job/PreCommit-YARN-Build/10339/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests-jdk1.7.0_91.txt https://builds.apache.org/job/PreCommit-YARN-Build/10339/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client-jdk1.7.0_91.txt
          JDK v1.7.0_91 Test Results https://builds.apache.org/job/PreCommit-YARN-Build/10339/testReport/
          modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-tests hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client U: hadoop-yarn-project/hadoop-yarn
          Max memory used 76MB
          Powered by Apache Yetus 0.2.0-SNAPSHOT http://yetus.apache.org
          Console output https://builds.apache.org/job/PreCommit-YARN-Build/10339/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 0s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 3 new or modified test files. 0 mvndep 0m 54s Maven dependency ordering for branch +1 mvninstall 7m 35s trunk passed +1 compile 1m 54s trunk passed with JDK v1.8.0_66 +1 compile 2m 9s trunk passed with JDK v1.7.0_91 +1 checkstyle 0m 29s trunk passed +1 mvnsite 2m 16s trunk passed +1 mvneclipse 1m 5s trunk passed +1 findbugs 4m 36s trunk passed +1 javadoc 1m 53s trunk passed with JDK v1.8.0_66 +1 javadoc 4m 16s trunk passed with JDK v1.7.0_91 0 mvndep 0m 42s Maven dependency ordering for patch +1 mvninstall 1m 50s the patch passed +1 compile 1m 51s the patch passed with JDK v1.8.0_66 -1 javac 4m 24s hadoop-yarn-project_hadoop-yarn-jdk1.8.0_66 with JDK v1.8.0_66 generated 1 new + 9 unchanged - 0 fixed = 10 total (was 9) +1 javac 1m 51s the patch passed +1 compile 2m 14s the patch passed with JDK v1.7.0_91 -1 javac 6m 38s hadoop-yarn-project_hadoop-yarn-jdk1.7.0_91 with JDK v1.7.0_91 generated 1 new + 10 unchanged - 0 fixed = 11 total (was 10) +1 javac 2m 14s the patch passed -1 checkstyle 0m 35s hadoop-yarn-project/hadoop-yarn: patch generated 3 new + 221 unchanged - 0 fixed = 224 total (was 221) +1 mvnsite 2m 22s the patch passed +1 mvneclipse 1m 1s the patch passed +1 whitespace 0m 0s Patch has no whitespace issues. +1 xml 0m 0s The patch has no ill-formed XML file. +1 findbugs 6m 2s the patch passed +1 javadoc 2m 7s the patch passed with JDK v1.8.0_66 +1 javadoc 4m 27s the patch passed with JDK v1.7.0_91 +1 unit 0m 24s hadoop-yarn-api in the patch passed with JDK v1.8.0_66. +1 unit 2m 7s hadoop-yarn-common in the patch passed with JDK v1.8.0_66. -1 unit 9m 7s hadoop-yarn-server-nodemanager in the patch failed with JDK v1.8.0_66. -1 unit 6m 41s hadoop-yarn-server-tests in the patch failed with JDK v1.8.0_66. -1 unit 64m 56s hadoop-yarn-client in the patch failed with JDK v1.8.0_66. +1 unit 0m 25s hadoop-yarn-api in the patch passed with JDK v1.7.0_91. +1 unit 2m 21s hadoop-yarn-common in the patch passed with JDK v1.7.0_91. -1 unit 9m 16s hadoop-yarn-server-nodemanager in the patch failed with JDK v1.7.0_91. -1 unit 6m 46s hadoop-yarn-server-tests in the patch failed with JDK v1.7.0_91. -1 unit 64m 53s hadoop-yarn-client in the patch failed with JDK v1.7.0_91. +1 asflicense 0m 19s Patch does not generate ASF License warnings. 219m 33s Reason Tests JDK v1.8.0_66 Failed junit tests hadoop.yarn.server.TestMiniYarnClusterNodeUtilization   hadoop.yarn.server.TestContainerManagerSecurity   hadoop.yarn.client.TestGetGroups JDK v1.8.0_66 Timed out junit tests org.apache.hadoop.yarn.client.cli.TestYarnCLI   org.apache.hadoop.yarn.client.api.impl.TestAMRMClient   org.apache.hadoop.yarn.client.api.impl.TestYarnClient   org.apache.hadoop.yarn.client.api.impl.TestNMClient JDK v1.7.0_91 Failed junit tests hadoop.yarn.server.TestMiniYarnClusterNodeUtilization   hadoop.yarn.server.TestContainerManagerSecurity   hadoop.yarn.client.TestGetGroups JDK v1.7.0_91 Timed out junit tests org.apache.hadoop.yarn.client.cli.TestYarnCLI   org.apache.hadoop.yarn.client.api.impl.TestAMRMClient   org.apache.hadoop.yarn.client.api.impl.TestYarnClient   org.apache.hadoop.yarn.client.api.impl.TestNMClient Subsystem Report/Notes Docker Image:yetus/hadoop:0ca8df7 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12783293/YARN-4496.2.patch JIRA Issue YARN-4496 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml uname Linux 07b6fe8e7835 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 57d0a94 Default Java 1.7.0_91 Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_66 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_91 findbugs v3.0.0 javac hadoop-yarn-project_hadoop-yarn-jdk1.8.0_66: https://builds.apache.org/job/PreCommit-YARN-Build/10339/artifact/patchprocess/diff-compile-javac-hadoop-yarn-project_hadoop-yarn-jdk1.8.0_66.txt javac hadoop-yarn-project_hadoop-yarn-jdk1.7.0_91: https://builds.apache.org/job/PreCommit-YARN-Build/10339/artifact/patchprocess/diff-compile-javac-hadoop-yarn-project_hadoop-yarn-jdk1.7.0_91.txt checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/10339/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/10339/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager-jdk1.8.0_66.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/10339/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests-jdk1.8.0_66.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/10339/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client-jdk1.8.0_66.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/10339/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager-jdk1.7.0_91.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/10339/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests-jdk1.7.0_91.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/10339/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client-jdk1.7.0_91.txt unit test logs https://builds.apache.org/job/PreCommit-YARN-Build/10339/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests-jdk1.8.0_66.txt https://builds.apache.org/job/PreCommit-YARN-Build/10339/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client-jdk1.8.0_66.txt https://builds.apache.org/job/PreCommit-YARN-Build/10339/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests-jdk1.7.0_91.txt https://builds.apache.org/job/PreCommit-YARN-Build/10339/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client-jdk1.7.0_91.txt JDK v1.7.0_91 Test Results https://builds.apache.org/job/PreCommit-YARN-Build/10339/testReport/ modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-tests hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client U: hadoop-yarn-project/hadoop-yarn Max memory used 76MB Powered by Apache Yetus 0.2.0-SNAPSHOT http://yetus.apache.org Console output https://builds.apache.org/job/PreCommit-YARN-Build/10339/console This message was automatically generated.
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 0s Docker mode activated.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 3 new or modified test files.
          0 mvndep 0m 57s Maven dependency ordering for branch
          +1 mvninstall 7m 47s trunk passed
          +1 compile 1m 47s trunk passed with JDK v1.8.0_66
          +1 compile 2m 9s trunk passed with JDK v1.7.0_91
          +1 checkstyle 0m 30s trunk passed
          +1 mvnsite 2m 11s trunk passed
          +1 mvneclipse 1m 4s trunk passed
          +1 findbugs 4m 43s trunk passed
          +1 javadoc 2m 1s trunk passed with JDK v1.8.0_66
          +1 javadoc 4m 21s trunk passed with JDK v1.7.0_91
          0 mvndep 0m 42s Maven dependency ordering for patch
          +1 mvninstall 1m 49s the patch passed
          +1 compile 1m 48s the patch passed with JDK v1.8.0_66
          -1 javac 4m 20s hadoop-yarn-project_hadoop-yarn-jdk1.8.0_66 with JDK v1.8.0_66 generated 1 new + 9 unchanged - 0 fixed = 10 total (was 9)
          +1 javac 1m 48s the patch passed
          +1 compile 2m 8s the patch passed with JDK v1.7.0_91
          -1 javac 6m 29s hadoop-yarn-project_hadoop-yarn-jdk1.7.0_91 with JDK v1.7.0_91 generated 1 new + 10 unchanged - 0 fixed = 11 total (was 10)
          +1 javac 2m 8s the patch passed
          -1 checkstyle 0m 29s hadoop-yarn-project/hadoop-yarn: patch generated 5 new + 221 unchanged - 0 fixed = 226 total (was 221)
          +1 mvnsite 2m 2s the patch passed
          +1 mvneclipse 0m 55s the patch passed
          +1 whitespace 0m 0s Patch has no whitespace issues.
          +1 xml 0m 0s The patch has no ill-formed XML file.
          +1 findbugs 5m 29s the patch passed
          +1 javadoc 1m 43s the patch passed with JDK v1.8.0_66
          +1 javadoc 4m 8s the patch passed with JDK v1.7.0_91
          +1 unit 0m 21s hadoop-yarn-api in the patch passed with JDK v1.8.0_66.
          +1 unit 2m 3s hadoop-yarn-common in the patch passed with JDK v1.8.0_66.
          -1 unit 8m 46s hadoop-yarn-server-nodemanager in the patch failed with JDK v1.8.0_66.
          -1 unit 6m 36s hadoop-yarn-server-tests in the patch failed with JDK v1.8.0_66.
          -1 unit 64m 55s hadoop-yarn-client in the patch failed with JDK v1.8.0_66.
          +1 unit 0m 27s hadoop-yarn-api in the patch passed with JDK v1.7.0_91.
          +1 unit 2m 18s hadoop-yarn-common in the patch passed with JDK v1.7.0_91.
          -1 unit 9m 7s hadoop-yarn-server-nodemanager in the patch failed with JDK v1.7.0_91.
          -1 unit 6m 42s hadoop-yarn-server-tests in the patch failed with JDK v1.7.0_91.
          -1 unit 64m 53s hadoop-yarn-client in the patch failed with JDK v1.7.0_91.
          +1 asflicense 0m 21s Patch does not generate ASF License warnings.
          227m 58s



          Reason Tests
          JDK v1.8.0_66 Failed junit tests hadoop.yarn.server.TestMiniYarnClusterNodeUtilization
            hadoop.yarn.server.TestContainerManagerSecurity
            hadoop.yarn.client.TestApplicationClientProtocolOnHA
            hadoop.yarn.client.TestGetGroups
          JDK v1.8.0_66 Timed out junit tests org.apache.hadoop.yarn.client.cli.TestYarnCLI
            org.apache.hadoop.yarn.client.api.impl.TestAMRMClient
            org.apache.hadoop.yarn.client.api.impl.TestYarnClient
            org.apache.hadoop.yarn.client.api.impl.TestNMClient
          JDK v1.7.0_91 Failed junit tests hadoop.yarn.server.TestMiniYarnClusterNodeUtilization
            hadoop.yarn.server.TestContainerManagerSecurity
            hadoop.yarn.client.TestGetGroups
          JDK v1.7.0_91 Timed out junit tests org.apache.hadoop.yarn.client.cli.TestYarnCLI
            org.apache.hadoop.yarn.client.api.impl.TestAMRMClient
            org.apache.hadoop.yarn.client.api.impl.TestYarnClient
            org.apache.hadoop.yarn.client.api.impl.TestNMClient



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:0ca8df7
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12783218/YARN-4496.1.patch
          JIRA Issue YARN-4496
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml
          uname Linux 31926e391034 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision trunk / 1acc509
          Default Java 1.7.0_91
          Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_66 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_91
          findbugs v3.0.0
          javac hadoop-yarn-project_hadoop-yarn-jdk1.8.0_66: https://builds.apache.org/job/PreCommit-YARN-Build/10332/artifact/patchprocess/diff-compile-javac-hadoop-yarn-project_hadoop-yarn-jdk1.8.0_66.txt
          javac hadoop-yarn-project_hadoop-yarn-jdk1.7.0_91: https://builds.apache.org/job/PreCommit-YARN-Build/10332/artifact/patchprocess/diff-compile-javac-hadoop-yarn-project_hadoop-yarn-jdk1.7.0_91.txt
          checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/10332/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/10332/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager-jdk1.8.0_66.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/10332/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests-jdk1.8.0_66.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/10332/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client-jdk1.8.0_66.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/10332/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager-jdk1.7.0_91.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/10332/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests-jdk1.7.0_91.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/10332/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client-jdk1.7.0_91.txt
          unit test logs https://builds.apache.org/job/PreCommit-YARN-Build/10332/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests-jdk1.8.0_66.txt https://builds.apache.org/job/PreCommit-YARN-Build/10332/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client-jdk1.8.0_66.txt https://builds.apache.org/job/PreCommit-YARN-Build/10332/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests-jdk1.7.0_91.txt https://builds.apache.org/job/PreCommit-YARN-Build/10332/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client-jdk1.7.0_91.txt
          JDK v1.7.0_91 Test Results https://builds.apache.org/job/PreCommit-YARN-Build/10332/testReport/
          modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-tests hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client U: hadoop-yarn-project/hadoop-yarn
          Max memory used 77MB
          Powered by Apache Yetus 0.2.0-SNAPSHOT http://yetus.apache.org
          Console output https://builds.apache.org/job/PreCommit-YARN-Build/10332/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 0s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 3 new or modified test files. 0 mvndep 0m 57s Maven dependency ordering for branch +1 mvninstall 7m 47s trunk passed +1 compile 1m 47s trunk passed with JDK v1.8.0_66 +1 compile 2m 9s trunk passed with JDK v1.7.0_91 +1 checkstyle 0m 30s trunk passed +1 mvnsite 2m 11s trunk passed +1 mvneclipse 1m 4s trunk passed +1 findbugs 4m 43s trunk passed +1 javadoc 2m 1s trunk passed with JDK v1.8.0_66 +1 javadoc 4m 21s trunk passed with JDK v1.7.0_91 0 mvndep 0m 42s Maven dependency ordering for patch +1 mvninstall 1m 49s the patch passed +1 compile 1m 48s the patch passed with JDK v1.8.0_66 -1 javac 4m 20s hadoop-yarn-project_hadoop-yarn-jdk1.8.0_66 with JDK v1.8.0_66 generated 1 new + 9 unchanged - 0 fixed = 10 total (was 9) +1 javac 1m 48s the patch passed +1 compile 2m 8s the patch passed with JDK v1.7.0_91 -1 javac 6m 29s hadoop-yarn-project_hadoop-yarn-jdk1.7.0_91 with JDK v1.7.0_91 generated 1 new + 10 unchanged - 0 fixed = 11 total (was 10) +1 javac 2m 8s the patch passed -1 checkstyle 0m 29s hadoop-yarn-project/hadoop-yarn: patch generated 5 new + 221 unchanged - 0 fixed = 226 total (was 221) +1 mvnsite 2m 2s the patch passed +1 mvneclipse 0m 55s the patch passed +1 whitespace 0m 0s Patch has no whitespace issues. +1 xml 0m 0s The patch has no ill-formed XML file. +1 findbugs 5m 29s the patch passed +1 javadoc 1m 43s the patch passed with JDK v1.8.0_66 +1 javadoc 4m 8s the patch passed with JDK v1.7.0_91 +1 unit 0m 21s hadoop-yarn-api in the patch passed with JDK v1.8.0_66. +1 unit 2m 3s hadoop-yarn-common in the patch passed with JDK v1.8.0_66. -1 unit 8m 46s hadoop-yarn-server-nodemanager in the patch failed with JDK v1.8.0_66. -1 unit 6m 36s hadoop-yarn-server-tests in the patch failed with JDK v1.8.0_66. -1 unit 64m 55s hadoop-yarn-client in the patch failed with JDK v1.8.0_66. +1 unit 0m 27s hadoop-yarn-api in the patch passed with JDK v1.7.0_91. +1 unit 2m 18s hadoop-yarn-common in the patch passed with JDK v1.7.0_91. -1 unit 9m 7s hadoop-yarn-server-nodemanager in the patch failed with JDK v1.7.0_91. -1 unit 6m 42s hadoop-yarn-server-tests in the patch failed with JDK v1.7.0_91. -1 unit 64m 53s hadoop-yarn-client in the patch failed with JDK v1.7.0_91. +1 asflicense 0m 21s Patch does not generate ASF License warnings. 227m 58s Reason Tests JDK v1.8.0_66 Failed junit tests hadoop.yarn.server.TestMiniYarnClusterNodeUtilization   hadoop.yarn.server.TestContainerManagerSecurity   hadoop.yarn.client.TestApplicationClientProtocolOnHA   hadoop.yarn.client.TestGetGroups JDK v1.8.0_66 Timed out junit tests org.apache.hadoop.yarn.client.cli.TestYarnCLI   org.apache.hadoop.yarn.client.api.impl.TestAMRMClient   org.apache.hadoop.yarn.client.api.impl.TestYarnClient   org.apache.hadoop.yarn.client.api.impl.TestNMClient JDK v1.7.0_91 Failed junit tests hadoop.yarn.server.TestMiniYarnClusterNodeUtilization   hadoop.yarn.server.TestContainerManagerSecurity   hadoop.yarn.client.TestGetGroups JDK v1.7.0_91 Timed out junit tests org.apache.hadoop.yarn.client.cli.TestYarnCLI   org.apache.hadoop.yarn.client.api.impl.TestAMRMClient   org.apache.hadoop.yarn.client.api.impl.TestYarnClient   org.apache.hadoop.yarn.client.api.impl.TestNMClient Subsystem Report/Notes Docker Image:yetus/hadoop:0ca8df7 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12783218/YARN-4496.1.patch JIRA Issue YARN-4496 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml uname Linux 31926e391034 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 1acc509 Default Java 1.7.0_91 Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_66 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_91 findbugs v3.0.0 javac hadoop-yarn-project_hadoop-yarn-jdk1.8.0_66: https://builds.apache.org/job/PreCommit-YARN-Build/10332/artifact/patchprocess/diff-compile-javac-hadoop-yarn-project_hadoop-yarn-jdk1.8.0_66.txt javac hadoop-yarn-project_hadoop-yarn-jdk1.7.0_91: https://builds.apache.org/job/PreCommit-YARN-Build/10332/artifact/patchprocess/diff-compile-javac-hadoop-yarn-project_hadoop-yarn-jdk1.7.0_91.txt checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/10332/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/10332/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager-jdk1.8.0_66.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/10332/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests-jdk1.8.0_66.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/10332/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client-jdk1.8.0_66.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/10332/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager-jdk1.7.0_91.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/10332/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests-jdk1.7.0_91.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/10332/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client-jdk1.7.0_91.txt unit test logs https://builds.apache.org/job/PreCommit-YARN-Build/10332/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests-jdk1.8.0_66.txt https://builds.apache.org/job/PreCommit-YARN-Build/10332/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client-jdk1.8.0_66.txt https://builds.apache.org/job/PreCommit-YARN-Build/10332/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests-jdk1.7.0_91.txt https://builds.apache.org/job/PreCommit-YARN-Build/10332/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client-jdk1.7.0_91.txt JDK v1.7.0_91 Test Results https://builds.apache.org/job/PreCommit-YARN-Build/10332/testReport/ modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-tests hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client U: hadoop-yarn-project/hadoop-yarn Max memory used 77MB Powered by Apache Yetus 0.2.0-SNAPSHOT http://yetus.apache.org Console output https://builds.apache.org/job/PreCommit-YARN-Build/10332/console This message was automatically generated.
          Hide
          jianhe Jian He added a comment -

          Uploaded a patch:

          • added a new RequestHedgingRMFailoverProxyProvider. When client tries to failover, it uses separate proxy object to talk to each RM simultaneously , each proxy retries the RM until the first one receives a response from the active RM. All the other requests are then cancelled.
          • changed the default rm-retry-interval to be 5 seconds, 30 seconds interval I think is too long.
          Show
          jianhe Jian He added a comment - Uploaded a patch: added a new RequestHedgingRMFailoverProxyProvider. When client tries to failover, it uses separate proxy object to talk to each RM simultaneously , each proxy retries the RM until the first one receives a response from the active RM. All the other requests are then cancelled. changed the default rm-retry-interval to be 5 seconds, 30 seconds interval I think is too long.
          Hide
          jianhe Jian He added a comment -

          taking over, thanks !

          Show
          jianhe Jian He added a comment - taking over, thanks !
          Hide
          asuresh Arun Suresh added a comment -

          Hey Jian He, Feel free to take it up.. I can help with the reviews..

          Show
          asuresh Arun Suresh added a comment - Hey Jian He , Feel free to take it up.. I can help with the reviews..
          Hide
          jianhe Jian He added a comment -

          +1, Arun Suresh, are you working on this ?

          Show
          jianhe Jian He added a comment - +1, Arun Suresh , are you working on this ?
          Hide
          subru Subru Krishnan added a comment -

          +1. Thanks Arun Suresh for initiating this. To add more context, our deployments are fairly large with multiple secondaries which is resulting in considerable connection latencies based on the current failover proxy.

          Show
          subru Subru Krishnan added a comment - +1. Thanks Arun Suresh for initiating this. To add more context, our deployments are fairly large with multiple secondaries which is resulting in considerable connection latencies based on the current failover proxy.
          Hide
          asuresh Arun Suresh added a comment -

          Had a discussion with Subru Krishnan, and we think this would also be useful for YARN federation (YARN-2915) as well

          Show
          asuresh Arun Suresh added a comment - Had a discussion with Subru Krishnan , and we think this would also be useful for YARN federation ( YARN-2915 ) as well

            People

            • Assignee:
              jianhe Jian He
              Reporter:
              asuresh Arun Suresh
            • Votes:
              1 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development