Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-7112

TestAMRMProxy is failing with invalid request

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.9.0, 3.0.0-beta1, 2.8.2
    • Fix Version/s: 2.9.0, 3.0.0-beta1, 2.8.2
    • Component/s: None
    • Labels:
      None

      Description

      The testAMRMProxyE2E and testAMRMProxyTokenRenewal tests in TestAMRMProxy are failing:

      org.apache.hadoop.yarn.exceptions.InvalidApplicationMasterRequestException: Invalid responseId in AllocateRequest from application attempt: appattempt_1503933047334_0001_000001, expect responseId to be 0, but get 1
      
      1. YARN-7112.001.patch
        1.0 kB
        Jason Lowe
      2. YARN-7112-branch-2.8.001.patch
        1.0 kB
        Jason Lowe

        Issue Links

          Activity

          Hide
          jlowe Jason Lowe added a comment -

          This was broken by YARN-6640. After that change the response ID for the initial allocation request must be zero, and these unit tests were sending a response ID of 1 instead.

          TestDistributedScheduling was failing with the same type of error since it leverages the same code to create an allocation request.

          Show
          jlowe Jason Lowe added a comment - This was broken by YARN-6640 . After that change the response ID for the initial allocation request must be zero, and these unit tests were sending a response ID of 1 instead. TestDistributedScheduling was failing with the same type of error since it leverages the same code to create an allocation request.
          Hide
          jlowe Jason Lowe added a comment -

          Attaching a patch that changes BaseAMRMProxyE2ETest to use an initial allocate ID of zero just like AMRMClient and RMContainerRequestor.

          Wangda Tan would you mind taking a look?

          Show
          jlowe Jason Lowe added a comment - Attaching a patch that changes BaseAMRMProxyE2ETest to use an initial allocate ID of zero just like AMRMClient and RMContainerRequestor. Wangda Tan would you mind taking a look?
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 20s Docker mode activated.
                Prechecks
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
                trunk Compile Tests
          +1 mvninstall 13m 19s trunk passed
          +1 compile 0m 21s trunk passed
          +1 checkstyle 0m 16s trunk passed
          +1 mvnsite 0m 24s trunk passed
          +1 findbugs 0m 29s trunk passed
          +1 javadoc 0m 16s trunk passed
                Patch Compile Tests
          +1 mvninstall 0m 19s the patch passed
          +1 compile 0m 18s the patch passed
          +1 javac 0m 18s the patch passed
          +1 checkstyle 0m 12s the patch passed
          +1 mvnsite 0m 20s the patch passed
          +1 whitespace 0m 0s The patch has no whitespace issues.
          +1 findbugs 0m 33s the patch passed
          +1 javadoc 0m 12s the patch passed
                Other Tests
          -1 unit 20m 48s hadoop-yarn-client in the patch failed.
          +1 asflicense 0m 14s The patch does not generate ASF License warnings.
          39m 42s



          Reason Tests
          Failed junit tests hadoop.yarn.client.api.impl.TestAMRMClient



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:14b5c93
          JIRA Issue YARN-7112
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12884070/YARN-7112.001.patch
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
          uname Linux 02d01acb836b 4.4.0-43-generic #63-Ubuntu SMP Wed Oct 12 13:48:03 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision trunk / 02599bd
          Default Java 1.8.0_144
          findbugs v3.1.0-RC1
          unit https://builds.apache.org/job/PreCommit-YARN-Build/17153/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client.txt
          Test Results https://builds.apache.org/job/PreCommit-YARN-Build/17153/testReport/
          modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client
          Console output https://builds.apache.org/job/PreCommit-YARN-Build/17153/console
          Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 20s Docker mode activated.       Prechecks +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.       trunk Compile Tests +1 mvninstall 13m 19s trunk passed +1 compile 0m 21s trunk passed +1 checkstyle 0m 16s trunk passed +1 mvnsite 0m 24s trunk passed +1 findbugs 0m 29s trunk passed +1 javadoc 0m 16s trunk passed       Patch Compile Tests +1 mvninstall 0m 19s the patch passed +1 compile 0m 18s the patch passed +1 javac 0m 18s the patch passed +1 checkstyle 0m 12s the patch passed +1 mvnsite 0m 20s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 findbugs 0m 33s the patch passed +1 javadoc 0m 12s the patch passed       Other Tests -1 unit 20m 48s hadoop-yarn-client in the patch failed. +1 asflicense 0m 14s The patch does not generate ASF License warnings. 39m 42s Reason Tests Failed junit tests hadoop.yarn.client.api.impl.TestAMRMClient Subsystem Report/Notes Docker Image:yetus/hadoop:14b5c93 JIRA Issue YARN-7112 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12884070/YARN-7112.001.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux 02d01acb836b 4.4.0-43-generic #63-Ubuntu SMP Wed Oct 12 13:48:03 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 02599bd Default Java 1.8.0_144 findbugs v3.1.0-RC1 unit https://builds.apache.org/job/PreCommit-YARN-Build/17153/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/17153/testReport/ modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client Console output https://builds.apache.org/job/PreCommit-YARN-Build/17153/console Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
          Hide
          leftnoteasy Wangda Tan added a comment -

          LGTM, +1. Thanks Jason Lowe. Committing now.

          Show
          leftnoteasy Wangda Tan added a comment - LGTM, +1. Thanks Jason Lowe . Committing now.
          Hide
          leftnoteasy Wangda Tan added a comment -

          Committed trunk/branch-2, it looks like patch needs some rework for branch-2.8. Jason Lowe could you help to take a look?

          Show
          leftnoteasy Wangda Tan added a comment - Committed trunk/branch-2, it looks like patch needs some rework for branch-2.8. Jason Lowe could you help to take a look?
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12255 (See https://builds.apache.org/job/Hadoop-trunk-Commit/12255/)
          YARN-7112. TestAMRMProxy is failing with invalid request. (Jason Lowe (wangda: rev 51881a863cb596ff01106d8bd386066e56c38a2a)

          • (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/api/impl/BaseAMRMProxyE2ETest.java
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12255 (See https://builds.apache.org/job/Hadoop-trunk-Commit/12255/ ) YARN-7112 . TestAMRMProxy is failing with invalid request. (Jason Lowe (wangda: rev 51881a863cb596ff01106d8bd386066e56c38a2a) (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/api/impl/BaseAMRMProxyE2ETest.java
          Hide
          jlowe Jason Lowe added a comment -

          Thanks for the review and commit, Wangda! Here's the patch for branch-2.8.

          Show
          jlowe Jason Lowe added a comment - Thanks for the review and commit, Wangda! Here's the patch for branch-2.8.
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 46s Docker mode activated.
                Prechecks
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
                branch-2.8 Compile Tests
          +1 mvninstall 8m 47s branch-2.8 passed
          +1 compile 0m 23s branch-2.8 passed with JDK v1.8.0_144
          +1 compile 0m 23s branch-2.8 passed with JDK v1.7.0_131
          +1 checkstyle 0m 16s branch-2.8 passed
          +1 mvnsite 0m 28s branch-2.8 passed
          +1 findbugs 0m 46s branch-2.8 passed
          +1 javadoc 0m 18s branch-2.8 passed with JDK v1.8.0_144
          +1 javadoc 0m 17s branch-2.8 passed with JDK v1.7.0_131
                Patch Compile Tests
          +1 mvninstall 0m 24s the patch passed
          +1 compile 0m 20s the patch passed with JDK v1.8.0_144
          +1 javac 0m 20s the patch passed
          +1 compile 0m 22s the patch passed with JDK v1.7.0_131
          +1 javac 0m 22s the patch passed
          +1 checkstyle 0m 15s the patch passed
          +1 mvnsite 0m 27s the patch passed
          +1 whitespace 0m 0s The patch has no whitespace issues.
          +1 findbugs 0m 52s the patch passed
          +1 javadoc 0m 12s the patch passed with JDK v1.8.0_144
          +1 javadoc 0m 15s the patch passed with JDK v1.7.0_131
                Other Tests
          -1 unit 9m 2s hadoop-yarn-client in the patch failed with JDK v1.7.0_131.
          +1 asflicense 0m 16s The patch does not generate ASF License warnings.
          35m 39s



          Reason Tests
          JDK v1.8.0_144 Failed junit tests hadoop.yarn.client.TestGetGroups
            hadoop.yarn.client.api.impl.TestYarnClient
          JDK v1.7.0_131 Failed junit tests hadoop.yarn.client.TestGetGroups
            hadoop.yarn.client.api.impl.TestYarnClient



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:d946387
          JIRA Issue YARN-7112
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12884117/YARN-7112-branch-2.8.001.patch
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
          uname Linux 6e0f46bf63b9 3.13.0-116-generic #163-Ubuntu SMP Fri Mar 31 14:13:22 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision branch-2.8 / bc73077
          Default Java 1.7.0_131
          Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_144 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_131
          findbugs v3.0.0
          unit https://builds.apache.org/job/PreCommit-YARN-Build/17161/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client-jdk1.7.0_131.txt
          JDK v1.7.0_131 Test Results https://builds.apache.org/job/PreCommit-YARN-Build/17161/testReport/
          modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client
          Console output https://builds.apache.org/job/PreCommit-YARN-Build/17161/console
          Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 46s Docker mode activated.       Prechecks +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.       branch-2.8 Compile Tests +1 mvninstall 8m 47s branch-2.8 passed +1 compile 0m 23s branch-2.8 passed with JDK v1.8.0_144 +1 compile 0m 23s branch-2.8 passed with JDK v1.7.0_131 +1 checkstyle 0m 16s branch-2.8 passed +1 mvnsite 0m 28s branch-2.8 passed +1 findbugs 0m 46s branch-2.8 passed +1 javadoc 0m 18s branch-2.8 passed with JDK v1.8.0_144 +1 javadoc 0m 17s branch-2.8 passed with JDK v1.7.0_131       Patch Compile Tests +1 mvninstall 0m 24s the patch passed +1 compile 0m 20s the patch passed with JDK v1.8.0_144 +1 javac 0m 20s the patch passed +1 compile 0m 22s the patch passed with JDK v1.7.0_131 +1 javac 0m 22s the patch passed +1 checkstyle 0m 15s the patch passed +1 mvnsite 0m 27s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 findbugs 0m 52s the patch passed +1 javadoc 0m 12s the patch passed with JDK v1.8.0_144 +1 javadoc 0m 15s the patch passed with JDK v1.7.0_131       Other Tests -1 unit 9m 2s hadoop-yarn-client in the patch failed with JDK v1.7.0_131. +1 asflicense 0m 16s The patch does not generate ASF License warnings. 35m 39s Reason Tests JDK v1.8.0_144 Failed junit tests hadoop.yarn.client.TestGetGroups   hadoop.yarn.client.api.impl.TestYarnClient JDK v1.7.0_131 Failed junit tests hadoop.yarn.client.TestGetGroups   hadoop.yarn.client.api.impl.TestYarnClient Subsystem Report/Notes Docker Image:yetus/hadoop:d946387 JIRA Issue YARN-7112 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12884117/YARN-7112-branch-2.8.001.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux 6e0f46bf63b9 3.13.0-116-generic #163-Ubuntu SMP Fri Mar 31 14:13:22 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision branch-2.8 / bc73077 Default Java 1.7.0_131 Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_144 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_131 findbugs v3.0.0 unit https://builds.apache.org/job/PreCommit-YARN-Build/17161/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client-jdk1.7.0_131.txt JDK v1.7.0_131 Test Results https://builds.apache.org/job/PreCommit-YARN-Build/17161/testReport/ modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client Console output https://builds.apache.org/job/PreCommit-YARN-Build/17161/console Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
          Hide
          leftnoteasy Wangda Tan added a comment -

          Committed to branch-2.8 as well, thanks Jason Lowe for quick update.

          Show
          leftnoteasy Wangda Tan added a comment - Committed to branch-2.8 as well, thanks Jason Lowe for quick update.
          Hide
          jlowe Jason Lowe added a comment -

          Thanks, Wangda!

          Show
          jlowe Jason Lowe added a comment - Thanks, Wangda!
          Hide
          jlowe Jason Lowe added a comment -

          I committed this to branch-2.8.2 as well since YARN-6640 was committed there.

          Show
          jlowe Jason Lowe added a comment - I committed this to branch-2.8.2 as well since YARN-6640 was committed there.

            People

            • Assignee:
              jlowe Jason Lowe
              Reporter:
              jlowe Jason Lowe
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development