Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-5816

TestDelegationTokenRenewer#testCancelWithMultipleAppSubmissions is still flakey

    Details

    • Hadoop Flags:
      Reviewed

      Description

      Even after YARN-5057, TestDelegationTokenRenewer#testCancelWithMultipleAppSubmissions is still flakey:

      Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 2.796 sec <<< FAILURE! - in org.apache.hadoop.yarn.server.resourcemanager.security.TestDelegationTokenRenewer
      testCancelWithMultipleAppSubmissions(org.apache.hadoop.yarn.server.resourcemanager.security.TestDelegationTokenRenewer)  Time elapsed: 2.307 sec  <<< FAILURE!
      java.lang.AssertionError: null
      	at org.junit.Assert.fail(Assert.java:86)
      	at org.junit.Assert.assertTrue(Assert.java:41)
      	at org.junit.Assert.assertTrue(Assert.java:52)
      	at org.apache.hadoop.yarn.server.resourcemanager.security.TestDelegationTokenRenewer.testCancelWithMultipleAppSubmissions(TestDelegationTokenRenewer.java:1260)
      

      Note that it's the same error as YARN-5057, but on a different line.

        Activity

        Hide
        bibinchundatt Bibin A Chundatt added a comment -

        Attaching logs of local failure found during YARN-3884 test case failure analysis. Ajith S could you provide patch for the jira

        Show
        bibinchundatt Bibin A Chundatt added a comment - Attaching logs of local failure found during YARN-3884 test case failure analysis. Ajith S could you provide patch for the jira
        Hide
        rchiang Ray Chiang added a comment -

        Ajith S or Bibin A Chundatt, can we get this done in time for Hadoop 3 beta 1?

        Show
        rchiang Ray Chiang added a comment - Ajith S or Bibin A Chundatt , can we get this done in time for Hadoop 3 beta 1?
        Hide
        rkanter Robert Kanter added a comment -

        Sounds like it's okay if I take this over.

        Show
        rkanter Robert Kanter added a comment - Sounds like it's okay if I take this over.
        Hide
        rkanter Robert Kanter added a comment -

        Like many flakey tests, this issue is due to timing. The test is expecting a token to be canceled, and it is, but some of the assert statements need more time before they can pass. The patch adds some waitFor blocks to help with this. I ran the test 50 times and it passes every time now. Without the changes, it would fail pretty much every time for me.

        Show
        rkanter Robert Kanter added a comment - Like many flakey tests, this issue is due to timing. The test is expecting a token to be canceled, and it is, but some of the assert statements need more time before they can pass. The patch adds some waitFor blocks to help with this. I ran the test 50 times and it passes every time now. Without the changes, it would fail pretty much every time for me.
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 17s Docker mode activated.
              Prechecks
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
              trunk Compile Tests
        +1 mvninstall 16m 12s trunk passed
        +1 compile 0m 38s trunk passed
        +1 checkstyle 0m 27s trunk passed
        +1 mvnsite 0m 40s trunk passed
        +1 findbugs 1m 1s trunk passed
        +1 javadoc 0m 25s trunk passed
              Patch Compile Tests
        +1 mvninstall 0m 35s the patch passed
        +1 compile 0m 33s the patch passed
        +1 javac 0m 33s the patch passed
        +1 checkstyle 0m 24s the patch passed
        +1 mvnsite 0m 38s the patch passed
        +1 whitespace 0m 0s The patch has no whitespace issues.
        +1 findbugs 1m 11s the patch passed
        +1 javadoc 0m 19s the patch passed
              Other Tests
        -1 unit 45m 43s hadoop-yarn-server-resourcemanager in the patch failed.
        +1 asflicense 0m 18s The patch does not generate ASF License warnings.
        70m 36s



        Reason Tests
        Failed junit tests hadoop.yarn.server.resourcemanager.scheduler.capacity.TestContainerAllocation



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:14b5c93
        JIRA Issue YARN-5816
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12884101/YARN-5816.001.patch
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
        uname Linux f8f43994dc79 3.13.0-116-generic #163-Ubuntu SMP Fri Mar 31 14:13:22 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / 51881a8
        Default Java 1.8.0_144
        findbugs v3.1.0-RC1
        unit https://builds.apache.org/job/PreCommit-YARN-Build/17156/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
        Test Results https://builds.apache.org/job/PreCommit-YARN-Build/17156/testReport/
        modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager
        Console output https://builds.apache.org/job/PreCommit-YARN-Build/17156/console
        Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 17s Docker mode activated.       Prechecks +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.       trunk Compile Tests +1 mvninstall 16m 12s trunk passed +1 compile 0m 38s trunk passed +1 checkstyle 0m 27s trunk passed +1 mvnsite 0m 40s trunk passed +1 findbugs 1m 1s trunk passed +1 javadoc 0m 25s trunk passed       Patch Compile Tests +1 mvninstall 0m 35s the patch passed +1 compile 0m 33s the patch passed +1 javac 0m 33s the patch passed +1 checkstyle 0m 24s the patch passed +1 mvnsite 0m 38s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 findbugs 1m 11s the patch passed +1 javadoc 0m 19s the patch passed       Other Tests -1 unit 45m 43s hadoop-yarn-server-resourcemanager in the patch failed. +1 asflicense 0m 18s The patch does not generate ASF License warnings. 70m 36s Reason Tests Failed junit tests hadoop.yarn.server.resourcemanager.scheduler.capacity.TestContainerAllocation Subsystem Report/Notes Docker Image:yetus/hadoop:14b5c93 JIRA Issue YARN-5816 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12884101/YARN-5816.001.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux f8f43994dc79 3.13.0-116-generic #163-Ubuntu SMP Fri Mar 31 14:13:22 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 51881a8 Default Java 1.8.0_144 findbugs v3.1.0-RC1 unit https://builds.apache.org/job/PreCommit-YARN-Build/17156/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/17156/testReport/ modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager Console output https://builds.apache.org/job/PreCommit-YARN-Build/17156/console Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
        Hide
        rkanter Robert Kanter added a comment -

        Test failure is unrelated - YARN-7044.

        Show
        rkanter Robert Kanter added a comment - Test failure is unrelated - YARN-7044 .
        Hide
        jlowe Jason Lowe added a comment -

        Thanks for the patch!

        +1 lgtm. Committing this.

        Show
        jlowe Jason Lowe added a comment - Thanks for the patch! +1 lgtm. Committing this.
        Hide
        jlowe Jason Lowe added a comment -

        Thanks, Robert! I committed this to trunk and branch-2.

        Show
        jlowe Jason Lowe added a comment - Thanks, Robert! I committed this to trunk and branch-2.
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12260 (See https://builds.apache.org/job/Hadoop-trunk-Commit/12260/)
        YARN-5816. (jlowe: rev 1f6dc4ee9a3ae38f7da2a768e07570f53002cdd2)

        • (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/security/TestDelegationTokenRenewer.java
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12260 (See https://builds.apache.org/job/Hadoop-trunk-Commit/12260/ ) YARN-5816 . (jlowe: rev 1f6dc4ee9a3ae38f7da2a768e07570f53002cdd2) (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/security/TestDelegationTokenRenewer.java

          People

          • Assignee:
            rkanter Robert Kanter
            Reporter:
            templedf Daniel Templeton
          • Votes:
            0 Vote for this issue
            Watchers:
            16 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development