Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-13375

o.a.h.security.TestGroupsCaching.testBackgroundRefreshCounters seems flaky

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.8.0
    • Fix Version/s: 2.8.0, 3.0.0-alpha2
    • Component/s: security, test
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Error Message

      expected:<1> but was:<0>

      Stacktrace

      java.lang.AssertionError: expected:<1> but was:<0>
      at org.junit.Assert.fail(Assert.java:88)
      at org.junit.Assert.failNotEquals(Assert.java:743)
      at org.junit.Assert.assertEquals(Assert.java:118)
      at org.junit.Assert.assertEquals(Assert.java:555)
      at org.junit.Assert.assertEquals(Assert.java:542)
      at org.apache.hadoop.security.TestGroupsCaching.testBackgroundRefreshCounters(TestGroupsCaching.java:638)

      1. HADOOP-13375.007.patch
        8 kB
        Weiwei Yang
      2. HADOOP-13375.006.patch
        8 kB
        Weiwei Yang
      3. HADOOP-13375.005.patch
        8 kB
        Weiwei Yang
      4. HADOOP-13375.004.patch
        8 kB
        Weiwei Yang
      5. HADOOP-13375.003.patch
        6 kB
        Weiwei Yang
      6. HADOOP-13375.002.patch
        6 kB
        Yuanbo Liu
      7. HADOOP-13375.001.patch
        6 kB
        Yuanbo Liu

        Issue Links

          Activity

          Hide
          andrew.wang Andrew Wang added a comment -

          Gentle reminder to please include the appropriate 3.0.0 fix version when committing to trunk, thanks!

          Show
          andrew.wang Andrew Wang added a comment - Gentle reminder to please include the appropriate 3.0.0 fix version when committing to trunk, thanks!
          Hide
          cheersyang Weiwei Yang added a comment -

          Thanks a lot Mingliang Liu

          Show
          cheersyang Weiwei Yang added a comment - Thanks a lot Mingliang Liu
          Hide
          liuml07 Mingliang Liu added a comment -

          Committted to trunk, branch-2, and branch-2.8. Thanks for your work, Weiwei Yang.

          Show
          liuml07 Mingliang Liu added a comment - Committted to trunk , branch-2 , and branch-2.8 . Thanks for your work, Weiwei Yang .
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10384 (See https://builds.apache.org/job/Hadoop-trunk-Commit/10384/)
          HADOOP-13375. (liuml07: rev dcd21d083ab2a66fc3ca3bfda03887461698b7b1)

          • (edit) hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/TestGroupsCaching.java
          • (edit) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/Groups.java
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10384 (See https://builds.apache.org/job/Hadoop-trunk-Commit/10384/ ) HADOOP-13375 . (liuml07: rev dcd21d083ab2a66fc3ca3bfda03887461698b7b1) (edit) hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/TestGroupsCaching.java (edit) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/Groups.java
          Hide
          hadoopqa Hadoop QA added a comment -
          +1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 20s Docker mode activated.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
          +1 mvninstall 6m 48s trunk passed
          +1 compile 7m 23s trunk passed
          +1 checkstyle 0m 24s trunk passed
          +1 mvnsite 0m 54s trunk passed
          +1 mvneclipse 0m 13s trunk passed
          +1 findbugs 1m 21s trunk passed
          +1 javadoc 0m 46s trunk passed
          +1 mvninstall 0m 38s the patch passed
          +1 compile 6m 46s the patch passed
          +1 javac 6m 46s the patch passed
          +1 checkstyle 0m 22s the patch passed
          +1 mvnsite 0m 52s the patch passed
          +1 mvneclipse 0m 13s the patch passed
          +1 whitespace 0m 0s The patch has no whitespace issues.
          +1 findbugs 1m 27s the patch passed
          +1 javadoc 0m 45s the patch passed
          +1 unit 8m 14s hadoop-common in the patch passed.
          +1 asflicense 0m 21s The patch does not generate ASF License warnings.
          39m 12s



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:9560f25
          JIRA Issue HADOOP-13375
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12826585/HADOOP-13375.007.patch
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
          uname Linux 2628cdd3c816 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision trunk / 08f55cc
          Default Java 1.8.0_101
          findbugs v3.0.0
          Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/10437/testReport/
          modules C: hadoop-common-project/hadoop-common U: hadoop-common-project/hadoop-common
          Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/10437/console
          Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - +1 overall Vote Subsystem Runtime Comment 0 reexec 0m 20s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. +1 mvninstall 6m 48s trunk passed +1 compile 7m 23s trunk passed +1 checkstyle 0m 24s trunk passed +1 mvnsite 0m 54s trunk passed +1 mvneclipse 0m 13s trunk passed +1 findbugs 1m 21s trunk passed +1 javadoc 0m 46s trunk passed +1 mvninstall 0m 38s the patch passed +1 compile 6m 46s the patch passed +1 javac 6m 46s the patch passed +1 checkstyle 0m 22s the patch passed +1 mvnsite 0m 52s the patch passed +1 mvneclipse 0m 13s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 findbugs 1m 27s the patch passed +1 javadoc 0m 45s the patch passed +1 unit 8m 14s hadoop-common in the patch passed. +1 asflicense 0m 21s The patch does not generate ASF License warnings. 39m 12s Subsystem Report/Notes Docker Image:yetus/hadoop:9560f25 JIRA Issue HADOOP-13375 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12826585/HADOOP-13375.007.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux 2628cdd3c816 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 08f55cc Default Java 1.8.0_101 findbugs v3.0.0 Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/10437/testReport/ modules C: hadoop-common-project/hadoop-common U: hadoop-common-project/hadoop-common Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/10437/console Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
          Hide
          cheersyang Weiwei Yang added a comment -

          Hello Mingliang Liu

          Sorry I missed your 1st comment earlier. Regarding to your concern, it doesn't bother me too much because

          • The only method used in multiple threads is latch.await(), this doesn't change latch's state.
          • FakeGroupMapping.resume() changes the state but it is only called in main thread.

          So I don't think there will be any thread safety issues. I agree to add volatile that makes sense, so I added it in v7 patch so I am good for either ways. Appreciate your thoroughly review!

          Show
          cheersyang Weiwei Yang added a comment - Hello Mingliang Liu Sorry I missed your 1st comment earlier. Regarding to your concern, it doesn't bother me too much because The only method used in multiple threads is latch.await() , this doesn't change latch's state. FakeGroupMapping.resume() changes the state but it is only called in main thread. So I don't think there will be any thread safety issues. I agree to add volatile that makes sense, so I added it in v7 patch so I am good for either ways. Appreciate your thoroughly review!
          Hide
          liuml07 Mingliang Liu added a comment -

          I see the v6 patch addressed the 2 and 3 comments. For the 1st one, can you double check that latch is being defined/used by multiple threads safely? If it's volatile it makes more sense to me, or else please explain briefly why. Thanks.

          Show
          liuml07 Mingliang Liu added a comment - I see the v6 patch addressed the 2 and 3 comments. For the 1st one, can you double check that latch is being defined/used by multiple threads safely? If it's volatile it makes more sense to me, or else please explain briefly why. Thanks.
          Hide
          hadoopqa Hadoop QA added a comment -
          +1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 19s Docker mode activated.
          +1 @author 0m 1s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
          +1 mvninstall 6m 47s trunk passed
          +1 compile 6m 51s trunk passed
          +1 checkstyle 0m 23s trunk passed
          +1 mvnsite 0m 53s trunk passed
          +1 mvneclipse 0m 12s trunk passed
          +1 findbugs 1m 17s trunk passed
          +1 javadoc 0m 45s trunk passed
          +1 mvninstall 0m 37s the patch passed
          +1 compile 6m 48s the patch passed
          +1 javac 6m 48s the patch passed
          +1 checkstyle 0m 23s the patch passed
          +1 mvnsite 0m 51s the patch passed
          +1 mvneclipse 0m 12s the patch passed
          +1 whitespace 0m 0s The patch has no whitespace issues.
          +1 findbugs 1m 28s the patch passed
          +1 javadoc 0m 45s the patch passed
          +1 unit 8m 13s hadoop-common in the patch passed.
          +1 asflicense 0m 22s The patch does not generate ASF License warnings.
          38m 33s



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:9560f25
          JIRA Issue HADOOP-13375
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12826548/HADOOP-13375.006.patch
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
          uname Linux e1604d91ea49 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision trunk / 6f4b0d3
          Default Java 1.8.0_101
          findbugs v3.0.0
          Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/10434/testReport/
          modules C: hadoop-common-project/hadoop-common U: hadoop-common-project/hadoop-common
          Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/10434/console
          Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - +1 overall Vote Subsystem Runtime Comment 0 reexec 0m 19s Docker mode activated. +1 @author 0m 1s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. +1 mvninstall 6m 47s trunk passed +1 compile 6m 51s trunk passed +1 checkstyle 0m 23s trunk passed +1 mvnsite 0m 53s trunk passed +1 mvneclipse 0m 12s trunk passed +1 findbugs 1m 17s trunk passed +1 javadoc 0m 45s trunk passed +1 mvninstall 0m 37s the patch passed +1 compile 6m 48s the patch passed +1 javac 6m 48s the patch passed +1 checkstyle 0m 23s the patch passed +1 mvnsite 0m 51s the patch passed +1 mvneclipse 0m 12s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 findbugs 1m 28s the patch passed +1 javadoc 0m 45s the patch passed +1 unit 8m 13s hadoop-common in the patch passed. +1 asflicense 0m 22s The patch does not generate ASF License warnings. 38m 33s Subsystem Report/Notes Docker Image:yetus/hadoop:9560f25 JIRA Issue HADOOP-13375 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12826548/HADOOP-13375.006.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux e1604d91ea49 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 6f4b0d3 Default Java 1.8.0_101 findbugs v3.0.0 Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/10434/testReport/ modules C: hadoop-common-project/hadoop-common U: hadoop-common-project/hadoop-common Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/10434/console Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
          Hide
          cheersyang Weiwei Yang added a comment -

          The error in mvninstall is (from component hadoop-yarn-server-timelineservice)

          Failed to execute goal org.apache.maven.plugins:maven-remote-resources-plugin:1.5:process (default) on project hadoop-yarn-server-timelineservice: Error resolving project artifact: Could not transfer artifact sqlline:sqlline:pom:1.1.8 from/to repository.jboss.org
          

          is this a jenkins issue? Let me submit a new (but same) patch to trigger a new jenkins job. See if this only happens this time.

          Show
          cheersyang Weiwei Yang added a comment - The error in mvninstall is (from component hadoop-yarn-server-timelineservice) Failed to execute goal org.apache.maven.plugins:maven-remote-resources-plugin:1.5:process ( default ) on project hadoop-yarn-server-timelineservice: Error resolving project artifact: Could not transfer artifact sqlline:sqlline:pom:1.1.8 from/to repository.jboss.org is this a jenkins issue? Let me submit a new (but same) patch to trigger a new jenkins job. See if this only happens this time.
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 11s Docker mode activated.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
          -1 mvninstall 5m 40s root in trunk failed.
          +1 compile 9m 26s trunk passed
          +1 checkstyle 0m 23s trunk passed
          +1 mvnsite 0m 55s trunk passed
          +1 mvneclipse 0m 13s trunk passed
          +1 findbugs 1m 19s trunk passed
          +1 javadoc 0m 44s trunk passed
          +1 mvninstall 0m 36s the patch passed
          +1 compile 6m 45s the patch passed
          +1 javac 6m 45s the patch passed
          +1 checkstyle 0m 22s the patch passed
          +1 mvnsite 0m 51s the patch passed
          +1 mvneclipse 0m 13s the patch passed
          +1 whitespace 0m 0s The patch has no whitespace issues.
          +1 findbugs 1m 26s the patch passed
          +1 javadoc 0m 45s the patch passed
          +1 unit 7m 13s hadoop-common in the patch passed.
          +1 asflicense 0m 23s The patch does not generate ASF License warnings.
          38m 50s



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:9560f25
          JIRA Issue HADOOP-13375
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12826542/HADOOP-13375.005.patch
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
          uname Linux 275a8f119c3c 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision trunk / 6f4b0d3
          Default Java 1.8.0_101
          mvninstall https://builds.apache.org/job/PreCommit-HADOOP-Build/10433/artifact/patchprocess/branch-mvninstall-root.txt
          findbugs v3.0.0
          Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/10433/testReport/
          modules C: hadoop-common-project/hadoop-common U: hadoop-common-project/hadoop-common
          Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/10433/console
          Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 11s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. -1 mvninstall 5m 40s root in trunk failed. +1 compile 9m 26s trunk passed +1 checkstyle 0m 23s trunk passed +1 mvnsite 0m 55s trunk passed +1 mvneclipse 0m 13s trunk passed +1 findbugs 1m 19s trunk passed +1 javadoc 0m 44s trunk passed +1 mvninstall 0m 36s the patch passed +1 compile 6m 45s the patch passed +1 javac 6m 45s the patch passed +1 checkstyle 0m 22s the patch passed +1 mvnsite 0m 51s the patch passed +1 mvneclipse 0m 13s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 findbugs 1m 26s the patch passed +1 javadoc 0m 45s the patch passed +1 unit 7m 13s hadoop-common in the patch passed. +1 asflicense 0m 23s The patch does not generate ASF License warnings. 38m 50s Subsystem Report/Notes Docker Image:yetus/hadoop:9560f25 JIRA Issue HADOOP-13375 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12826542/HADOOP-13375.005.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux 275a8f119c3c 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 6f4b0d3 Default Java 1.8.0_101 mvninstall https://builds.apache.org/job/PreCommit-HADOOP-Build/10433/artifact/patchprocess/branch-mvninstall-root.txt findbugs v3.0.0 Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/10433/testReport/ modules C: hadoop-common-project/hadoop-common U: hadoop-common-project/hadoop-common Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/10433/console Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
          Hide
          liuml07 Mingliang Liu added a comment -

          The v4 patch looks good. +1 once the following minor comments are addressed/considered:

          1. Should the latch be volatile?
          2. if(latch != null && latch.getCount() > 0) { seems we don't have to check the getCount() before await()
          3. // After 120ms all should have completed running can be deleted as it's not true in the current patch any longer
          Show
          liuml07 Mingliang Liu added a comment - The v4 patch looks good. +1 once the following minor comments are addressed/considered: Should the latch be volatile? if(latch != null && latch.getCount() > 0) { seems we don't have to check the getCount() before await() // After 120ms all should have completed running can be deleted as it's not true in the current patch any longer
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 17s Docker mode activated.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
          +1 mvninstall 7m 47s trunk passed
          +1 compile 6m 48s trunk passed
          +1 checkstyle 0m 22s trunk passed
          +1 mvnsite 0m 53s trunk passed
          +1 mvneclipse 0m 12s trunk passed
          +1 findbugs 1m 19s trunk passed
          +1 javadoc 0m 45s trunk passed
          +1 mvninstall 0m 37s the patch passed
          +1 compile 6m 50s the patch passed
          +1 javac 6m 50s the patch passed
          +1 checkstyle 0m 22s the patch passed
          +1 mvnsite 0m 52s the patch passed
          +1 mvneclipse 0m 12s the patch passed
          +1 whitespace 0m 0s The patch has no whitespace issues.
          +1 findbugs 1m 25s the patch passed
          +1 javadoc 0m 45s the patch passed
          -1 unit 17m 5s hadoop-common in the patch failed.
          +1 asflicense 0m 21s The patch does not generate ASF License warnings.
          48m 18s



          Reason Tests
          Timed out junit tests org.apache.hadoop.http.TestHttpServerLifecycle



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:9560f25
          JIRA Issue HADOOP-13375
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12826451/HADOOP-13375.004.patch
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
          uname Linux e80962b71875 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision trunk / 20ae1fa
          Default Java 1.8.0_101
          findbugs v3.0.0
          unit https://builds.apache.org/job/PreCommit-HADOOP-Build/10430/artifact/patchprocess/patch-unit-hadoop-common-project_hadoop-common.txt
          Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/10430/testReport/
          modules C: hadoop-common-project/hadoop-common U: hadoop-common-project/hadoop-common
          Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/10430/console
          Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 17s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. +1 mvninstall 7m 47s trunk passed +1 compile 6m 48s trunk passed +1 checkstyle 0m 22s trunk passed +1 mvnsite 0m 53s trunk passed +1 mvneclipse 0m 12s trunk passed +1 findbugs 1m 19s trunk passed +1 javadoc 0m 45s trunk passed +1 mvninstall 0m 37s the patch passed +1 compile 6m 50s the patch passed +1 javac 6m 50s the patch passed +1 checkstyle 0m 22s the patch passed +1 mvnsite 0m 52s the patch passed +1 mvneclipse 0m 12s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 findbugs 1m 25s the patch passed +1 javadoc 0m 45s the patch passed -1 unit 17m 5s hadoop-common in the patch failed. +1 asflicense 0m 21s The patch does not generate ASF License warnings. 48m 18s Reason Tests Timed out junit tests org.apache.hadoop.http.TestHttpServerLifecycle Subsystem Report/Notes Docker Image:yetus/hadoop:9560f25 JIRA Issue HADOOP-13375 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12826451/HADOOP-13375.004.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux e80962b71875 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 20ae1fa Default Java 1.8.0_101 findbugs v3.0.0 unit https://builds.apache.org/job/PreCommit-HADOOP-Build/10430/artifact/patchprocess/patch-unit-hadoop-common-project_hadoop-common.txt Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/10430/testReport/ modules C: hadoop-common-project/hadoop-common U: hadoop-common-project/hadoop-common Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/10430/console Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
          Hide
          cheersyang Weiwei Yang added a comment -

          Hello Mingliang Liu

          Thanks for the comments. Well I can't say that the case in your concern won't happen, it may fail that way in slightly chance. So I modified the delayIfNecessary method a little bit to let it be able to pause and wait for notification (using a latch). In this way we will not need to sleep anymore and just pause the thread, do verify, resume the thread, then verify again.

          Please help to review v4 patch, and let me know if it looks good or not. Thanks a lot.

          Show
          cheersyang Weiwei Yang added a comment - Hello Mingliang Liu Thanks for the comments. Well I can't say that the case in your concern won't happen, it may fail that way in slightly chance. So I modified the delayIfNecessary method a little bit to let it be able to pause and wait for notification (using a latch). In this way we will not need to sleep anymore and just pause the thread, do verify, resume the thread, then verify again. Please help to review v4 patch, and let me know if it looks good or not. Thanks a lot.
          Hide
          liuml07 Mingliang Liu added a comment -

          The v3 patch looks good overall to me.

          This turns out a non-trivial fix for the test. My last concern is about the

          624	    waitForGroupCounters(groups, 3, 2, 0, 0);
          625
          626	    // After 120ms all should have completed running
          627	    waitForGroupCounters(groups, 0, 0, 5, 0);
          

          If the background reload threads run really fast (and the main test thread is preempted somehow), is it possible that the main test thread misses the first point of condition and fails? If true, we can:

          1. coordinate the maint test thread and the FakeGroupMapping#delayIfNecessary() using latch or barrier
          2. or simply to increase the delay interval FakeGroupMapping.setGetGroupsDelayMs(40); and the time out in waitForGroupCounters() so that the chance of failure is largely reduced.
          Show
          liuml07 Mingliang Liu added a comment - The v3 patch looks good overall to me. This turns out a non-trivial fix for the test. My last concern is about the 624 waitForGroupCounters(groups, 3, 2, 0, 0); 625 626 // After 120ms all should have completed running 627 waitForGroupCounters(groups, 0, 0, 5, 0); If the background reload threads run really fast (and the main test thread is preempted somehow), is it possible that the main test thread misses the first point of condition and fails? If true, we can: coordinate the maint test thread and the FakeGroupMapping#delayIfNecessary() using latch or barrier or simply to increase the delay interval FakeGroupMapping.setGetGroupsDelayMs(40); and the time out in waitForGroupCounters() so that the chance of failure is largely reduced.
          Hide
          hadoopqa Hadoop QA added a comment -
          +1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 17s Docker mode activated.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
          +1 mvninstall 6m 49s trunk passed
          +1 compile 6m 48s trunk passed
          +1 checkstyle 0m 23s trunk passed
          +1 mvnsite 0m 54s trunk passed
          +1 mvneclipse 0m 12s trunk passed
          +1 findbugs 1m 20s trunk passed
          +1 javadoc 0m 44s trunk passed
          +1 mvninstall 0m 37s the patch passed
          +1 compile 6m 44s the patch passed
          +1 javac 6m 44s the patch passed
          +1 checkstyle 0m 22s the patch passed
          +1 mvnsite 0m 51s the patch passed
          +1 mvneclipse 0m 12s the patch passed
          +1 whitespace 0m 0s The patch has no whitespace issues.
          +1 findbugs 1m 27s the patch passed
          +1 javadoc 0m 45s the patch passed
          +1 unit 8m 57s hadoop-common in the patch passed.
          +1 asflicense 0m 22s The patch does not generate ASF License warnings.
          39m 8s



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:9560f25
          JIRA Issue HADOOP-13375
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12825751/HADOOP-13375.003.patch
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
          uname Linux a38c356ae098 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision trunk / 19c743c
          Default Java 1.8.0_101
          findbugs v3.0.0
          Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/10392/testReport/
          modules C: hadoop-common-project/hadoop-common U: hadoop-common-project/hadoop-common
          Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/10392/console
          Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - +1 overall Vote Subsystem Runtime Comment 0 reexec 0m 17s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. +1 mvninstall 6m 49s trunk passed +1 compile 6m 48s trunk passed +1 checkstyle 0m 23s trunk passed +1 mvnsite 0m 54s trunk passed +1 mvneclipse 0m 12s trunk passed +1 findbugs 1m 20s trunk passed +1 javadoc 0m 44s trunk passed +1 mvninstall 0m 37s the patch passed +1 compile 6m 44s the patch passed +1 javac 6m 44s the patch passed +1 checkstyle 0m 22s the patch passed +1 mvnsite 0m 51s the patch passed +1 mvneclipse 0m 12s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 findbugs 1m 27s the patch passed +1 javadoc 0m 45s the patch passed +1 unit 8m 57s hadoop-common in the patch passed. +1 asflicense 0m 22s The patch does not generate ASF License warnings. 39m 8s Subsystem Report/Notes Docker Image:yetus/hadoop:9560f25 JIRA Issue HADOOP-13375 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12825751/HADOOP-13375.003.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux a38c356ae098 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 19c743c Default Java 1.8.0_101 findbugs v3.0.0 Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/10392/testReport/ modules C: hadoop-common-project/hadoop-common U: hadoop-common-project/hadoop-common Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/10392/console Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
          Hide
          cheersyang Weiwei Yang added a comment -

          Hello Mingliang Liu

          Thanks for pointing this out, the utility class is quite useful. I just uploaded v3 patch to address these changes. Thanks!

          Show
          cheersyang Weiwei Yang added a comment - Hello Mingliang Liu Thanks for pointing this out, the utility class is quite useful. I just uploaded v3 patch to address these changes. Thanks!
          Hide
          liuml07 Mingliang Liu added a comment -

          Thanks for the patch, Weiwei Yang. And welcome to Hadoop contributors.

          I think the retry of check makes sense here.

          1. Can we replace waitOnExpectedValue() with GenericTestUtils.waitFor()? See the Über-jira HDFS-10666 for usages in other cases.
          2. Should we group the related assertions as a single wait-for condition? e.g.
            626	    assertEquals(groups.getBackgroundRefreshQueued(), 0);		
            627	    assertEquals(groups.getBackgroundRefreshRunning(), 0);		
            628	    assertEquals(groups.getBackgroundRefreshSuccess(), 5);
            

            are actually multiple state variables of the same condition. This may make the code changes simpler.

            GenericTestUtils.waitFor(...
              ...
               return groups.getBackgroundRefreshQueued() == 0 &&
                      groups.getBackgroundRefreshRunning() == 0 &&
                      groups.getBackgroundRefreshSuccess() == 5;
              ...
            );
            
          Show
          liuml07 Mingliang Liu added a comment - Thanks for the patch, Weiwei Yang . And welcome to Hadoop contributors. I think the retry of check makes sense here. Can we replace waitOnExpectedValue() with GenericTestUtils.waitFor() ? See the Über-jira HDFS-10666 for usages in other cases. Should we group the related assertions as a single wait-for condition? e.g. 626 assertEquals(groups.getBackgroundRefreshQueued(), 0); 627 assertEquals(groups.getBackgroundRefreshRunning(), 0); 628 assertEquals(groups.getBackgroundRefreshSuccess(), 5); are actually multiple state variables of the same condition. This may make the code changes simpler. GenericTestUtils.waitFor(... ... return groups.getBackgroundRefreshQueued() == 0 && groups.getBackgroundRefreshRunning() == 0 && groups.getBackgroundRefreshSuccess() == 5; ... );
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 15s Docker mode activated.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
          +1 mvninstall 7m 11s trunk passed
          +1 compile 6m 59s trunk passed
          +1 checkstyle 0m 23s trunk passed
          +1 mvnsite 0m 55s trunk passed
          +1 mvneclipse 0m 13s trunk passed
          +1 findbugs 1m 20s trunk passed
          +1 javadoc 0m 44s trunk passed
          +1 mvninstall 0m 38s the patch passed
          +1 compile 6m 52s the patch passed
          +1 javac 6m 52s the patch passed
          +1 checkstyle 0m 23s the patch passed
          +1 mvnsite 0m 52s the patch passed
          +1 mvneclipse 0m 13s the patch passed
          +1 whitespace 0m 0s The patch has no whitespace issues.
          +1 findbugs 1m 29s the patch passed
          +1 javadoc 0m 45s the patch passed
          -1 unit 19m 52s hadoop-common in the patch failed.
          +1 asflicense 0m 22s The patch does not generate ASF License warnings.
          50m 51s



          Reason Tests
          Timed out junit tests org.apache.hadoop.http.TestHttpServerLifecycle



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:9560f25
          JIRA Issue HADOOP-13375
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12825629/HADOOP-13375.002.patch
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
          uname Linux 282b1d1b320f 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision trunk / 27c3b86
          Default Java 1.8.0_101
          findbugs v3.0.0
          unit https://builds.apache.org/job/PreCommit-HADOOP-Build/10381/artifact/patchprocess/patch-unit-hadoop-common-project_hadoop-common.txt
          Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/10381/testReport/
          modules C: hadoop-common-project/hadoop-common U: hadoop-common-project/hadoop-common
          Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/10381/console
          Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 15s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. +1 mvninstall 7m 11s trunk passed +1 compile 6m 59s trunk passed +1 checkstyle 0m 23s trunk passed +1 mvnsite 0m 55s trunk passed +1 mvneclipse 0m 13s trunk passed +1 findbugs 1m 20s trunk passed +1 javadoc 0m 44s trunk passed +1 mvninstall 0m 38s the patch passed +1 compile 6m 52s the patch passed +1 javac 6m 52s the patch passed +1 checkstyle 0m 23s the patch passed +1 mvnsite 0m 52s the patch passed +1 mvneclipse 0m 13s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 findbugs 1m 29s the patch passed +1 javadoc 0m 45s the patch passed -1 unit 19m 52s hadoop-common in the patch failed. +1 asflicense 0m 22s The patch does not generate ASF License warnings. 50m 51s Reason Tests Timed out junit tests org.apache.hadoop.http.TestHttpServerLifecycle Subsystem Report/Notes Docker Image:yetus/hadoop:9560f25 JIRA Issue HADOOP-13375 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12825629/HADOOP-13375.002.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux 282b1d1b320f 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 27c3b86 Default Java 1.8.0_101 findbugs v3.0.0 unit https://builds.apache.org/job/PreCommit-HADOOP-Build/10381/artifact/patchprocess/patch-unit-hadoop-common-project_hadoop-common.txt Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/10381/testReport/ modules C: hadoop-common-project/hadoop-common U: hadoop-common-project/hadoop-common Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/10381/console Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
          Hide
          yuanbo Yuanbo Liu added a comment -

          Upload v2 patch which is from Weiwei Yang

          Show
          yuanbo Yuanbo Liu added a comment - Upload v2 patch which is from Weiwei Yang
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 17s Docker mode activated.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
          +1 mvninstall 6m 36s trunk passed
          +1 compile 6m 51s trunk passed
          +1 checkstyle 0m 22s trunk passed
          +1 mvnsite 0m 55s trunk passed
          +1 mvneclipse 0m 13s trunk passed
          +1 findbugs 1m 17s trunk passed
          +1 javadoc 0m 45s trunk passed
          +1 mvninstall 0m 36s the patch passed
          +1 compile 6m 45s the patch passed
          +1 javac 6m 45s the patch passed
          -0 checkstyle 0m 23s hadoop-common-project/hadoop-common: The patch generated 13 new + 36 unchanged - 0 fixed = 49 total (was 36)
          +1 mvnsite 0m 51s the patch passed
          +1 mvneclipse 0m 13s the patch passed
          +1 whitespace 0m 0s The patch has no whitespace issues.
          +1 findbugs 1m 26s the patch passed
          +1 javadoc 0m 44s the patch passed
          -1 unit 7m 43s hadoop-common in the patch failed.
          +1 asflicense 0m 21s The patch does not generate ASF License warnings.
          37m 45s



          Reason Tests
          Failed junit tests hadoop.security.ssl.TestSSLFactory



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:9560f25
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12825421/HADOOP-13375.001.patch
          JIRA Issue HADOOP-13375
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
          uname Linux 2dac7207bf9e 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision trunk / ab3b727
          Default Java 1.8.0_101
          findbugs v3.0.0
          checkstyle https://builds.apache.org/job/PreCommit-HADOOP-Build/10367/artifact/patchprocess/diff-checkstyle-hadoop-common-project_hadoop-common.txt
          unit https://builds.apache.org/job/PreCommit-HADOOP-Build/10367/artifact/patchprocess/patch-unit-hadoop-common-project_hadoop-common.txt
          Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/10367/testReport/
          modules C: hadoop-common-project/hadoop-common U: hadoop-common-project/hadoop-common
          Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/10367/console
          Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 17s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. +1 mvninstall 6m 36s trunk passed +1 compile 6m 51s trunk passed +1 checkstyle 0m 22s trunk passed +1 mvnsite 0m 55s trunk passed +1 mvneclipse 0m 13s trunk passed +1 findbugs 1m 17s trunk passed +1 javadoc 0m 45s trunk passed +1 mvninstall 0m 36s the patch passed +1 compile 6m 45s the patch passed +1 javac 6m 45s the patch passed -0 checkstyle 0m 23s hadoop-common-project/hadoop-common: The patch generated 13 new + 36 unchanged - 0 fixed = 49 total (was 36) +1 mvnsite 0m 51s the patch passed +1 mvneclipse 0m 13s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 findbugs 1m 26s the patch passed +1 javadoc 0m 44s the patch passed -1 unit 7m 43s hadoop-common in the patch failed. +1 asflicense 0m 21s The patch does not generate ASF License warnings. 37m 45s Reason Tests Failed junit tests hadoop.security.ssl.TestSSLFactory Subsystem Report/Notes Docker Image:yetus/hadoop:9560f25 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12825421/HADOOP-13375.001.patch JIRA Issue HADOOP-13375 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux 2dac7207bf9e 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / ab3b727 Default Java 1.8.0_101 findbugs v3.0.0 checkstyle https://builds.apache.org/job/PreCommit-HADOOP-Build/10367/artifact/patchprocess/diff-checkstyle-hadoop-common-project_hadoop-common.txt unit https://builds.apache.org/job/PreCommit-HADOOP-Build/10367/artifact/patchprocess/patch-unit-hadoop-common-project_hadoop-common.txt Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/10367/testReport/ modules C: hadoop-common-project/hadoop-common U: hadoop-common-project/hadoop-common Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/10367/console Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
          Hide
          cheersyang Weiwei Yang added a comment -

          Thanks Yuanbo Liu to help upload this patch. Stephen O'Donnell and Mingliang Liu, can you help to review the patch and see if this can fix the problem?

          Show
          cheersyang Weiwei Yang added a comment - Thanks Yuanbo Liu to help upload this patch. Stephen O'Donnell and Mingliang Liu , can you help to review the patch and see if this can fix the problem?
          Hide
          yuanbo Yuanbo Liu added a comment - - edited

          v1 patch is from Weiwei Yang

          Show
          yuanbo Yuanbo Liu added a comment - - edited v1 patch is from Weiwei Yang
          Hide
          cheersyang Weiwei Yang added a comment - - edited

          This issue happens to me as well when I was working on some other issues. It fails quite often as the test case uses rarely small sleep. To get rid of this, I had a patch that to replace those sleep-then-check logic by wait-on-value check, it checks if the counter reaches the expected value in a given timeout, use small interval to reduce the await time. It runs faster than before and never fail again in my test.

          I would love to upload this patch so you guys can help to review and see if it makes sense, but the I don't know why JIRA doesn't allow me to (I fixed several HADOOP issues before).

          Show
          cheersyang Weiwei Yang added a comment - - edited This issue happens to me as well when I was working on some other issues. It fails quite often as the test case uses rarely small sleep. To get rid of this, I had a patch that to replace those sleep-then-check logic by wait-on-value check, it checks if the counter reaches the expected value in a given timeout, use small interval to reduce the await time. It runs faster than before and never fail again in my test. I would love to upload this patch so you guys can help to review and see if it makes sense, but the I don't know why JIRA doesn't allow me to (I fixed several HADOOP issues before).
          Hide
          sodonnell Stephen O'Donnell added a comment -

          Those exceptions going to stderr are expected in that test, as it is testing failed background refreshes. The Guava docs say that exceptions are 'logged and swallowed'. I am hoping that when running outside of junit those logs would be written to the namenode log file and not stderr.

          Show
          sodonnell Stephen O'Donnell added a comment - Those exceptions going to stderr are expected in that test, as it is testing failed background refreshes. The Guava docs say that exceptions are 'logged and swallowed'. I am hoping that when running outside of junit those logs would be written to the namenode log file and not stderr.
          Hide
          sodonnell Stephen O'Donnell added a comment -

          I'll try to get a look at this - we had concerns that the sleeps in the tests were troublesome, but I copied the pattern in the existing tests when adding the new ones. I'm open to any good ideas about how to factor the sleeps out of the tests, and I'll have a think about it myself too.

          Show
          sodonnell Stephen O'Donnell added a comment - I'll try to get a look at this - we had concerns that the sleeps in the tests were troublesome, but I copied the pattern in the existing tests when adding the new ones. I'm open to any good ideas about how to factor the sleeps out of the tests, and I'll have a think about it myself too.
          Hide
          liuml07 Mingliang Liu added a comment -

          I think this has something to do with the sleep timing. Stephen O'Donnell do you have any idea? Thanks.

          Show
          liuml07 Mingliang Liu added a comment - I think this has something to do with the sleep timing. Stephen O'Donnell do you have any idea? Thanks.
          Hide
          liuml07 Mingliang Liu added a comment -
          Standard Error

          Jul 08, 2016 3:25:28 AM com.google.common.cache.LocalCache$Segment$1 run
          WARNING: Exception thrown during refresh
          java.util.concurrent.ExecutionException: java.io.IOException: For test
          at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:252)
          at java.util.concurrent.FutureTask.get(FutureTask.java:111)
          at com.google.common.util.concurrent.Uninterruptibles.getUninterruptibly(Uninterruptibles.java:132)
          at com.google.common.cache.LocalCache$Segment.getAndRecordStats(LocalCache.java:2381)
          at com.google.common.cache.LocalCache$Segment$1.run(LocalCache.java:2362)
          at com.google.common.util.concurrent.MoreExecutors$SameThreadExecutorService.execute(MoreExecutors.java:253)
          at com.google.common.util.concurrent.ExecutionList$RunnableExecutorPair.execute(ExecutionList.java:149)
          at com.google.common.util.concurrent.ExecutionList.execute(ExecutionList.java:134)
          at com.google.common.util.concurrent.ListenableFutureTask.done(ListenableFutureTask.java:86)
          at java.util.concurrent.FutureTask$Sync.innerSetException(FutureTask.java:302)
          at java.util.concurrent.FutureTask.setException(FutureTask.java:153)
          at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:336)
          at java.util.concurrent.FutureTask.run(FutureTask.java:166)
          at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
          at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
          at java.lang.Thread.run(Thread.java:722)
          Caused by: java.io.IOException: For test
          at org.apache.hadoop.security.TestGroupsCaching$FakeGroupMapping.getGroups(TestGroupsCaching.java:79)
          at org.apache.hadoop.security.Groups$GroupCacheLoader.fetchGroupList(Groups.java:356)
          at org.apache.hadoop.security.Groups$GroupCacheLoader.load(Groups.java:299)
          at org.apache.hadoop.security.Groups$GroupCacheLoader$1.call(Groups.java:335)
          at org.apache.hadoop.security.Groups$GroupCacheLoader$1.call(Groups.java:328)
          at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
          ... 4 more

          Jul 08, 2016 3:25:28 AM com.google.common.cache.LocalCache$Segment$1 run
          WARNING: Exception thrown during refresh
          java.util.concurrent.ExecutionException: java.io.IOException: For test
          at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:252)
          at java.util.concurrent.FutureTask.get(FutureTask.java:111)
          at com.google.common.util.concurrent.Uninterruptibles.getUninterruptibly(Uninterruptibles.java:132)
          at com.google.common.cache.LocalCache$Segment.getAndRecordStats(LocalCache.java:2381)
          at com.google.common.cache.LocalCache$Segment$1.run(LocalCache.java:2362)
          at com.google.common.util.concurrent.MoreExecutors$SameThreadExecutorService.execute(MoreExecutors.java:253)
          at com.google.common.util.concurrent.ExecutionList$RunnableExecutorPair.execute(ExecutionList.java:149)
          at com.google.common.util.concurrent.ExecutionList.execute(ExecutionList.java:134)
          at com.google.common.util.concurrent.ListenableFutureTask.done(ListenableFutureTask.java:86)
          at java.util.concurrent.FutureTask$Sync.innerSetException(FutureTask.java:302)
          at java.util.concurrent.FutureTask.setException(FutureTask.java:153)
          at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:336)
          at java.util.concurrent.FutureTask.run(FutureTask.java:166)
          at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
          at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
          at java.lang.Thread.run(Thread.java:722)
          Caused by: java.io.IOException: For test
          at org.apache.hadoop.security.TestGroupsCaching$FakeGroupMapping.getGroups(TestGroupsCaching.java:79)
          at org.apache.hadoop.security.Groups$GroupCacheLoader.fetchGroupList(Groups.java:356)
          at org.apache.hadoop.security.Groups$GroupCacheLoader.load(Groups.java:299)
          at org.apache.hadoop.security.Groups$GroupCacheLoader$1.call(Groups.java:335)
          at org.apache.hadoop.security.Groups$GroupCacheLoader$1.call(Groups.java:328)
          at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
          ... 4 more

          Jul 08, 2016 3:25:28 AM com.google.common.cache.LocalCache$Segment$1 run
          WARNING: Exception thrown during refresh
          java.util.concurrent.ExecutionException: java.io.IOException: For test
          at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:252)
          at java.util.concurrent.FutureTask.get(FutureTask.java:111)
          at com.google.common.util.concurrent.Uninterruptibles.getUninterruptibly(Uninterruptibles.java:132)
          at com.google.common.cache.LocalCache$Segment.getAndRecordStats(LocalCache.java:2381)
          at com.google.common.cache.LocalCache$Segment$1.run(LocalCache.java:2362)
          at com.google.common.util.concurrent.MoreExecutors$SameThreadExecutorService.execute(MoreExecutors.java:253)
          at com.google.common.util.concurrent.ExecutionList$RunnableExecutorPair.execute(ExecutionList.java:149)
          at com.google.common.util.concurrent.ExecutionList.execute(ExecutionList.java:134)
          at com.google.common.util.concurrent.ListenableFutureTask.done(ListenableFutureTask.java:86)
          at java.util.concurrent.FutureTask$Sync.innerSetException(FutureTask.java:302)
          at java.util.concurrent.FutureTask.setException(FutureTask.java:153)
          at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:336)
          at java.util.concurrent.FutureTask.run(FutureTask.java:166)
          at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
          at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
          at java.lang.Thread.run(Thread.java:722)
          Caused by: java.io.IOException: For test
          at org.apache.hadoop.security.TestGroupsCaching$FakeGroupMapping.getGroups(TestGroupsCaching.java:79)
          at org.apache.hadoop.security.Groups$GroupCacheLoader.fetchGroupList(Groups.java:356)
          at org.apache.hadoop.security.Groups$GroupCacheLoader.load(Groups.java:299)
          at org.apache.hadoop.security.Groups$GroupCacheLoader$1.call(Groups.java:335)
          at org.apache.hadoop.security.Groups$GroupCacheLoader$1.call(Groups.java:328)
          at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
          ... 4 more

          Jul 08, 2016 3:25:28 AM com.google.common.cache.LocalCache$Segment$1 run
          WARNING: Exception thrown during refresh
          java.util.concurrent.ExecutionException: java.io.IOException: For test
          at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:252)
          at java.util.concurrent.FutureTask.get(FutureTask.java:111)
          at com.google.common.util.concurrent.Uninterruptibles.getUninterruptibly(Uninterruptibles.java:132)
          at com.google.common.cache.LocalCache$Segment.getAndRecordStats(LocalCache.java:2381)
          at com.google.common.cache.LocalCache$Segment$1.run(LocalCache.java:2362)
          at com.google.common.util.concurrent.MoreExecutors$SameThreadExecutorService.execute(MoreExecutors.java:253)
          at com.google.common.util.concurrent.ExecutionList$RunnableExecutorPair.execute(ExecutionList.java:149)
          at com.google.common.util.concurrent.ExecutionList.execute(ExecutionList.java:134)
          at com.google.common.util.concurrent.ListenableFutureTask.done(ListenableFutureTask.java:86)
          at java.util.concurrent.FutureTask$Sync.innerSetException(FutureTask.java:302)
          at java.util.concurrent.FutureTask.setException(FutureTask.java:153)
          at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:336)
          at java.util.concurrent.FutureTask.run(FutureTask.java:166)
          at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
          at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
          at java.lang.Thread.run(Thread.java:722)
          Caused by: java.io.IOException: For test
          at org.apache.hadoop.security.TestGroupsCaching$FakeGroupMapping.getGroups(TestGroupsCaching.java:79)
          at org.apache.hadoop.security.Groups$GroupCacheLoader.fetchGroupList(Groups.java:356)
          at org.apache.hadoop.security.Groups$GroupCacheLoader.load(Groups.java:299)
          at org.apache.hadoop.security.Groups$GroupCacheLoader$1.call(Groups.java:335)
          at org.apache.hadoop.security.Groups$GroupCacheLoader$1.call(Groups.java:328)
          at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
          ... 4 more

          Jul 08, 2016 3:25:28 AM com.google.common.cache.LocalCache$Segment$1 run
          WARNING: Exception thrown during refresh
          java.util.concurrent.ExecutionException: java.io.IOException: For test
          at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:252)
          at java.util.concurrent.FutureTask.get(FutureTask.java:111)
          at com.google.common.util.concurrent.Uninterruptibles.getUninterruptibly(Uninterruptibles.java:132)
          at com.google.common.cache.LocalCache$Segment.getAndRecordStats(LocalCache.java:2381)
          at com.google.common.cache.LocalCache$Segment$1.run(LocalCache.java:2362)
          at com.google.common.util.concurrent.MoreExecutors$SameThreadExecutorService.execute(MoreExecutors.java:253)
          at com.google.common.util.concurrent.ExecutionList$RunnableExecutorPair.execute(ExecutionList.java:149)
          at com.google.common.util.concurrent.ExecutionList.execute(ExecutionList.java:134)
          at com.google.common.util.concurrent.ListenableFutureTask.done(ListenableFutureTask.java:86)
          at java.util.concurrent.FutureTask$Sync.innerSetException(FutureTask.java:302)
          at java.util.concurrent.FutureTask.setException(FutureTask.java:153)
          at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:336)
          at java.util.concurrent.FutureTask.run(FutureTask.java:166)
          at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
          at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
          at java.lang.Thread.run(Thread.java:722)
          Caused by: java.io.IOException: For test
          at org.apache.hadoop.security.TestGroupsCaching$FakeGroupMapping.getGroups(TestGroupsCaching.java:79)
          at org.apache.hadoop.security.Groups$GroupCacheLoader.fetchGroupList(Groups.java:356)
          at org.apache.hadoop.security.Groups$GroupCacheLoader.load(Groups.java:299)
          at org.apache.hadoop.security.Groups$GroupCacheLoader$1.call(Groups.java:335)
          at org.apache.hadoop.security.Groups$GroupCacheLoader$1.call(Groups.java:328)
          at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
          ... 4 more

          Show
          liuml07 Mingliang Liu added a comment - Standard Error Jul 08, 2016 3:25:28 AM com.google.common.cache.LocalCache$Segment$1 run WARNING: Exception thrown during refresh java.util.concurrent.ExecutionException: java.io.IOException: For test at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:252) at java.util.concurrent.FutureTask.get(FutureTask.java:111) at com.google.common.util.concurrent.Uninterruptibles.getUninterruptibly(Uninterruptibles.java:132) at com.google.common.cache.LocalCache$Segment.getAndRecordStats(LocalCache.java:2381) at com.google.common.cache.LocalCache$Segment$1.run(LocalCache.java:2362) at com.google.common.util.concurrent.MoreExecutors$SameThreadExecutorService.execute(MoreExecutors.java:253) at com.google.common.util.concurrent.ExecutionList$RunnableExecutorPair.execute(ExecutionList.java:149) at com.google.common.util.concurrent.ExecutionList.execute(ExecutionList.java:134) at com.google.common.util.concurrent.ListenableFutureTask.done(ListenableFutureTask.java:86) at java.util.concurrent.FutureTask$Sync.innerSetException(FutureTask.java:302) at java.util.concurrent.FutureTask.setException(FutureTask.java:153) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:336) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:722) Caused by: java.io.IOException: For test at org.apache.hadoop.security.TestGroupsCaching$FakeGroupMapping.getGroups(TestGroupsCaching.java:79) at org.apache.hadoop.security.Groups$GroupCacheLoader.fetchGroupList(Groups.java:356) at org.apache.hadoop.security.Groups$GroupCacheLoader.load(Groups.java:299) at org.apache.hadoop.security.Groups$GroupCacheLoader$1.call(Groups.java:335) at org.apache.hadoop.security.Groups$GroupCacheLoader$1.call(Groups.java:328) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) ... 4 more Jul 08, 2016 3:25:28 AM com.google.common.cache.LocalCache$Segment$1 run WARNING: Exception thrown during refresh java.util.concurrent.ExecutionException: java.io.IOException: For test at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:252) at java.util.concurrent.FutureTask.get(FutureTask.java:111) at com.google.common.util.concurrent.Uninterruptibles.getUninterruptibly(Uninterruptibles.java:132) at com.google.common.cache.LocalCache$Segment.getAndRecordStats(LocalCache.java:2381) at com.google.common.cache.LocalCache$Segment$1.run(LocalCache.java:2362) at com.google.common.util.concurrent.MoreExecutors$SameThreadExecutorService.execute(MoreExecutors.java:253) at com.google.common.util.concurrent.ExecutionList$RunnableExecutorPair.execute(ExecutionList.java:149) at com.google.common.util.concurrent.ExecutionList.execute(ExecutionList.java:134) at com.google.common.util.concurrent.ListenableFutureTask.done(ListenableFutureTask.java:86) at java.util.concurrent.FutureTask$Sync.innerSetException(FutureTask.java:302) at java.util.concurrent.FutureTask.setException(FutureTask.java:153) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:336) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:722) Caused by: java.io.IOException: For test at org.apache.hadoop.security.TestGroupsCaching$FakeGroupMapping.getGroups(TestGroupsCaching.java:79) at org.apache.hadoop.security.Groups$GroupCacheLoader.fetchGroupList(Groups.java:356) at org.apache.hadoop.security.Groups$GroupCacheLoader.load(Groups.java:299) at org.apache.hadoop.security.Groups$GroupCacheLoader$1.call(Groups.java:335) at org.apache.hadoop.security.Groups$GroupCacheLoader$1.call(Groups.java:328) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) ... 4 more Jul 08, 2016 3:25:28 AM com.google.common.cache.LocalCache$Segment$1 run WARNING: Exception thrown during refresh java.util.concurrent.ExecutionException: java.io.IOException: For test at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:252) at java.util.concurrent.FutureTask.get(FutureTask.java:111) at com.google.common.util.concurrent.Uninterruptibles.getUninterruptibly(Uninterruptibles.java:132) at com.google.common.cache.LocalCache$Segment.getAndRecordStats(LocalCache.java:2381) at com.google.common.cache.LocalCache$Segment$1.run(LocalCache.java:2362) at com.google.common.util.concurrent.MoreExecutors$SameThreadExecutorService.execute(MoreExecutors.java:253) at com.google.common.util.concurrent.ExecutionList$RunnableExecutorPair.execute(ExecutionList.java:149) at com.google.common.util.concurrent.ExecutionList.execute(ExecutionList.java:134) at com.google.common.util.concurrent.ListenableFutureTask.done(ListenableFutureTask.java:86) at java.util.concurrent.FutureTask$Sync.innerSetException(FutureTask.java:302) at java.util.concurrent.FutureTask.setException(FutureTask.java:153) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:336) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:722) Caused by: java.io.IOException: For test at org.apache.hadoop.security.TestGroupsCaching$FakeGroupMapping.getGroups(TestGroupsCaching.java:79) at org.apache.hadoop.security.Groups$GroupCacheLoader.fetchGroupList(Groups.java:356) at org.apache.hadoop.security.Groups$GroupCacheLoader.load(Groups.java:299) at org.apache.hadoop.security.Groups$GroupCacheLoader$1.call(Groups.java:335) at org.apache.hadoop.security.Groups$GroupCacheLoader$1.call(Groups.java:328) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) ... 4 more Jul 08, 2016 3:25:28 AM com.google.common.cache.LocalCache$Segment$1 run WARNING: Exception thrown during refresh java.util.concurrent.ExecutionException: java.io.IOException: For test at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:252) at java.util.concurrent.FutureTask.get(FutureTask.java:111) at com.google.common.util.concurrent.Uninterruptibles.getUninterruptibly(Uninterruptibles.java:132) at com.google.common.cache.LocalCache$Segment.getAndRecordStats(LocalCache.java:2381) at com.google.common.cache.LocalCache$Segment$1.run(LocalCache.java:2362) at com.google.common.util.concurrent.MoreExecutors$SameThreadExecutorService.execute(MoreExecutors.java:253) at com.google.common.util.concurrent.ExecutionList$RunnableExecutorPair.execute(ExecutionList.java:149) at com.google.common.util.concurrent.ExecutionList.execute(ExecutionList.java:134) at com.google.common.util.concurrent.ListenableFutureTask.done(ListenableFutureTask.java:86) at java.util.concurrent.FutureTask$Sync.innerSetException(FutureTask.java:302) at java.util.concurrent.FutureTask.setException(FutureTask.java:153) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:336) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:722) Caused by: java.io.IOException: For test at org.apache.hadoop.security.TestGroupsCaching$FakeGroupMapping.getGroups(TestGroupsCaching.java:79) at org.apache.hadoop.security.Groups$GroupCacheLoader.fetchGroupList(Groups.java:356) at org.apache.hadoop.security.Groups$GroupCacheLoader.load(Groups.java:299) at org.apache.hadoop.security.Groups$GroupCacheLoader$1.call(Groups.java:335) at org.apache.hadoop.security.Groups$GroupCacheLoader$1.call(Groups.java:328) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) ... 4 more Jul 08, 2016 3:25:28 AM com.google.common.cache.LocalCache$Segment$1 run WARNING: Exception thrown during refresh java.util.concurrent.ExecutionException: java.io.IOException: For test at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:252) at java.util.concurrent.FutureTask.get(FutureTask.java:111) at com.google.common.util.concurrent.Uninterruptibles.getUninterruptibly(Uninterruptibles.java:132) at com.google.common.cache.LocalCache$Segment.getAndRecordStats(LocalCache.java:2381) at com.google.common.cache.LocalCache$Segment$1.run(LocalCache.java:2362) at com.google.common.util.concurrent.MoreExecutors$SameThreadExecutorService.execute(MoreExecutors.java:253) at com.google.common.util.concurrent.ExecutionList$RunnableExecutorPair.execute(ExecutionList.java:149) at com.google.common.util.concurrent.ExecutionList.execute(ExecutionList.java:134) at com.google.common.util.concurrent.ListenableFutureTask.done(ListenableFutureTask.java:86) at java.util.concurrent.FutureTask$Sync.innerSetException(FutureTask.java:302) at java.util.concurrent.FutureTask.setException(FutureTask.java:153) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:336) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:722) Caused by: java.io.IOException: For test at org.apache.hadoop.security.TestGroupsCaching$FakeGroupMapping.getGroups(TestGroupsCaching.java:79) at org.apache.hadoop.security.Groups$GroupCacheLoader.fetchGroupList(Groups.java:356) at org.apache.hadoop.security.Groups$GroupCacheLoader.load(Groups.java:299) at org.apache.hadoop.security.Groups$GroupCacheLoader$1.call(Groups.java:335) at org.apache.hadoop.security.Groups$GroupCacheLoader$1.call(Groups.java:328) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) ... 4 more

            People

            • Assignee:
              cheersyang Weiwei Yang
              Reporter:
              liuml07 Mingliang Liu
            • Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development