Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.22.0
    • Fix Version/s: 0.22.0
    • Component/s: test
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Hudson runs fail several tests. TestBlockToken.testBlockTokenRpc is one of them.
      See here

      1. h1284-03.patch
        2 kB
        Kan Zhang
      2. h1284-02.patch
        2 kB
        Kan Zhang
      3. h1284-01.patch
        1 kB
        Kan Zhang

        Issue Links

          Activity

          Hide
          Konstantin Shvachko added a comment -
          Error Message
          
          java.lang.AssertionError: Only one BlockTokenIdentifier expected expected:<1> but was:<0> 
          
          Stacktrace
          
          java.io.IOException: java.lang.AssertionError: Only one BlockTokenIdentifier expected expected:<1> but was:<0>
          	at org.apache.hadoop.hdfs.security.token.block.TestBlockToken$getLengthAnswer.answer(TestBlockToken.java:104)
          	at org.apache.hadoop.hdfs.security.token.block.TestBlockToken$getLengthAnswer.answer(TestBlockToken.java:87)
          	at org.mockito.internal.stubbing.StubbedInvocationMatcher.answer(StubbedInvocationMatcher.java:29)
          	at org.mockito.internal.MockHandler.handle(MockHandler.java:95)
          	at org.mockito.internal.creation.MethodInterceptorFilter.intercept(MethodInterceptorFilter.java:47)
          	at org.apache.hadoop.hdfs.protocol.ClientDatanodeProtocol$$EnhancerByMockitoWithCGLIB$$aa5fc970.getReplicaVisibleLength(<generated>)
          	at org.apache.hadoop.ipc.WritableRpcEngine$Server.call(WritableRpcEngine.java:342)
          	at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1369)
          	at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1365)
          	at java.security.AccessController.doPrivileged(Native Method)
          	at javax.security.auth.Subject.doAs(Subject.java:396)
          	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:813)
          	at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1363)
          
          	at org.apache.hadoop.ipc.Client.call(Client.java:918)
          	at org.apache.hadoop.ipc.WritableRpcEngine$Invoker.invoke(WritableRpcEngine.java:198)
          	at $Proxy4.getReplicaVisibleLength(Unknown Source)
          	at org.apache.hadoop.hdfs.security.token.block.TestBlockToken.testBlockTokenRpc(TestBlockToken.java:215)
          
          Show
          Konstantin Shvachko added a comment - Error Message java.lang.AssertionError: Only one BlockTokenIdentifier expected expected:<1> but was:<0> Stacktrace java.io.IOException: java.lang.AssertionError: Only one BlockTokenIdentifier expected expected:<1> but was:<0> at org.apache.hadoop.hdfs.security.token.block.TestBlockToken$getLengthAnswer.answer(TestBlockToken.java:104) at org.apache.hadoop.hdfs.security.token.block.TestBlockToken$getLengthAnswer.answer(TestBlockToken.java:87) at org.mockito.internal.stubbing.StubbedInvocationMatcher.answer(StubbedInvocationMatcher.java:29) at org.mockito.internal.MockHandler.handle(MockHandler.java:95) at org.mockito.internal.creation.MethodInterceptorFilter.intercept(MethodInterceptorFilter.java:47) at org.apache.hadoop.hdfs.protocol.ClientDatanodeProtocol$$EnhancerByMockitoWithCGLIB$$aa5fc970.getReplicaVisibleLength(<generated>) at org.apache.hadoop.ipc.WritableRpcEngine$Server.call(WritableRpcEngine.java:342) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1369) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1365) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:813) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1363) at org.apache.hadoop.ipc.Client.call(Client.java:918) at org.apache.hadoop.ipc.WritableRpcEngine$Invoker.invoke(WritableRpcEngine.java:198) at $Proxy4.getReplicaVisibleLength(Unknown Source) at org.apache.hadoop.hdfs.security.token.block.TestBlockToken.testBlockTokenRpc(TestBlockToken.java:215)
          Hide
          Kan Zhang added a comment -

          adding a test patch.

          Show
          Kan Zhang added a comment - adding a test patch.
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12449951/h1284-01.patch
          against trunk revision 965697.

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 3 new or modified tests.

          +1 javadoc. The javadoc tool did not generate any warning messages.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 findbugs. The patch does not introduce any new Findbugs warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          -1 core tests. The patch failed core unit tests.

          -1 contrib tests. The patch failed contrib unit tests.

          Test results: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/219/testReport/
          Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/219/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
          Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/219/artifact/trunk/build/test/checkstyle-errors.html
          Console output: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/219/console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12449951/h1284-01.patch against trunk revision 965697. +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 3 new or modified tests. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 findbugs. The patch does not introduce any new Findbugs warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. -1 core tests. The patch failed core unit tests. -1 contrib tests. The patch failed contrib unit tests. Test results: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/219/testReport/ Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/219/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/219/artifact/trunk/build/test/checkstyle-errors.html Console output: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/219/console This message is automatically generated.
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12449986/h1284-02.patch
          against trunk revision 966031.

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 6 new or modified tests.

          +1 javadoc. The javadoc tool did not generate any warning messages.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 findbugs. The patch does not introduce any new Findbugs warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          +1 core tests. The patch passed core unit tests.

          -1 contrib tests. The patch failed contrib unit tests.

          Test results: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/220/testReport/
          Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/220/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
          Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/220/artifact/trunk/build/test/checkstyle-errors.html
          Console output: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/220/console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12449986/h1284-02.patch against trunk revision 966031. +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 6 new or modified tests. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 findbugs. The patch does not introduce any new Findbugs warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed core unit tests. -1 contrib tests. The patch failed contrib unit tests. Test results: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/220/testReport/ Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/220/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/220/artifact/trunk/build/test/checkstyle-errors.html Console output: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/220/console This message is automatically generated.
          Hide
          Kan Zhang added a comment -

          I can't re-produce this bug on my local box. The log showed RPC client was using "SIMPLE" authentication, which is not the expected setting. The test tried to use a static initialization block to set the authentication to Kerberos. Apparently, it failed on Hudson. By doing that inside @Before method, it seems working.

          Show
          Kan Zhang added a comment - I can't re-produce this bug on my local box. The log showed RPC client was using "SIMPLE" authentication, which is not the expected setting. The test tried to use a static initialization block to set the authentication to Kerberos. Apparently, it failed on Hudson. By doing that inside @Before method, it seems working.
          Hide
          Kan Zhang added a comment -

          A patch to make krb5.conf available for unit tests. I took the easy way of copying krb5.conf from common to hdfs. If you have a better way of doing it, please let me know.

          Show
          Kan Zhang added a comment - A patch to make krb5.conf available for unit tests. I took the easy way of copying krb5.conf from common to hdfs. If you have a better way of doing it, please let me know.
          Hide
          Kan Zhang added a comment -

          TestBlockToken sometimes fails because of HADOOP-6913. We need to make krb5.conf available for this test. Previously, it wasn't needed because we never actually did initialize KerberosName class with security turned on due to the circular initialization bug in HADOOP-6913.

          Show
          Kan Zhang added a comment - TestBlockToken sometimes fails because of HADOOP-6913 . We need to make krb5.conf available for this test. Previously, it wasn't needed because we never actually did initialize KerberosName class with security turned on due to the circular initialization bug in HADOOP-6913 .
          Hide
          Kan Zhang added a comment -

          h1284-03.patch is ready to be submitted as soon as HADOOP-6913 is committed.

          Show
          Kan Zhang added a comment - h1284-03.patch is ready to be submitted as soon as HADOOP-6913 is committed.
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12451831/h1284-03.patch
          against trunk revision 990466.

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 3 new or modified tests.

          -1 javadoc. The javadoc tool appears to have generated 1 warning messages.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 findbugs. The patch does not introduce any new Findbugs warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          -1 core tests. The patch failed core unit tests.

          -1 contrib tests. The patch failed contrib unit tests.

          +1 system tests framework. The patch passed system tests framework compile.

          Test results: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/231/testReport/
          Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/231/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
          Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/231/artifact/trunk/build/test/checkstyle-errors.html
          Console output: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/231/console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12451831/h1284-03.patch against trunk revision 990466. +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 3 new or modified tests. -1 javadoc. The javadoc tool appears to have generated 1 warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 findbugs. The patch does not introduce any new Findbugs warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. -1 core tests. The patch failed core unit tests. -1 contrib tests. The patch failed contrib unit tests. +1 system tests framework. The patch passed system tests framework compile. Test results: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/231/testReport/ Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/231/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/231/artifact/trunk/build/test/checkstyle-errors.html Console output: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/231/console This message is automatically generated.
          Hide
          Kan Zhang added a comment -

          I think this patch is ready for commit. The failed tests are unrelated (some are due to HADOOP-6938).

          Show
          Kan Zhang added a comment - I think this patch is ready for commit. The failed tests are unrelated (some are due to HADOOP-6938 ).
          Hide
          Jakob Homan added a comment -

          +1

          Show
          Jakob Homan added a comment - +1
          Hide
          Jakob Homan added a comment -

          I've committed this. Resolving as fixed. Thanks, Kan!

          Show
          Jakob Homan added a comment - I've committed this. Resolving as fixed. Thanks, Kan!
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-trunk-Commit #379 (See https://hudson.apache.org/hudson/job/Hadoop-Hdfs-trunk-Commit/379/)

          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-trunk-Commit #379 (See https://hudson.apache.org/hudson/job/Hadoop-Hdfs-trunk-Commit/379/ )

            People

            • Assignee:
              Kan Zhang
              Reporter:
              Konstantin Shvachko
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development