Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.22.0
    • 0.22.0
    • test
    • None
    • Reviewed

    Description

      Hudson runs fail several tests. TestBlockToken.testBlockTokenRpc is one of them.
      See here

      Attachments

        1. h1284-03.patch
          2 kB
          Kan Zhang
        2. h1284-02.patch
          2 kB
          Kan Zhang
        3. h1284-01.patch
          1 kB
          Kan Zhang

        Issue Links

          Activity

            Error Message
            
            java.lang.AssertionError: Only one BlockTokenIdentifier expected expected:<1> but was:<0> 
            
            Stacktrace
            
            java.io.IOException: java.lang.AssertionError: Only one BlockTokenIdentifier expected expected:<1> but was:<0>
            	at org.apache.hadoop.hdfs.security.token.block.TestBlockToken$getLengthAnswer.answer(TestBlockToken.java:104)
            	at org.apache.hadoop.hdfs.security.token.block.TestBlockToken$getLengthAnswer.answer(TestBlockToken.java:87)
            	at org.mockito.internal.stubbing.StubbedInvocationMatcher.answer(StubbedInvocationMatcher.java:29)
            	at org.mockito.internal.MockHandler.handle(MockHandler.java:95)
            	at org.mockito.internal.creation.MethodInterceptorFilter.intercept(MethodInterceptorFilter.java:47)
            	at org.apache.hadoop.hdfs.protocol.ClientDatanodeProtocol$$EnhancerByMockitoWithCGLIB$$aa5fc970.getReplicaVisibleLength(<generated>)
            	at org.apache.hadoop.ipc.WritableRpcEngine$Server.call(WritableRpcEngine.java:342)
            	at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1369)
            	at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1365)
            	at java.security.AccessController.doPrivileged(Native Method)
            	at javax.security.auth.Subject.doAs(Subject.java:396)
            	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:813)
            	at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1363)
            
            	at org.apache.hadoop.ipc.Client.call(Client.java:918)
            	at org.apache.hadoop.ipc.WritableRpcEngine$Invoker.invoke(WritableRpcEngine.java:198)
            	at $Proxy4.getReplicaVisibleLength(Unknown Source)
            	at org.apache.hadoop.hdfs.security.token.block.TestBlockToken.testBlockTokenRpc(TestBlockToken.java:215)
            
            shv Konstantin Shvachko added a comment - Error Message java.lang.AssertionError: Only one BlockTokenIdentifier expected expected:<1> but was:<0> Stacktrace java.io.IOException: java.lang.AssertionError: Only one BlockTokenIdentifier expected expected:<1> but was:<0> at org.apache.hadoop.hdfs.security.token.block.TestBlockToken$getLengthAnswer.answer(TestBlockToken.java:104) at org.apache.hadoop.hdfs.security.token.block.TestBlockToken$getLengthAnswer.answer(TestBlockToken.java:87) at org.mockito.internal.stubbing.StubbedInvocationMatcher.answer(StubbedInvocationMatcher.java:29) at org.mockito.internal.MockHandler.handle(MockHandler.java:95) at org.mockito.internal.creation.MethodInterceptorFilter.intercept(MethodInterceptorFilter.java:47) at org.apache.hadoop.hdfs.protocol.ClientDatanodeProtocol$$EnhancerByMockitoWithCGLIB$$aa5fc970.getReplicaVisibleLength(<generated>) at org.apache.hadoop.ipc.WritableRpcEngine$Server.call(WritableRpcEngine.java:342) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1369) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1365) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:813) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1363) at org.apache.hadoop.ipc.Client.call(Client.java:918) at org.apache.hadoop.ipc.WritableRpcEngine$Invoker.invoke(WritableRpcEngine.java:198) at $Proxy4.getReplicaVisibleLength(Unknown Source) at org.apache.hadoop.hdfs.security.token.block.TestBlockToken.testBlockTokenRpc(TestBlockToken.java:215)
            kzhang Kan Zhang added a comment -

            adding a test patch.

            kzhang Kan Zhang added a comment - adding a test patch.
            hadoopqa Hadoop QA added a comment -

            -1 overall. Here are the results of testing the latest attachment
            http://issues.apache.org/jira/secure/attachment/12449951/h1284-01.patch
            against trunk revision 965697.

            +1 @author. The patch does not contain any @author tags.

            +1 tests included. The patch appears to include 3 new or modified tests.

            +1 javadoc. The javadoc tool did not generate any warning messages.

            +1 javac. The applied patch does not increase the total number of javac compiler warnings.

            +1 findbugs. The patch does not introduce any new Findbugs warnings.

            +1 release audit. The applied patch does not increase the total number of release audit warnings.

            -1 core tests. The patch failed core unit tests.

            -1 contrib tests. The patch failed contrib unit tests.

            Test results: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/219/testReport/
            Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/219/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
            Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/219/artifact/trunk/build/test/checkstyle-errors.html
            Console output: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/219/console

            This message is automatically generated.

            hadoopqa Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12449951/h1284-01.patch against trunk revision 965697. +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 3 new or modified tests. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 findbugs. The patch does not introduce any new Findbugs warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. -1 core tests. The patch failed core unit tests. -1 contrib tests. The patch failed contrib unit tests. Test results: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/219/testReport/ Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/219/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/219/artifact/trunk/build/test/checkstyle-errors.html Console output: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/219/console This message is automatically generated.
            hadoopqa Hadoop QA added a comment -

            -1 overall. Here are the results of testing the latest attachment
            http://issues.apache.org/jira/secure/attachment/12449986/h1284-02.patch
            against trunk revision 966031.

            +1 @author. The patch does not contain any @author tags.

            +1 tests included. The patch appears to include 6 new or modified tests.

            +1 javadoc. The javadoc tool did not generate any warning messages.

            +1 javac. The applied patch does not increase the total number of javac compiler warnings.

            +1 findbugs. The patch does not introduce any new Findbugs warnings.

            +1 release audit. The applied patch does not increase the total number of release audit warnings.

            +1 core tests. The patch passed core unit tests.

            -1 contrib tests. The patch failed contrib unit tests.

            Test results: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/220/testReport/
            Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/220/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
            Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/220/artifact/trunk/build/test/checkstyle-errors.html
            Console output: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/220/console

            This message is automatically generated.

            hadoopqa Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12449986/h1284-02.patch against trunk revision 966031. +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 6 new or modified tests. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 findbugs. The patch does not introduce any new Findbugs warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed core unit tests. -1 contrib tests. The patch failed contrib unit tests. Test results: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/220/testReport/ Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/220/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/220/artifact/trunk/build/test/checkstyle-errors.html Console output: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/220/console This message is automatically generated.
            kzhang Kan Zhang added a comment -

            I can't re-produce this bug on my local box. The log showed RPC client was using "SIMPLE" authentication, which is not the expected setting. The test tried to use a static initialization block to set the authentication to Kerberos. Apparently, it failed on Hudson. By doing that inside @Before method, it seems working.

            kzhang Kan Zhang added a comment - I can't re-produce this bug on my local box. The log showed RPC client was using "SIMPLE" authentication, which is not the expected setting. The test tried to use a static initialization block to set the authentication to Kerberos. Apparently, it failed on Hudson. By doing that inside @Before method, it seems working.
            kzhang Kan Zhang added a comment -

            A patch to make krb5.conf available for unit tests. I took the easy way of copying krb5.conf from common to hdfs. If you have a better way of doing it, please let me know.

            kzhang Kan Zhang added a comment - A patch to make krb5.conf available for unit tests. I took the easy way of copying krb5.conf from common to hdfs. If you have a better way of doing it, please let me know.
            kzhang Kan Zhang added a comment -

            TestBlockToken sometimes fails because of HADOOP-6913. We need to make krb5.conf available for this test. Previously, it wasn't needed because we never actually did initialize KerberosName class with security turned on due to the circular initialization bug in HADOOP-6913.

            kzhang Kan Zhang added a comment - TestBlockToken sometimes fails because of HADOOP-6913 . We need to make krb5.conf available for this test. Previously, it wasn't needed because we never actually did initialize KerberosName class with security turned on due to the circular initialization bug in HADOOP-6913 .
            kzhang Kan Zhang added a comment -

            h1284-03.patch is ready to be submitted as soon as HADOOP-6913 is committed.

            kzhang Kan Zhang added a comment - h1284-03.patch is ready to be submitted as soon as HADOOP-6913 is committed.
            hadoopqa Hadoop QA added a comment -

            -1 overall. Here are the results of testing the latest attachment
            http://issues.apache.org/jira/secure/attachment/12451831/h1284-03.patch
            against trunk revision 990466.

            +1 @author. The patch does not contain any @author tags.

            +1 tests included. The patch appears to include 3 new or modified tests.

            -1 javadoc. The javadoc tool appears to have generated 1 warning messages.

            +1 javac. The applied patch does not increase the total number of javac compiler warnings.

            +1 findbugs. The patch does not introduce any new Findbugs warnings.

            +1 release audit. The applied patch does not increase the total number of release audit warnings.

            -1 core tests. The patch failed core unit tests.

            -1 contrib tests. The patch failed contrib unit tests.

            +1 system tests framework. The patch passed system tests framework compile.

            Test results: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/231/testReport/
            Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/231/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
            Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/231/artifact/trunk/build/test/checkstyle-errors.html
            Console output: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/231/console

            This message is automatically generated.

            hadoopqa Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12451831/h1284-03.patch against trunk revision 990466. +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 3 new or modified tests. -1 javadoc. The javadoc tool appears to have generated 1 warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 findbugs. The patch does not introduce any new Findbugs warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. -1 core tests. The patch failed core unit tests. -1 contrib tests. The patch failed contrib unit tests. +1 system tests framework. The patch passed system tests framework compile. Test results: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/231/testReport/ Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/231/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/231/artifact/trunk/build/test/checkstyle-errors.html Console output: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/231/console This message is automatically generated.
            kzhang Kan Zhang added a comment -

            I think this patch is ready for commit. The failed tests are unrelated (some are due to HADOOP-6938).

            kzhang Kan Zhang added a comment - I think this patch is ready for commit. The failed tests are unrelated (some are due to HADOOP-6938 ).
            jghoman Jakob Homan added a comment -

            +1

            jghoman Jakob Homan added a comment - +1
            jghoman Jakob Homan added a comment -

            I've committed this. Resolving as fixed. Thanks, Kan!

            jghoman Jakob Homan added a comment - I've committed this. Resolving as fixed. Thanks, Kan!
            hudson Hudson added a comment -

            Integrated in Hadoop-Hdfs-trunk-Commit #379 (See https://hudson.apache.org/hudson/job/Hadoop-Hdfs-trunk-Commit/379/)

            hudson Hudson added a comment - Integrated in Hadoop-Hdfs-trunk-Commit #379 (See https://hudson.apache.org/hudson/job/Hadoop-Hdfs-trunk-Commit/379/ )

            People

              kzhang Kan Zhang
              shv Konstantin Shvachko
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: