Details

    • Type: Bug
    • Status: Closed
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 0.99.1
    • Fix Version/s: 2.0.0, 0.99.2
    • Component/s: None
    • Labels:
      None

      Description

      Let me fix a few innocuous exceptions that show on startup (saw testing 0.99.1), even when regular – will throw people off.

      Here is one:

      2014-10-12 19:07:15,251 INFO  [c2020:16020.activeMasterManager] zookeeper.MetaTableLocator: Failed verification of hbase:meta,,1 at address=c2021.halxg.cloudera.com,16020,1413165899611, exception=org.apache.hadoop.hbase.NotServingRegionException: org.apache.hadoop.hbase.NotServingRegionException: Region hbase:meta,,1 is not online on c2021.halxg.cloudera.com,16020,1413166029547
              at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedName(HRegionServer.java:2677)
              at org.apache.hadoop.hbase.regionserver.RSRpcServices.getRegion(RSRpcServices.java:838)
              at org.apache.hadoop.hbase.regionserver.RSRpcServices.getRegionInfo(RSRpcServices.java:1110)
              at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$2.callBlockingMethod(AdminProtos.java:20158)
              at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2016)
              at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:108)
              at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:110)
              at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:90)
              at java.lang.Thread.run(Thread.java:745)
      

      More to follow...

      1. 12238.txt
        8 kB
        stack
      2. 12238.txt
        8 kB
        stack

        Activity

        Hide
        stack stack added a comment -

        In standalone mode this is a little disorientating... it shows up frequently:

         143 2014-10-07 16:57:28,814 INFO  [M:0;192.168.1.225:54811-SendThread(fe80:0:0:0:0:0:0:1%1:2181)] zookeeper.ClientCnxn: Opening socket connection to server fe80:0:0:0:0:0:0:1%1/fe80:0:0:0:0:0:0:1%1:2181. Will not attempt to authenticate using SASL (unknown error)
         144 2014-10-07 16:57:28,815 INFO  [M:0;192.168.1.225:54811-SendThread(fe80:0:0:0:0:0:0:1%1:2181)] zookeeper.ClientCnxn: Client session timed out, have not heard from server in 5076ms for sessionid 0x0, closing socket connection and attempting reconnect
         145 2014-10-07 16:57:28,815 INFO  [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181] server.NIOServerCnxnFactory: Accepted socket connection from /fe80:0:0:0:0:0:0:1%1:54823
         146 2014-10-07 16:57:28,815 WARN  [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181] server.NIOServerCnxn: caught end of stream exception
         147 EndOfStreamException: Unable to read additional data from client sessionid 0x0, likely client has closed socket
         148   at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
         149   at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
         150   at java.lang.Thread.run(Thread.java:745)
        
        Show
        stack stack added a comment - In standalone mode this is a little disorientating... it shows up frequently: 143 2014-10-07 16:57:28,814 INFO [M:0;192.168.1.225:54811-SendThread(fe80:0:0:0:0:0:0:1%1:2181)] zookeeper.ClientCnxn: Opening socket connection to server fe80:0:0:0:0:0:0:1%1/fe80:0:0:0:0:0:0:1%1:2181. Will not attempt to authenticate using SASL (unknown error) 144 2014-10-07 16:57:28,815 INFO [M:0;192.168.1.225:54811-SendThread(fe80:0:0:0:0:0:0:1%1:2181)] zookeeper.ClientCnxn: Client session timed out, have not heard from server in 5076ms for sessionid 0x0, closing socket connection and attempting reconnect 145 2014-10-07 16:57:28,815 INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181] server.NIOServerCnxnFactory: Accepted socket connection from /fe80:0:0:0:0:0:0:1%1:54823 146 2014-10-07 16:57:28,815 WARN [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181] server.NIOServerCnxn: caught end of stream exception 147 EndOfStreamException: Unable to read additional data from client sessionid 0x0, likely client has closed socket 148 at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228) 149 at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208) 150 at java.lang. Thread .run( Thread .java:745)
        Hide
        stack stack added a comment -

        Remove logging of NSRE from MTL. Other minor fixup.

        Spent some time on "EndOfStreamException: Unable to read additional data from client sessionid 0x0, likely client has closed socket" Turning off ipv6 seemed to clear this one up locally. But it is a common complaint if you search around: http://community.cloudera.com/t5/Storage-Random-Access-HDFS/End-of-stream-Exception-with-HBASE-and-YSCB/td-p/6045 In this latter case it is not ipv6.

        There is also a stall when standalone for a couple of seconds. Will look at that in another issue. This will do for this issue for now.

        Show
        stack stack added a comment - Remove logging of NSRE from MTL. Other minor fixup. Spent some time on "EndOfStreamException: Unable to read additional data from client sessionid 0x0, likely client has closed socket" Turning off ipv6 seemed to clear this one up locally. But it is a common complaint if you search around: http://community.cloudera.com/t5/Storage-Random-Access-HDFS/End-of-stream-Exception-with-HBASE-and-YSCB/td-p/6045 In this latter case it is not ipv6. There is also a stall when standalone for a couple of seconds. Will look at that in another issue. This will do for this issue for now.
        Hide
        hadoopqa Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12674928/12238.txt
        against trunk revision .
        ATTACHMENT ID: 12674928

        +1 @author. The patch does not contain any @author tags.

        -1 tests included. The patch doesn't appear to include any new or modified tests.
        Please justify why no new tests are needed for this patch.
        Also please list what manual steps were performed to verify this patch.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 javadoc. The javadoc tool did not generate any warning messages.

        +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        +1 lineLengths. The patch does not introduce lines longer than 100

        +1 site. The mvn site goal succeeds with this patch.

        -1 core tests. The patch failed these unit tests:
        org.apache.hadoop.hbase.procedure.TestZKProcedure

        Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/11350//testReport/
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/11350//artifact/patchprocess/newPatchFindbugsWarningshbase-rest.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/11350//artifact/patchprocess/newPatchFindbugsWarningshbase-client.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/11350//artifact/patchprocess/newPatchFindbugsWarningshbase-examples.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/11350//artifact/patchprocess/newPatchFindbugsWarningshbase-protocol.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/11350//artifact/patchprocess/newPatchFindbugsWarningshbase-common.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/11350//artifact/patchprocess/newPatchFindbugsWarningshbase-server.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/11350//artifact/patchprocess/newPatchFindbugsWarningshbase-thrift.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/11350//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/11350//artifact/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/11350//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/11350//artifact/patchprocess/newPatchFindbugsWarningshbase-annotations.html
        Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/11350//console

        This message is automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12674928/12238.txt against trunk revision . ATTACHMENT ID: 12674928 +1 @author . The patch does not contain any @author tags. -1 tests included . The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . The javadoc tool did not generate any warning messages. +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. +1 lineLengths . The patch does not introduce lines longer than 100 +1 site . The mvn site goal succeeds with this patch. -1 core tests . The patch failed these unit tests: org.apache.hadoop.hbase.procedure.TestZKProcedure Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/11350//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/11350//artifact/patchprocess/newPatchFindbugsWarningshbase-rest.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/11350//artifact/patchprocess/newPatchFindbugsWarningshbase-client.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/11350//artifact/patchprocess/newPatchFindbugsWarningshbase-examples.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/11350//artifact/patchprocess/newPatchFindbugsWarningshbase-protocol.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/11350//artifact/patchprocess/newPatchFindbugsWarningshbase-common.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/11350//artifact/patchprocess/newPatchFindbugsWarningshbase-server.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/11350//artifact/patchprocess/newPatchFindbugsWarningshbase-thrift.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/11350//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/11350//artifact/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/11350//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/11350//artifact/patchprocess/newPatchFindbugsWarningshbase-annotations.html Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/11350//console This message is automatically generated.
        Hide
        stack stack added a comment -

        Retry. Minor.

        Show
        stack stack added a comment - Retry. Minor.
        Hide
        hadoopqa Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12678091/12238.txt
        against trunk revision .
        ATTACHMENT ID: 12678091

        +1 @author. The patch does not contain any @author tags.

        -1 tests included. The patch doesn't appear to include any new or modified tests.
        Please justify why no new tests are needed for this patch.
        Also please list what manual steps were performed to verify this patch.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 javadoc. The javadoc tool did not generate any warning messages.

        +1 checkstyle. The applied patch does not increase the total number of checkstyle errors

        +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        +1 lineLengths. The patch does not introduce lines longer than 100

        +1 site. The mvn site goal succeeds with this patch.

        +1 core tests. The patch passed unit tests in .

        Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/11512//testReport/
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/11512//artifact/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/11512//artifact/patchprocess/newPatchFindbugsWarningshbase-examples.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/11512//artifact/patchprocess/newPatchFindbugsWarningshbase-common.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/11512//artifact/patchprocess/newPatchFindbugsWarningshbase-annotations.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/11512//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/11512//artifact/patchprocess/newPatchFindbugsWarningshbase-rest.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/11512//artifact/patchprocess/newPatchFindbugsWarningshbase-client.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/11512//artifact/patchprocess/newPatchFindbugsWarningshbase-thrift.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/11512//artifact/patchprocess/newPatchFindbugsWarningshbase-protocol.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/11512//artifact/patchprocess/newPatchFindbugsWarningshbase-server.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/11512//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html
        Checkstyle Errors: https://builds.apache.org/job/PreCommit-HBASE-Build/11512//artifact/patchprocess/checkstyle-aggregate.html

        Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/11512//console

        This message is automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12678091/12238.txt against trunk revision . ATTACHMENT ID: 12678091 +1 @author . The patch does not contain any @author tags. -1 tests included . The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . The javadoc tool did not generate any warning messages. +1 checkstyle . The applied patch does not increase the total number of checkstyle errors +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. +1 lineLengths . The patch does not introduce lines longer than 100 +1 site . The mvn site goal succeeds with this patch. +1 core tests . The patch passed unit tests in . Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/11512//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/11512//artifact/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/11512//artifact/patchprocess/newPatchFindbugsWarningshbase-examples.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/11512//artifact/patchprocess/newPatchFindbugsWarningshbase-common.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/11512//artifact/patchprocess/newPatchFindbugsWarningshbase-annotations.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/11512//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/11512//artifact/patchprocess/newPatchFindbugsWarningshbase-rest.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/11512//artifact/patchprocess/newPatchFindbugsWarningshbase-client.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/11512//artifact/patchprocess/newPatchFindbugsWarningshbase-thrift.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/11512//artifact/patchprocess/newPatchFindbugsWarningshbase-protocol.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/11512//artifact/patchprocess/newPatchFindbugsWarningshbase-server.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/11512//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html Checkstyle Errors: https://builds.apache.org/job/PreCommit-HBASE-Build/11512//artifact/patchprocess/checkstyle-aggregate.html Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/11512//console This message is automatically generated.
        Hide
        stack stack added a comment -

        Committed small patch that is mostly doc and log emissions edits.

        Show
        stack stack added a comment - Committed small patch that is mostly doc and log emissions edits.
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in HBase-TRUNK #5720 (See https://builds.apache.org/job/HBase-TRUNK/5720/)
        HBASE-12238 A few ugly exceptions on startup (stack: rev 5062edebcfc18329360845988cfee5d25c23a934)

        • hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMasterCommandLine.java
        • hbase-client/src/main/java/org/apache/hadoop/hbase/zookeeper/MetaTableLocator.java
        • hbase-server/src/main/java/org/apache/hadoop/hbase/zookeeper/MiniZooKeeperCluster.java
        • hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in HBase-TRUNK #5720 (See https://builds.apache.org/job/HBase-TRUNK/5720/ ) HBASE-12238 A few ugly exceptions on startup (stack: rev 5062edebcfc18329360845988cfee5d25c23a934) hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMasterCommandLine.java hbase-client/src/main/java/org/apache/hadoop/hbase/zookeeper/MetaTableLocator.java hbase-server/src/main/java/org/apache/hadoop/hbase/zookeeper/MiniZooKeeperCluster.java hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in HBase-1.0 #387 (See https://builds.apache.org/job/HBase-1.0/387/)
        HBASE-12238 A few ugly exceptions on startup (stack: rev b069c10af4aae0ecc94196f241124652cd0b1998)

        • hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMasterCommandLine.java
        • hbase-client/src/main/java/org/apache/hadoop/hbase/zookeeper/MetaTableLocator.java
        • hbase-server/src/main/java/org/apache/hadoop/hbase/zookeeper/MiniZooKeeperCluster.java
        • hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in HBase-1.0 #387 (See https://builds.apache.org/job/HBase-1.0/387/ ) HBASE-12238 A few ugly exceptions on startup (stack: rev b069c10af4aae0ecc94196f241124652cd0b1998) hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMasterCommandLine.java hbase-client/src/main/java/org/apache/hadoop/hbase/zookeeper/MetaTableLocator.java hbase-server/src/main/java/org/apache/hadoop/hbase/zookeeper/MiniZooKeeperCluster.java hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
        Hide
        enis Enis Soztutar added a comment -

        Closing this issue after 0.99.2 release.

        Show
        enis Enis Soztutar added a comment - Closing this issue after 0.99.2 release.

          People

          • Assignee:
            stack stack
            Reporter:
            stack stack
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development