HBase
  1. HBase
  2. HBASE-6641

more message with DoNotRetryIOException in client

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.94.0
    • Fix Version/s: 0.94.2
    • Component/s: Client
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      when write a row with wrong or unexist family into a table , we will get message below

      org.apache.hadoop.hbase.client.RetriesExhaustedWithDetailsException: Failed 2000 actions: DoNotRetryIOException: 2000 times, servers with issues: dw82.kgb.sqa.cm4:64020, at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.processBatchCallback(HConnectionManager.java:1591)
      at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.processBatch(HConnectionManager.java:1367)
      at org.apache.hadoop.hbase.client.HTable.flushCommits(HTable.java:945)
      at org.apache.hadoop.hbase.client.HTable.doPut(HTable.java:801)
      at org.apache.hadoop.hbase.client.HTable.put(HTable.java:784)
      at zookeeper.WriteMultiThread.doInsert(WriteToTable.java:101)
      at zookeeper.WriteMultiThread.run(WriteToTable.java:80)

      it not friendly to the client. Need to show the client more details about the exception.

      1. HBASE-6641.patch
        0.8 kB
        Zhou wenjian

        Activity

        Hide
        Hudson added a comment -

        Integrated in HBase-0.94-security-on-Hadoop-23 #7 (See https://builds.apache.org/job/HBase-0.94-security-on-Hadoop-23/7/)
        HBASE-6641 more message with DoNotRetryIOException in client (Revision 1377122)

        Result = FAILURE
        stack :
        Files :

        • /hbase/branches/0.94/src/main/java/org/apache/hadoop/hbase/client/RetriesExhaustedWithDetailsException.java
        Show
        Hudson added a comment - Integrated in HBase-0.94-security-on-Hadoop-23 #7 (See https://builds.apache.org/job/HBase-0.94-security-on-Hadoop-23/7/ ) HBASE-6641 more message with DoNotRetryIOException in client (Revision 1377122) Result = FAILURE stack : Files : /hbase/branches/0.94/src/main/java/org/apache/hadoop/hbase/client/RetriesExhaustedWithDetailsException.java
        Hide
        Hudson added a comment -

        Integrated in HBase-0.92-security #117 (See https://builds.apache.org/job/HBase-0.92-security/117/)
        HBASE-6641 more message with DoNotRetryIOException in client (Revision 1377124)

        Result = SUCCESS
        stack :
        Files :

        • /hbase/branches/0.92/src/main/java/org/apache/hadoop/hbase/client/RetriesExhaustedWithDetailsException.java
        Show
        Hudson added a comment - Integrated in HBase-0.92-security #117 (See https://builds.apache.org/job/HBase-0.92-security/117/ ) HBASE-6641 more message with DoNotRetryIOException in client (Revision 1377124) Result = SUCCESS stack : Files : /hbase/branches/0.92/src/main/java/org/apache/hadoop/hbase/client/RetriesExhaustedWithDetailsException.java
        Hide
        Hudson added a comment -

        Integrated in HBase-0.94-security #50 (See https://builds.apache.org/job/HBase-0.94-security/50/)
        HBASE-6641 more message with DoNotRetryIOException in client (Revision 1377122)

        Result = FAILURE
        stack :
        Files :

        • /hbase/branches/0.94/src/main/java/org/apache/hadoop/hbase/client/RetriesExhaustedWithDetailsException.java
        Show
        Hudson added a comment - Integrated in HBase-0.94-security #50 (See https://builds.apache.org/job/HBase-0.94-security/50/ ) HBASE-6641 more message with DoNotRetryIOException in client (Revision 1377122) Result = FAILURE stack : Files : /hbase/branches/0.94/src/main/java/org/apache/hadoop/hbase/client/RetriesExhaustedWithDetailsException.java
        Hide
        Hudson added a comment -

        Integrated in HBase-0.92 #531 (See https://builds.apache.org/job/HBase-0.92/531/)
        HBASE-6641 more message with DoNotRetryIOException in client (Revision 1377124)

        Result = FAILURE
        stack :
        Files :

        • /hbase/branches/0.92/src/main/java/org/apache/hadoop/hbase/client/RetriesExhaustedWithDetailsException.java
        Show
        Hudson added a comment - Integrated in HBase-0.92 #531 (See https://builds.apache.org/job/HBase-0.92/531/ ) HBASE-6641 more message with DoNotRetryIOException in client (Revision 1377124) Result = FAILURE stack : Files : /hbase/branches/0.92/src/main/java/org/apache/hadoop/hbase/client/RetriesExhaustedWithDetailsException.java
        Hide
        Hudson added a comment -

        Integrated in HBase-TRUNK-on-Hadoop-2.0.0 #146 (See https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/146/)
        HBASE-6641 more message with DoNotRetryIOException in client (Revision 1377121)

        Result = FAILURE
        stack :
        Files :

        • /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/client/RetriesExhaustedWithDetailsException.java
        Show
        Hudson added a comment - Integrated in HBase-TRUNK-on-Hadoop-2.0.0 #146 (See https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/146/ ) HBASE-6641 more message with DoNotRetryIOException in client (Revision 1377121) Result = FAILURE stack : Files : /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/client/RetriesExhaustedWithDetailsException.java
        Hide
        Hudson added a comment -

        Integrated in HBase-0.94 #431 (See https://builds.apache.org/job/HBase-0.94/431/)
        HBASE-6641 more message with DoNotRetryIOException in client (Revision 1377122)

        Result = SUCCESS
        stack :
        Files :

        • /hbase/branches/0.94/src/main/java/org/apache/hadoop/hbase/client/RetriesExhaustedWithDetailsException.java
        Show
        Hudson added a comment - Integrated in HBase-0.94 #431 (See https://builds.apache.org/job/HBase-0.94/431/ ) HBASE-6641 more message with DoNotRetryIOException in client (Revision 1377122) Result = SUCCESS stack : Files : /hbase/branches/0.94/src/main/java/org/apache/hadoop/hbase/client/RetriesExhaustedWithDetailsException.java
        Hide
        Hudson added a comment -

        Integrated in HBase-TRUNK #3272 (See https://builds.apache.org/job/HBase-TRUNK/3272/)
        HBASE-6641 more message with DoNotRetryIOException in client (Revision 1377121)

        Result = FAILURE
        stack :
        Files :

        • /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/client/RetriesExhaustedWithDetailsException.java
        Show
        Hudson added a comment - Integrated in HBase-TRUNK #3272 (See https://builds.apache.org/job/HBase-TRUNK/3272/ ) HBASE-6641 more message with DoNotRetryIOException in client (Revision 1377121) Result = FAILURE stack : Files : /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/client/RetriesExhaustedWithDetailsException.java
        Hide
        stack added a comment -

        Thank you for the nice little usability improvement. Applied to 0.92, 0.94, and trunk.

        Show
        stack added a comment - Thank you for the nice little usability improvement. Applied to 0.92, 0.94, and trunk.
        Hide
        Zhou wenjian added a comment -

        After applying the patch,we could get what happened

        org.apache.hadoop.hbase.client.RetriesExhaustedWithDetailsException: Failed 2000 actions: org.apache.hadoop.hbase.DoNotRetryIOException: Column family a does not exist in region logTable,8LK27P38EYG15H7JDEB5YT6TK1MADYZYGFXFE330L3MB29G5Z7,1345183514575.0c8bf995b1e70d6f26fdcaa03c701035. in table {NAME => 'logTable', FAMILIES => [

        {NAME => 'cf', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '0', COMPRESSION => 'NONE', VERSIONS => '3', TTL => '2147483647', MIN_VERSIONS => '0', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', ENCODE_ON_DISK => 'true', IN_MEMORY => 'false', BLOCKCACHE => 'true'}

        ]}
        at org.apache.hadoop.hbase.regionserver.HRegionServer.multi(HRegionServer.java:3773)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.hbase.ipc.WritableRpcEngine$Server.call(WritableRpcEngine.java:364)
        at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1401)

        Show
        Zhou wenjian added a comment - After applying the patch,we could get what happened org.apache.hadoop.hbase.client.RetriesExhaustedWithDetailsException: Failed 2000 actions: org.apache.hadoop.hbase.DoNotRetryIOException: Column family a does not exist in region logTable,8LK27P38EYG15H7JDEB5YT6TK1MADYZYGFXFE330L3MB29G5Z7,1345183514575.0c8bf995b1e70d6f26fdcaa03c701035. in table {NAME => 'logTable', FAMILIES => [ {NAME => 'cf', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '0', COMPRESSION => 'NONE', VERSIONS => '3', TTL => '2147483647', MIN_VERSIONS => '0', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', ENCODE_ON_DISK => 'true', IN_MEMORY => 'false', BLOCKCACHE => 'true'} ]} at org.apache.hadoop.hbase.regionserver.HRegionServer.multi(HRegionServer.java:3773) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.hbase.ipc.WritableRpcEngine$Server.call(WritableRpcEngine.java:364) at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1401)

          People

          • Assignee:
            Zhou wenjian
            Reporter:
            Zhou wenjian
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development