Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-13825

Use ProtobufUtil#mergeFrom and ProtobufUtil#mergeDelimitedFrom in place of builder methods of same name

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.0.0, 1.0.1
    • 0.98.14, 1.0.2, 1.2.0, 1.1.2, 1.3.0, 2.0.0
    • util
    • None
    • Reviewed

    Description

      When performing a get operation on a column family with more than 64MB of data, the operation fails with:

      Caused by: Portable(java.io.IOException): Call to host:port failed on local exception: com.google.protobuf.InvalidProtocolBufferException: Protocol message was too large. May be malicious. Use CodedInputStream.setSizeLimit() to increase the size limit.
      at org.apache.hadoop.hbase.ipc.RpcClient.wrapException(RpcClient.java:1481)
      at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1453)
      at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1653)
      at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1711)
      at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$BlockingStub.get(ClientProtos.java:27308)
      at org.apache.hadoop.hbase.protobuf.ProtobufUtil.get(ProtobufUtil.java:1381)
      at org.apache.hadoop.hbase.client.HTable$3.call(HTable.java:753)
      at org.apache.hadoop.hbase.client.HTable$3.call(HTable.java:751)
      at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:120)
      at org.apache.hadoop.hbase.client.HTable.get(HTable.java:756)
      at org.apache.hadoop.hbase.client.HTable.get(HTable.java:765)
      at org.apache.hadoop.hbase.client.HTablePool$PooledHTable.get(HTablePool.java:395)

      This may be related to https://issues.apache.org/jira/browse/HBASE-11747 but that issue is related to cluster status.

      Scan and put operations on the same data work fine

      Tested on a 1.0.0 cluster with both 1.0.1 and 1.0.0 clients.

      Attachments

        1. HBASE-13825.patch
          60 kB
          Andrew Kyle Purtell
        2. HBASE-13825-0.98.patch
          71 kB
          Andrew Kyle Purtell
        3. HBASE-13825-0.98.patch
          70 kB
          Andrew Kyle Purtell
        4. HBASE-13825-branch-1.patch
          74 kB
          Andrew Kyle Purtell
        5. HBASE-13825-branch-1.patch
          73 kB
          Andrew Kyle Purtell

        Issue Links

          Activity

            People

              apurtell Andrew Kyle Purtell
              devl.development Dev Lakhani
              Votes:
              7 Vote for this issue
              Watchers:
              18 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: