Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-13825

Use ProtobufUtil#mergeFrom and ProtobufUtil#mergeDelimitedFrom in place of builder methods of same name

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.0.0, 1.0.1
    • 0.98.14, 1.0.2, 1.2.0, 1.1.2, 1.3.0, 2.0.0
    • util
    • None
    • Reviewed

    Description

      When performing a get operation on a column family with more than 64MB of data, the operation fails with:

      Caused by: Portable(java.io.IOException): Call to host:port failed on local exception: com.google.protobuf.InvalidProtocolBufferException: Protocol message was too large. May be malicious. Use CodedInputStream.setSizeLimit() to increase the size limit.
      at org.apache.hadoop.hbase.ipc.RpcClient.wrapException(RpcClient.java:1481)
      at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1453)
      at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1653)
      at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1711)
      at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$BlockingStub.get(ClientProtos.java:27308)
      at org.apache.hadoop.hbase.protobuf.ProtobufUtil.get(ProtobufUtil.java:1381)
      at org.apache.hadoop.hbase.client.HTable$3.call(HTable.java:753)
      at org.apache.hadoop.hbase.client.HTable$3.call(HTable.java:751)
      at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:120)
      at org.apache.hadoop.hbase.client.HTable.get(HTable.java:756)
      at org.apache.hadoop.hbase.client.HTable.get(HTable.java:765)
      at org.apache.hadoop.hbase.client.HTablePool$PooledHTable.get(HTablePool.java:395)

      This may be related to https://issues.apache.org/jira/browse/HBASE-11747 but that issue is related to cluster status.

      Scan and put operations on the same data work fine

      Tested on a 1.0.0 cluster with both 1.0.1 and 1.0.0 clients.

      Attachments

        1. HBASE-13825.patch
          60 kB
          Andrew Kyle Purtell
        2. HBASE-13825-0.98.patch
          71 kB
          Andrew Kyle Purtell
        3. HBASE-13825-0.98.patch
          70 kB
          Andrew Kyle Purtell
        4. HBASE-13825-branch-1.patch
          74 kB
          Andrew Kyle Purtell
        5. HBASE-13825-branch-1.patch
          73 kB
          Andrew Kyle Purtell

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            apurtell Andrew Kyle Purtell
            devl.development Dev Lakhani
            Votes:
            7 Vote for this issue
            Watchers:
            18 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment