Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-13825

Use ProtobufUtil#mergeFrom and ProtobufUtil#mergeDelimitedFrom in place of builder methods of same name

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.0.0, 1.0.1
    • Fix Version/s: 0.98.14, 1.0.2, 1.2.0, 1.1.2, 1.3.0, 2.0.0
    • Component/s: util
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      When performing a get operation on a column family with more than 64MB of data, the operation fails with:

      Caused by: Portable(java.io.IOException): Call to host:port failed on local exception: com.google.protobuf.InvalidProtocolBufferException: Protocol message was too large. May be malicious. Use CodedInputStream.setSizeLimit() to increase the size limit.
      at org.apache.hadoop.hbase.ipc.RpcClient.wrapException(RpcClient.java:1481)
      at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1453)
      at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1653)
      at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1711)
      at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$BlockingStub.get(ClientProtos.java:27308)
      at org.apache.hadoop.hbase.protobuf.ProtobufUtil.get(ProtobufUtil.java:1381)
      at org.apache.hadoop.hbase.client.HTable$3.call(HTable.java:753)
      at org.apache.hadoop.hbase.client.HTable$3.call(HTable.java:751)
      at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:120)
      at org.apache.hadoop.hbase.client.HTable.get(HTable.java:756)
      at org.apache.hadoop.hbase.client.HTable.get(HTable.java:765)
      at org.apache.hadoop.hbase.client.HTablePool$PooledHTable.get(HTablePool.java:395)

      This may be related to https://issues.apache.org/jira/browse/HBASE-11747 but that issue is related to cluster status.

      Scan and put operations on the same data work fine

      Tested on a 1.0.0 cluster with both 1.0.1 and 1.0.0 clients.

        Attachments

        1. HBASE-13825-branch-1.patch
          74 kB
          Andrew Kyle Purtell
        2. HBASE-13825-0.98.patch
          71 kB
          Andrew Kyle Purtell
        3. HBASE-13825-branch-1.patch
          73 kB
          Andrew Kyle Purtell
        4. HBASE-13825-0.98.patch
          70 kB
          Andrew Kyle Purtell
        5. HBASE-13825.patch
          60 kB
          Andrew Kyle Purtell

          Issue Links

            Activity

              People

              • Assignee:
                apurtell Andrew Kyle Purtell
                Reporter:
                devl.development Dev Lakhani
              • Votes:
                7 Vote for this issue
                Watchers:
                19 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: