Details
-
Improvement
-
Status: Closed
-
Minor
-
Resolution: Fixed
-
None
-
None
Description
HBaseHandler sets up a TableInputFormat MR job against HBase to read data in. The underlying implementation (in HBaseHandler.java) makes an RPC call per row-key, which makes it very inefficient. Need to specify a client side cache size on the scan.
Note that HBase currently only supports num-rows based caching (no way to specify a memory limit). Created HBASE-6770 to address this.
Attachments
Attachments
Issue Links
- breaks
-
HIVE-6356 Dependency injection in hbase storage handler is broken
- Resolved