[HIVE-6584] Add HiveHBaseTableSnapshotInputFormat

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.14.0
• Component/s: HBase Handler
• Labels: TODOC14

Release Note

Hive can now execute queries against HBase table snapshots. This feature is available for any table defined using the HBaseStorageHandler. It requires at least HBase 0.98.3.

To query against a snapshot instead of the online table, specify the snapshot name via hive.hbase.snapshot.name. The snapshot will be restored into a unique directory under /tmp. This location can be overridden by setting a path via hive.hbase.snapshot.restoredir.

• Assignee: Nick Dimiduk Assign to me
• Reporter: Nick Dimiduk
• Created: 07/Mar/14 18:00
• Updated: 01/Oct/17 04:28
• Resolved: 04/Aug/14 19:18

Description

HBASE-8369 provided mapreduce support for reading from HBase table snapsopts. This allows a MR job to consume a stable, read-only view of an HBase table directly off of HDFS. Bypassing the online region server API provides a nice performance boost for the full scan. HBASE-10642 is backporting that feature to 0.94/0.96 and also adding a mapred implementation. Once that's available, we should add an input format. A follow-on patch could work out how to integrate this functionality into the StorageHandler, similar to how HIVE-6473 integrates the HFileOutputFormat into existing table definitions.

Issue Links

• depends upon: HBASE-11137 Add mapred.TableSnapshotInputFormat
• is related to: HIVE-7534 remove reflection from HBaseSplit
• relates to: HBASE-11555 TableSnapshotRegionSplit should be public
• relates to: HBASE-11163 Support providing a Scan instance in mapred.TableMapReduceUtil
• relates to: HBASE-11557 Counter.class should always be added as dependencyJar
• links to: https://reviews.apache.org/r/23824/