[HBASE-6800] Build a Document Store on HBase for Better Query Processing

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Abandoned
• Affects Version/s: 0.95.2
• Component/s: Coprocessors, Performance
• Assignee: Unassigned
• Reporter: Jason Dai
• Created: 17/Sep/12 08:46
• Updated: 14/Jun/22 18:03
• Resolved: 11/Jun/22 18:16

Description

In the last couple of years, increasingly more people begin to stream data into HBase in near time, and
use high level queries (e.g., Hive) to analyze the data in HBase directly. While HBase already has very effective MapReduce integration with its good scanning performance, query processing using MapReduce on HBase still has significant gaps compared to HDFS: ~3x space overheads and 3~5x performance overheads according to our measurement.

We propose to implement a document store on HBase, which can greatly improve query processing on HBase (by leveraging the relational model and read-mostly access patterns). According to our prototype, it can reduce space usage by up-to ~3x and speedup query processing by up-to ~1.8x.

Issue Links

• relates to: HBASE-6805 Extend co-processor framework to provide observers for filter operations

Sub-Tasks

• Extend co-processor framework to provide observers for filter operations: Closed
• StoreScanner need to be able to be subclassed: Closed