[HBASE-6032] Port HFileBlockIndex improvement from HBASE-5987

• Type: Task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.94.3, 0.95.0
• Hadoop Flags: Reviewed
• Assignee: Ted Yu
• Reporter: Ted Yu
• Created: 17/May/12 18:03
• Updated: 23/Oct/13 21:00
• Resolved: 01/Oct/12 20:59

Description

Excerpt from HBASE-5987:
First, we propose to lookahead for one more block index so that the HFileScanner would know the start key value of next data block. So if the target key value for the scan(reSeekTo) is "smaller" than that start kv of next data block, it means the target key value has a very high possibility in the current data block (if not in current data block, then the start kv of next data block should be returned. Indexing on the start key has some defects here) and it shall NOT query the HFileBlockIndex in this case. On the contrary, if the target key value is "bigger", then it shall query the HFileBlockIndex. This improvement shall help to reduce the hotness of HFileBlockIndex and avoid some unnecessary IdLock Contention or Index Block Cache lookup.

This JIRA is to port the fix to HBase trunk, etc.

Issue Links

• is related to: HBASE-5987 HFileBlockIndex improvement