HBase
  1. HBase
  2. HBASE-6032

Port HFileBlockIndex improvement from HBASE-5987

    Details

    • Type: Task Task
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.94.3, 0.95.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Excerpt from HBASE-5987:
      First, we propose to lookahead for one more block index so that the HFileScanner would know the start key value of next data block. So if the target key value for the scan(reSeekTo) is "smaller" than that start kv of next data block, it means the target key value has a very high possibility in the current data block (if not in current data block, then the start kv of next data block should be returned. Indexing on the start key has some defects here) and it shall NOT query the HFileBlockIndex in this case. On the contrary, if the target key value is "bigger", then it shall query the HFileBlockIndex. This improvement shall help to reduce the hotness of HFileBlockIndex and avoid some unnecessary IdLock Contention or Index Block Cache lookup.

      This JIRA is to port the fix to HBase trunk, etc.

      1. 6032.094.txt
        34 kB
        stack
      2. 6032-ports-5987.txt
        32 kB
        Ted Yu
      3. 6032-ports-5987-v2.txt
        32 kB
        Ted Yu
      4. 6032v3.txt
        34 kB
        stack

        Issue Links

          Activity

          Ted Yu created issue -
          Ted Yu made changes -
          Field Original Value New Value
          Link This issue is related to HBASE-5987 [ HBASE-5987 ]
          Ted Yu made changes -
          Attachment 6032-ports-5987.txt [ 12529563 ]
          Ted Yu made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Ted Yu made changes -
          Fix Version/s 0.96.0 [ 12320040 ]
          Ted Yu made changes -
          Assignee Zhihong Yu [ zhihyu@ebaysf.com ]
          Ted Yu made changes -
          Attachment 6032-ports-5987-v2.txt [ 12529917 ]
          Ted Yu made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Ted Yu made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          stack made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags Reviewed [ 10343 ]
          Resolution Fixed [ 1 ]
          stack made changes -
          Attachment 6032v3.txt [ 12549448 ]
          Attachment 6032.094.txt [ 12549449 ]
          Lars Hofhansl made changes -
          Fix Version/s 0.94.3 [ 12323144 ]
          Lars Hofhansl made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          stack made changes -
          Fix Version/s 0.95.0 [ 12324094 ]
          Fix Version/s 0.96.0 [ 12320040 ]
          Fix Version/s 0.94.3 [ 12323144 ]
          Lars Hofhansl made changes -
          Fix Version/s 0.94.3 [ 12323144 ]

            People

            • Assignee:
              Ted Yu
              Reporter:
              Ted Yu
            • Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development