Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-9751

Excessive readpoints checks in StoreFileScanner

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.98.0, 0.94.12, 0.96.0
    • Fix Version/s: 0.98.0, 0.94.13, 0.96.1
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      It seems that usage of skipKVsNewerThanReadpoint in StoreFileScanner can be greatly reduced or even eliminated all together (HFiles are immutable and no new KVs can be inserted after scanner instance is created). The same is true for MemStoreScanner which checks readpoint on every next() and seek(). Each readpoint check is ThreadLocal.get() and it is quite expensive.

        Attachments

        1. 9751-0.94.txt
          4 kB
          Lars Hofhansl
        2. 9751-0.94-v2.txt
          4 kB
          Lars Hofhansl
        3. 9751-trunk.txt
          3 kB
          Lars Hofhansl
        4. 9751-trunk-v2.txt
          4 kB
          Lars Hofhansl

          Activity

            People

            • Assignee:
              larsh Lars Hofhansl
              Reporter:
              vrodionov Vladimir Rodionov
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: