Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-4683

Always cache index and bloom blocks

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • None
    • 0.92.0, 0.94.0
    • None
    • None
    • Reviewed

    Description

      This would add a new boolean config option: hfile.block.cache.datablocks
      Default would be true.

      Setting this to false allows HBase in a mode where only index blocks are cached, which is useful for analytical scenarios where a useful working set of the data cannot be expected to fit into the (aggregate) cache.
      This is the equivalent of setting cacheBlocks to false on all scans (including scans on behalf of gets).

      I would like to get a general feeling about what folks think about this.
      The change itself would be simple.

      Update (Mikhail): we probably don't need a new conf option. Instead, we will make index blocks cached by default.

      Attachments

        1. HBASE-4683-v3.patch
          3 kB
          Jean-Daniel Cryans
        2. HBASE-4683-0.92-v2.patch
          8 kB
          Jean-Daniel Cryans
        3. ASF.LICENSE.NOT.GRANTED--D807.3.patch
          42 kB
          Phabricator
        4. ASF.LICENSE.NOT.GRANTED--D807.2.patch
          42 kB
          Phabricator
        5. ASF.LICENSE.NOT.GRANTED--D807.1.patch
          33 kB
          Phabricator
        6. ASF.LICENSE.NOT.GRANTED--D1695.1.patch
          8 kB
          Phabricator
        7. 4683-v2.txt
          10 kB
          Lars Hofhansl
        8. 4683.txt
          9 kB
          Lars Hofhansl
        9. 0001-Cache-important-block-types.patch
          47 kB
          Mikhail Gryzykhin

        Issue Links

          Activity

            People

              mikhail Mikhail Gryzykhin
              larsh Lars Hofhansl
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: