Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-23066 Create a config that forces to cache blocks on compaction
  3. HBASE-23350

Make compaction files cacheonWrite configurable based on threshold

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.0.0-alpha-1, 2.3.0
    • Component/s: Compaction
    • Labels:
      None
    • Release Note:
      Hide
      This JIRA adds a new configuration - `hbase.rs.cachecompactedblocksonwrite.threshold`. This configuration is the maximum total size (in bytes) of the compacted files below which the configuration `hbase.rs.cachecompactedblocksonwrite` is honoured. If the total size of the compacted fies exceeds this threshold, even when `hbase.rs.cachecompactedblocksonwrite` is enabled, the data blocks are not cached. Caching index and bloom blocks is not affected by this configuration (user configuration is always honoured).

      Default value of this configuration is Long.MAX_VALUE. This means whatever the total size of the compacted files, it wil be cached.
      Show
      This JIRA adds a new configuration - `hbase.rs.cachecompactedblocksonwrite.threshold`. This configuration is the maximum total size (in bytes) of the compacted files below which the configuration `hbase.rs.cachecompactedblocksonwrite` is honoured. If the total size of the compacted fies exceeds this threshold, even when `hbase.rs.cachecompactedblocksonwrite` is enabled, the data blocks are not cached. Caching index and bloom blocks is not affected by this configuration (user configuration is always honoured). Default value of this configuration is Long.MAX_VALUE. This means whatever the total size of the compacted files, it wil be cached.

      Description

      As per comment from chenxu in the parent JIRA
      https://issues.apache.org/jira/browse/HBASE-23066?focusedCommentId=16937361&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-16937361
      This is to introduce a config to identify if the resulting compacted file's blocks should be added to the cache - while writing.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                abhinaba.sarkar Abhinaba Sarkar
                Reporter:
                ram_krish ramkrishna.s.vasudevan
              • Votes:
                0 Vote for this issue
                Watchers:
                12 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: