HBase
  1. HBase
  2. HBASE-4241

Optimize flushing of the Store cache for max versions and (new) min versions

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.92.0
    • Fix Version/s: 0.92.0
    • Component/s: regionserver
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      As discussed with with Jon, there is room for improvement in how the memstore is flushed to disk.
      Currently only expired KVs are pruned before flushing, but we can also prune versions if we find at least maxVersions versions in the memstore.
      The same holds for the new minversion feature: If we find at least minVersion versions in the store we can remove all further versions that are expired.

      Generally we should use the same mechanism here that is used for Compaction. I.e. StoreScanner. We only need to add a scanner to Memstore that can scan along the current snapshot.

      1. 4241.txt
        12 kB
        Lars Hofhansl
      2. 4241-v2.txt
        13 kB
        Lars Hofhansl
      3. 4241-v8.txt
        15 kB
        Lars Hofhansl

        Issue Links

        There are no Sub-Tasks for this issue.

          Activity

            People

            • Assignee:
              Lars Hofhansl
              Reporter:
              Lars Hofhansl
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development