Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-10713

A MemStore implementation with in memory flushes to CellBlocks

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Duplicate
    • None
    • None
    • None
    • None

    Description

      After HBASE-10648 we can plugin any implementation for MemStore. This issue aims at coming up with an implementation, in which we will have in between in memory flushes. This will reduce the need to keep lots of KVs in heap as well as in CSLM. CSLM perform poor when no# items in it increases. We can keep create CellBlocks (contigous byte[] like HFile block) out of KVs and keep it as one object rather than many KVs. At some point in time, MemStore might have N CellBlocks and one CSLM.

      These in memory CellBlocks can be compacted to one bigger block in between. We can target that in follow on tasks once the basic code is ready.

      Attachments

        1. HBASE-10713_WIP.patch
          73 kB
          Anoop Sam John

        Issue Links

          is blocked by

          Bug - A problem which impairs or prevents the functions of the product. HBASE-11401 Late-binding sequenceid presumes a particular KeyValue mvcc format hampering experiment

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          is related to

          Umbrella - An overarching type made of sub-tasks HBASE-10191 Move large arena storage off heap

          • Major - Major loss of function.
          • Closed
          relates to

          New Feature - A new feature of the product, which has yet to be developed. HBASE-13408 HBase In-Memory Memstore Compaction

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-3993 Alternatives to ConcurrentSkipListMap in MemStore

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Umbrella - An overarching type made of sub-tasks HBASE-14918 In-Memory MemStore Flush and Compaction

          • Major - Major loss of function.
          • Closed
          requires

          Sub-task - The sub-task of the issue HBASE-10648 Pluggable Memstore

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-10771 Primitive type put/get APIs in ByteRange

          • Major - Major loss of function.
          • Closed

          Activity

            People

              Unassigned Unassigned
              anoop.hbase Anoop Sam John
              Votes:
              0 Vote for this issue
              Watchers:
              17 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: