Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-16421 Introducing the CellChunkMap as a new additional index variant in the MemStore
  3. HBASE-19282

CellChunkMap Benchmarking and User Interface

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.0.0-beta-1, 2.0.0
    • None
    • None
    • Reviewed
    • Hide
      When MSLAB is in use (that is the default config) , we will always use the CellChunkMap indexing variant for in memory flushed Immutable segments. When MSLAB is turned off, we will use CellAraryMap. These can not be changed with any configs. The in memory flush threshold been made to be default to 10% of region flush size. This can be turned using 'hbase.memstore.inmemoryflush.threshold.factor'.
      Show
      When MSLAB is in use (that is the default config) , we will always use the CellChunkMap indexing variant for in memory flushed Immutable segments. When MSLAB is turned off, we will use CellAraryMap. These can not be changed with any configs. The in memory flush threshold been made to be default to 10% of region flush size. This can be turned using 'hbase.memstore.inmemoryflush.threshold.factor'.

    Description

      We have made some experiments how working with CellChunkMap (CCM) influences the performance when running on-heap and off-heap. Based on those results it is suggested to tie the MSLAB usage (off-heap or on-heap) with CCM index usage.

      Attachments

        1. HBASE-19282-V08.patch
          15 kB
          Anastasia Braginsky
        2. HBASE-19282-V07.patch
          15 kB
          Anastasia Braginsky
        3. HBASE-19282-V06.patch
          15 kB
          Anastasia Braginsky
        4. HBASE-19282-V06.patch
          15 kB
          Anastasia Braginsky
        5. HBASE-19282-V05.patch
          14 kB
          Anastasia Braginsky
        6. HBASE-19282-V03.patch
          14 kB
          Anastasia Braginsky
        7. HBASE-19282.patch
          13 kB
          Anastasia Braginsky
        8. HBASE-19282.master.001.patch
          17 kB
          Michael Stack
        9. CCM Benchmarking.pdf
          58 kB
          Anastasia Braginsky

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. HBASE-19148 Reevaluate default values of configurations

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved
          links to

          Web Link Review Board

          Web Link Review Board (master)

          Activity

            People

              anastas Anastasia Braginsky
              anastas Anastasia Braginsky
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: