Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-11527

Cluster free memory limit check should consider L2 block cache size also when L2 cache is onheap.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.99.0
    • None
    • None
    • Reviewed
    • Hide
      The sum of the heap size % used by Memstore (Configured using 'hbase.regionserver.global.memstore.size' and defaults to 40%) and the that of block cache (Configured using 'hfile.block.cache.size' and defaults to 40%) should leave enough heap size for other normal operations of RS. This is 20%. Also to be noted that when the L2 block cache (ie. Bucket cache) is configured to be on heap, the size of that also comes into this size math. So in that case the sum of memstore heap size, L1 block cache size and L2 cache size (Configured using 'hbase.bucketcache.size')can be at max 80%.
      When automatic tuning of heap memory is enabled (HBASE-5349) at point of time this 80% cap should hold.
      Show
      The sum of the heap size % used by Memstore (Configured using 'hbase.regionserver.global.memstore.size' and defaults to 40%) and the that of block cache (Configured using 'hfile.block.cache.size' and defaults to 40%) should leave enough heap size for other normal operations of RS. This is 20%. Also to be noted that when the L2 block cache (ie. Bucket cache) is configured to be on heap, the size of that also comes into this size math. So in that case the sum of memstore heap size, L1 block cache size and L2 cache size (Configured using 'hbase.bucketcache.size')can be at max 80%. When automatic tuning of heap memory is enabled ( HBASE-5349 ) at point of time this 80% cap should hold.

    Attachments

      1. HBASE-11527.patch
        30 kB
        Anoop Sam John
      2. HBASE-11527_0.99.patch
        36 kB
        Anoop Sam John
      3. HBASE-11527_addendum.patch
        8 kB
        Anoop Sam John

      Activity

        People

          anoop.hbase Anoop Sam John
          anoop.hbase Anoop Sam John
          Votes:
          0 Vote for this issue
          Watchers:
          6 Start watching this issue

          Dates

            Created:
            Updated:
            Resolved: