Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-11527

Cluster free memory limit check should consider L2 block cache size also when L2 cache is onheap.

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.99.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      The sum of the heap size % used by Memstore (Configured using 'hbase.regionserver.global.memstore.size' and defaults to 40%) and the that of block cache (Configured using 'hfile.block.cache.size' and defaults to 40%) should leave enough heap size for other normal operations of RS. This is 20%. Also to be noted that when the L2 block cache (ie. Bucket cache) is configured to be on heap, the size of that also comes into this size math. So in that case the sum of memstore heap size, L1 block cache size and L2 cache size (Configured using 'hbase.bucketcache.size')can be at max 80%.
      When automatic tuning of heap memory is enabled (HBASE-5349) at point of time this 80% cap should hold.
      Show
      The sum of the heap size % used by Memstore (Configured using 'hbase.regionserver.global.memstore.size' and defaults to 40%) and the that of block cache (Configured using 'hfile.block.cache.size' and defaults to 40%) should leave enough heap size for other normal operations of RS. This is 20%. Also to be noted that when the L2 block cache (ie. Bucket cache) is configured to be on heap, the size of that also comes into this size math. So in that case the sum of memstore heap size, L1 block cache size and L2 cache size (Configured using 'hbase.bucketcache.size')can be at max 80%. When automatic tuning of heap memory is enabled ( HBASE-5349 ) at point of time this 80% cap should hold.

      Attachments

      1. HBASE-11527.patch
        30 kB
        Anoop Sam John
      2. HBASE-11527_addendum.patch
        8 kB
        Anoop Sam John
      3. HBASE-11527_0.99.patch
        36 kB
        Anoop Sam John

        Activity

          People

          • Assignee:
            anoop.hbase Anoop Sam John
            Reporter:
            anoop.hbase Anoop Sam John
          • Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved: