Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-14793

Allow limiting size of block into L1 block cache.

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.2.0, 1.1.2
    • Fix Version/s: 1.2.0, 1.3.0, 0.98.17, 2.0.0
    • Component/s: BlockCache
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      Very large blocks can fragment the heap and cause bad issues for the garbage collector, especially the G1GC. Now there is a maximum size that a block can be and still stick in the LruBlockCache. That size defaults to 16mb but can be controlled by changing "hbase.lru.max.block.size"
      Show
      Very large blocks can fragment the heap and cause bad issues for the garbage collector, especially the G1GC. Now there is a maximum size that a block can be and still stick in the LruBlockCache. That size defaults to 16mb but can be controlled by changing "hbase.lru.max.block.size"

      Description

      G1GC does really badly with long lived large objects. Lets allow limiting the size of a block that can be kept in the block cache.

        Attachments

        1. HBASE-14793.patch
          7 kB
          Elliott Neil Clark
        2. HBASE-14793-v1.patch
          7 kB
          Elliott Neil Clark
        3. HBASE-14793-v3.patch
          16 kB
          Elliott Neil Clark
        4. HBASE-14793-v4.patch
          16 kB
          Elliott Neil Clark
        5. HBASE-14793-v5.patch
          17 kB
          Elliott Neil Clark
        6. HBASE-14793-v6.patch
          17 kB
          Elliott Neil Clark
        7. HBASE-14793-v7.patch
          17 kB
          Elliott Neil Clark

          Issue Links

            Activity

              People

              • Assignee:
                eclark Elliott Neil Clark
                Reporter:
                eclark Elliott Neil Clark
              • Votes:
                0 Vote for this issue
                Watchers:
                12 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: