HBase
  1. HBase
  2. HBASE-4027

Enable direct byte buffers LruBlockCache

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.92.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      Setting hbase.offheapcachesize in hbase-site.xml and -XX:MaxDirectMemorySize in hbase-env.sh to enable this feature. The file already has a line you can uncomment and you need to set the size of the direct memory (your total memory - size allocated to memstores - size allocated to the normal block cache - and some head room for the other functionalities).
      Show
      Setting hbase.offheapcachesize in hbase-site.xml and -XX:MaxDirectMemorySize in hbase-env.sh to enable this feature. The file already has a line you can uncomment and you need to set the size of the direct memory (your total memory - size allocated to memstores - size allocated to the normal block cache - and some head room for the other functionalities).

      Description

      Java offers the creation of direct byte buffers which are allocated outside of the heap.

      They need to be manually free'd, which can be accomplished using an documented clean method.

      The feature will be optional. After implementing, we can benchmark for differences in speed and garbage collection observances.

      1. slabcachepatchv4.diff
        46 kB
        Li Pi
      2. slabcachepatchv4.5.diff
        38 kB
        Li Pi
      3. slabcachepatchv3.diff
        34 kB
        Li Pi
      4. slabcachepatchv3.2.diff
        37 kB
        Li Pi
      5. slabcachepatchv3.1.diff
        37 kB
        Li Pi
      6. slabcachepatchv2.diff
        33 kB
        Li Pi
      7. slabcachepatch.diff
        34 kB
        Li Pi
      8. HBase4027v9.diff
        56 kB
        Li Pi
      9. HBase4027v8.diff
        56 kB
        Li Pi
      10. hbase-4027v6.diff
        50 kB
        Li Pi
      11. hbase-4027v15.3.diff
        91 kB
        Li Pi
      12. hbase4027v15.2.diff
        91 kB
        Li Pi
      13. hbase-4027v13.1.diff
        83 kB
        Li Pi
      14. hbase4027v12.diff
        113 kB
        Li Pi
      15. hbase4027v12.1.diff
        108 kB
        Li Pi
      16. hbase4027v11.diff
        68 kB
        Li Pi
      17. hbase4027v11.7.diff
        68 kB
        Li Pi
      18. hbase4027v11.6.diff
        68 kB
        Li Pi
      19. hbase4027v11.5.diff
        68 kB
        Li Pi
      20. hbase-4027-v10.diff
        155 kB
        Li Pi
      21. hbase-4027v10.6.diff
        68 kB
        Li Pi
      22. hbase-4027-v10.5.diff
        62 kB
        Li Pi
      23. HBase-4027 (1).pdf
        54 kB
        Li Pi
      24. HBase-4027.pdf
        54 kB
        Li Pi
      25. 4027v7.diff
        52 kB
        Li Pi
      26. 4027-v5.diff
        50 kB
        Li Pi

        Activity

        No work has yet been logged on this issue.

          People

          • Assignee:
            Li Pi
            Reporter:
            Jason Rutherglen
          • Votes:
            0 Vote for this issue
            Watchers:
            21 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development