Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-4027

Enable direct byte buffers LruBlockCache

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • None
    • 0.92.0
    • None
    • None
    • Reviewed
    • Hide
      Setting hbase.offheapcachesize in hbase-site.xml and -XX:MaxDirectMemorySize in hbase-env.sh to enable this feature. The file already has a line you can uncomment and you need to set the size of the direct memory (your total memory - size allocated to memstores - size allocated to the normal block cache - and some head room for the other functionalities).
      Show
      Setting hbase.offheapcachesize in hbase-site.xml and -XX:MaxDirectMemorySize in hbase-env.sh to enable this feature. The file already has a line you can uncomment and you need to set the size of the direct memory (your total memory - size allocated to memstores - size allocated to the normal block cache - and some head room for the other functionalities).

    Description

      Java offers the creation of direct byte buffers which are allocated outside of the heap.

      They need to be manually free'd, which can be accomplished using an documented clean method.

      The feature will be optional. After implementing, we can benchmark for differences in speed and garbage collection observances.

      Attachments

        1. 4027-v5.diff
          50 kB
          Li Pi
        2. 4027v7.diff
          52 kB
          Li Pi
        3. HBase-4027.pdf
          54 kB
          Li Pi
        4. HBase-4027 (1).pdf
          54 kB
          Li Pi
        5. hbase-4027-v10.5.diff
          62 kB
          Li Pi
        6. hbase-4027v10.6.diff
          68 kB
          Li Pi
        7. hbase-4027-v10.diff
          155 kB
          Li Pi
        8. hbase4027v11.5.diff
          68 kB
          Li Pi
        9. hbase4027v11.6.diff
          68 kB
          Li Pi
        10. hbase4027v11.7.diff
          68 kB
          Li Pi
        11. hbase4027v11.diff
          68 kB
          Li Pi
        12. hbase4027v12.1.diff
          108 kB
          Li Pi
        13. hbase4027v12.diff
          113 kB
          Li Pi
        14. hbase-4027v13.1.diff
          83 kB
          Li Pi
        15. hbase4027v15.2.diff
          91 kB
          Li Pi
        16. hbase-4027v15.3.diff
          91 kB
          Li Pi
        17. hbase-4027v6.diff
          50 kB
          Li Pi
        18. HBase4027v8.diff
          56 kB
          Li Pi
        19. HBase4027v9.diff
          56 kB
          Li Pi
        20. slabcachepatch.diff
          34 kB
          Li Pi
        21. slabcachepatchv2.diff
          33 kB
          Li Pi
        22. slabcachepatchv3.1.diff
          37 kB
          Li Pi
        23. slabcachepatchv3.2.diff
          37 kB
          Li Pi
        24. slabcachepatchv3.diff
          34 kB
          Li Pi
        25. slabcachepatchv4.5.diff
          38 kB
          Li Pi
        26. slabcachepatchv4.diff
          46 kB
          Li Pi
        There are no Sub-Tasks for this issue.

        Activity

          People

            li Li Pi
            jasonrutherglen Jason Rutherglen
            Votes:
            0 Vote for this issue
            Watchers:
            24 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: