HBase
  1. HBase
  2. HBASE-10191 Move large arena storage off heap
  3. HBASE-10655

ByteRange-fronted slab allocator for on- and off-heap cellblock storage

    Details

    • Type: Sub-task Sub-task
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Our ByteRange interface has some nice properties such as a compareTo method using hbase-friendly unsigned byte comparison. This can be backed by either on-heap or off-heap byte buffers. Consider an allocator that internally allocates huge on or off-heap slabs and hands out ByteRanges over portions of those arenas. Keep it as simple as possible, optimized for HBase needs. Can be fairly standalone with respect to the rest of the HBase code.

        Issue Links

          Activity

          Andrew Purtell made changes -
          Link This issue is related to HDFS-6709 [ HDFS-6709 ]
          Andrew Purtell made changes -
          Assignee Andrew Purtell [ apurtell ]
          Andrew Purtell made changes -
          Summary ByteBuf-fronted slab allocator for on- and off-heap cellblock storage ByteRange-fronted slab allocator for on- and off-heap cellblock storage
          Andrew Purtell made changes -
          Description Our ByteRange interface has some nice properties such as a compareTo method using hbase-friendly unsigned byte comparison. This can be backed by either on-heap or off-heap byte buffers. Consider an allocator that internally allocaetes huge on or off-heap slabs and hands out ByteRangers over portions of those arenas. Keep it as simple as possible, optimized for HBase needs. Can be fairly standalone with respect to the rest of the HBase code. Our ByteRange interface has some nice properties such as a compareTo method using hbase-friendly unsigned byte comparison. This can be backed by either on-heap or off-heap byte buffers. Consider an allocator that internally allocates huge on or off-heap slabs and hands out ByteRanges over portions of those arenas. Keep it as simple as possible, optimized for HBase needs. Can be fairly standalone with respect to the rest of the HBase code.
          Andrew Purtell made changes -
          Description Our ByteRange interface has some nice properties such as a compareTo method using hbase-friendly unsigned byte comparison. This can be backed by either on-heap or off-heap byte buffers. Consider an allocator that internally allocaetes huge on or off-heap slabs and hands out ByteRangers over portions of those arenas. Keep it as simple as possible, optimized for HBase needs. Can be fairly standalone with respect to the rest of the HBase code.
          Andrew Purtell made changes -
          Field Original Value New Value
          Assignee Andrew Purtell [ apurtell ]
          Andrew Purtell created issue -

            People

            • Assignee:
              Unassigned
              Reporter:
              Andrew Purtell
            • Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:

                Development