Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-21879 Read HFile's block to ByteBuffer directly instead of to byte for reducing young gc purpose
  3. HBASE-21921

Notify users if the ByteBufAllocator is always allocating ByteBuffers from heap which means the increacing GC pressure

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      As the javadoc of ByteBuffAllocator says:

      There's possible that the desired memory size is large than ByteBufferPool has, we'll downgrade to allocate ByteBuffers from heap which meaning the GC pressure may increase again. Of course, an better way is increasing the ByteBufferPool size if we detected this case. 
      

      So I think we need some messages to remind the user that an larger ByteBufferPool size may be better if the allocator allocate ByteBuffer from heap frequently.

        Attachments

        1. HBASE-21921.HBASE-21879.v03.patch
          36 kB
          Zheng Hu
        2. HBASE-21921.HBASE-21879.v02.patch
          31 kB
          Zheng Hu
        3. web-ui.png
          87 kB
          Zheng Hu
        4. jmx-metrics.png
          175 kB
          Zheng Hu
        5. HBASE-21921.HBASE-21879.v01.patch
          17 kB
          Zheng Hu

          Issue Links

            Activity

              People

              • Assignee:
                openinx Zheng Hu
                Reporter:
                openinx Zheng Hu
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: