Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-24051

When the data directory is set to EC,the amount of storefiles reaches a relatively high level,heap Occupancy Percent is above heap occupancy alarm watermark,resulting in frequent gc and eventual failure

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Reopened
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 2.0.1
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      When the data directory is set to EC, during the continuous load process, regionserver is found down ,to view the log:

      regionserver.HeapMemoryManager: heapOccupancyPercent 0.91630864 is now below the heap occupancy alarm watermark (0.95)

      regionserver.HeapMemoryManager: heapOccupancyPercent 0.969546 is above heap occupancy alarm watermark (0.95)

      [JvmPauseMonitor] util.JvmPauseMonitor: Detected pause in JVM or host machine (eg GC): pause of approximately 1254ms
      GC pool 'G1 Young Generation' had collection(s): count=2 time=115ms
      GC pool 'G1 Old Generation' had collection(s): count=1 time=1487ms

      In particular, GC pauses occurred 283 times in half an hour.

      The memory analysis found that most of the memory footprint was generated by HeepByteBuffer,and DFSStripedInputStream produces the HeepByteBuffer

      See HDFS-14308,but after the fix, hbase did not return to normal.

        Attachments

        1. 1.png
          180 kB
          shenshengli

          Issue Links

            Activity

              People

              • Assignee:
                shenshengli shenshengli
                Reporter:
                shenshengli shenshengli
              • Votes:
                0 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated: