Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-14702

Datanode.ReplicaMap memory leak

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 2.7.1
    • None
    • datanode
    • None

    Description

      DataNode memory is occupied by ReplicaMaps and cause GC high frequency then write performance degrade.
      It is about 600K block replicas located at DataNode, but when dump heap, there are over 8M items of ReplicaMaps and footprint over 500MB. It seems that memory leak. One more situation, the block w/r ops is very high.
      Do not test HDFS-8859 and no idea if it can solve this issue.

      Attachments

        1. datanode.dump.png
          465 kB
          Xiaoqiao He

        Activity

          People

            Unassigned Unassigned
            hexiaoqiao Xiaoqiao He
            Votes:
            0 Vote for this issue
            Watchers:
            10 Start watching this issue

            Dates

              Created:
              Updated: