Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-14702

Datanode.ReplicaMap memory leak

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 2.7.1
    • Fix Version/s: None
    • Component/s: datanode
    • Labels:
      None

      Description

      DataNode memory is occupied by ReplicaMaps and cause GC high frequency then write performance degrade.
      It is about 600K block replicas located at DataNode, but when dump heap, there are over 8M items of ReplicaMaps and footprint over 500MB. It seems that memory leak. One more situation, the block w/r ops is very high.
      Do not test HDFS-8859 and no idea if it can solve this issue.

        Attachments

        1. datanode.dump.png
          465 kB
          Xiaoqiao He

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              hexiaoqiao Xiaoqiao He
            • Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

              • Created:
                Updated: