Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-1382

Remove unusableRMNodesConcurrentSet (never used) in NodeListManager to get rid of memory leak

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.2.0, 2.7.1, 2.6.2
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: resourcemanager
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      If a node is in the unusable nodes set (unusableRMNodesConcurrentSet) and never comes back, the node will be there forever.

      While the leak is not big, it gets aggravated if the NM addresses are configured with ephemeral ports as when the nodes come back they come back as new.

      Some related details in YARN-1343

        Attachments

        1. 0003-YARN-1382.patch
          3 kB
          Rohith Sharma K S
        2. 0002-YARN-1382.patch
          3 kB
          Rohith Sharma K S
        3. 0001-YARN-1382.patch
          2 kB
          Rohith Sharma K S

          Activity

            People

            • Assignee:
              rohithsharma Rohith Sharma K S
              Reporter:
              tucu00 Alejandro Abdelnur
            • Votes:
              1 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: