Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-6188

Fix OOM issue with decommissioningNodesWatcher in the case of clusters with large number of nodes

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.9.0
    • Fix Version/s: 2.9.0, 3.0.0-alpha4
    • Component/s: resourcemanager
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      LogDecommissioningNodesStatus method in DecommissioningNodesWatcher uses StringBuilder to append status of all
      decommissioning nodes for logging purpose.
      In the case of large number of decommissioning nodes, this leads to OOM exception. The fix scopes StringBuilder so that in case of memory pressure, GC can kick in and free up the memory.

      This is supposed to fix a bug introduced in https://issues.apache.org/jira/browse/YARN-4676

        Attachments

        1. YARN-6188.003.patch
          2 kB
          Ajay Jadhav
        2. YARN-6188.002.patch
          2 kB
          Ajay Jadhav
        3. YARN-6188.001.patch
          2 kB
          Ajay Jadhav

          Activity

            People

            • Assignee:
              ajayjadhav Ajay Jadhav
              Reporter:
              ajayjadhav Ajay Jadhav
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: