Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-6188

Fix OOM issue with decommissioningNodesWatcher in the case of clusters with large number of nodes

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.9.0
    • 2.9.0, 3.0.0-alpha4
    • resourcemanager
    • None
    • Reviewed

    Description

      LogDecommissioningNodesStatus method in DecommissioningNodesWatcher uses StringBuilder to append status of all
      decommissioning nodes for logging purpose.
      In the case of large number of decommissioning nodes, this leads to OOM exception. The fix scopes StringBuilder so that in case of memory pressure, GC can kick in and free up the memory.

      This is supposed to fix a bug introduced in https://issues.apache.org/jira/browse/YARN-4676

      Attachments

        1. YARN-6188.001.patch
          2 kB
          Ajay Jadhav
        2. YARN-6188.002.patch
          2 kB
          Ajay Jadhav
        3. YARN-6188.003.patch
          2 kB
          Ajay Jadhav

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            ajayjadhav Ajay Jadhav
            ajayjadhav Ajay Jadhav
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment