Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-558

Add ability to completely remove nodemanager from resourcemanager.

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: resourcemanager
    • Labels:

      Description

      I would like to add the ability to completely remove a nodemanager from the resourcemanager's state.

      I run a cloud service where I want to dynamically bring up nodes to act as nodemanagers and then bring them down again when not needed. These nodes have dynamically assigned IPs, thus the alternative of decommissioning them via an excludes file leads to a large (unbounded) list of decommissioned nodes that may never be commissioned again. I would like the ability to move a node from a decommissioned state to completely removing it from the resource manager.

      I have thought of two ways of implementing this.

      1) Add an optional timeout between the decommission state -> being removed from the nodemanager.

      2) Add an explicit RPC to remove a node that is decommissioned.

      Any additional thoughts/discussion are welcome.

        Attachments

          Activity

            People

            • Assignee:
              luhuichun luhuichun
              Reporter:
              ggoodson Garth Goodson
            • Votes:
              1 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

              • Created:
                Updated: