[YARN-313] Add Admin API for supporting node resource configuration in command line

• Type: Sub-task
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 2.8.0, 3.0.0-alpha1
• Component/s: client, graceful
• Target Version/s: 2.8.0

Release Note

After this patch, the feature to support NM resource dynamically configuration is completed, so that user can configure NM with new resource without bring NM down or decommissioned.
Two CLIs are provided to support update resources on individual node or a batch of nodes:
1. Update resource on single node: yarn rmadmin -updateNodeResource [NodeID] [MemSize] [vCores]
2. Update resource on a batch of nodes: yarn rmadmin -refreshNodesResources, that reflect nodes' resource configuration defined in dynamic-resources.xml which is loaded by RM dynamically (like capacity-scheduler.xml or fair-scheduler.xml).
The first version of configuration format is:
<configuration>
  <property>
    <name>yarn.resource.dynamic.nodes</name>
    <value>h1:1234</value>
  </property>
  <property>
    <name>yarn.resource.dynamic.h1:1234.vcores</name>
    <value>16</value>
  </property>
  <property>
    <name>yarn.resource.dynamic.h1:1234.memory</name>
    <value>1024</value>
  </property>
</configuration>

• Assignee: Íñigo Goiri
• Reporter: Junping Du
• Created: 04/Jan/13 04:04
• Updated: 25/Oct/19 20:27
• Resolved: 15/Sep/15 15:21

Description

We should provide some admin interface, e.g. "yarn rmadmin -refreshResources" to support changes of node's resource specified in a config file.

Issue Links

• is blocked by: YARN-1506 Replace set resource change on RMNode/SchedulerNode directly with event notification.
• is blocked by: YARN-312 Add updateNodeResource in ResourceManagerAdministrationProtocol
• is depended upon by: YARN-4160 Dynamic NM Resources Configuration file should be simplified.