[YARN-1197] Support changing resources of an allocated container

• Type: Task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 2.1.0-beta
• Component/s: api, graceful, nodemanager, resourcemanager
• Assignee: Unassigned
• Reporter: Wangda Tan
• Created: 13/Sep/13 08:51
• Updated: 31/Jan/19 16:54

Description

The current YARN resource management logic assumes resource allocated to a container is fixed during the lifetime of it. When users want to change a resource
of an allocated container the only way is releasing it and allocating a new container with expected size.
Allowing run-time changing resources of an allocated container will give us better control of resource usage in application side

Issue Links

• is depended upon by: SLIDER-938 Add ability to resize containers (Hadoop 2.8+)
• is depended upon by: YARN-896 Roll up for long-lived services in YARN
• is related to: YARN-5085 Add support for change of container ExecutionType
• is related to: YARN-4080 Capacity planning for long running services on YARN
• relates to: MAPREDUCE-7180 Relaunching Failed Containers
• relates to: SPARK-3174 Provide elastic scaling within a Spark application

Sub-Tasks

• Add implementations to FairScheduler to support increase/decrease container resource: Patch Available
• Example of use YARN-1197: In Progress