[YARN-6216] Unify Container Resizing code paths with Container Updates making it scheduler agnostic

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0-alpha2
• Fix Version/s: 2.9.0, 3.0.0-alpha4
• Component/s: capacity scheduler, fairscheduler, resourcemanager
• Target Version/s: 2.9.0, 3.0.0-alpha4
• Assignee: Arun Suresh
• Reporter: Arun Suresh
• Created: 22/Feb/17 14:20
• Updated: 01/Feb/19 09:02
• Resolved: 14/Apr/17 02:29

Description

YARN-5959 introduced an ContainerUpdateContext which can be used to update the ExecutionType of a container in a scheduler agnostic manner. As mentioned in that JIRA, extending that to encompass Container resizing is trivial.
This JIRA proposes to remove all the CapacityScheduler specific code paths. (CapacityScheduler, CSQueue, FicaSchedulerApp etc.) and modify the code to use the framework introduced in YARN-5959 without any loss of functionality.

Issue Links

• incorporates: YARN-6181 SchedulerRequestKey compareTo method neglects to compare containerToUpdate
• is related to: YARN-6251 Do async container release to prevent deadlock during container updates
• is required by: YARN-1655 Add implementations to FairScheduler to support increase/decrease container resource
• relates to: YARN-5959 RM changes to support change of container ExecutionType
• supercedes: YARN-1651 CapacityScheduler side changes to support increase/decrease container resource.