[YARN-5541] Handling of opportunistic containers in the NM

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Assignee: Unassigned
• Reporter: Konstantinos Karanasos
• Created: 19/Aug/16 21:25
• Updated: 15/Nov/16 18:24

Description

I am creating this JIRA in order to group all tasks related to the management of opportunistic containers in the NMs, such as the queuing of containers, the pausing of containers and the prioritization of queued containers.

Issue Links

• is related to: YARN-2882 Add an OPPORTUNISTIC ExecutionType
• is related to: YARN-2883 Queuing of container requests in the NM
• is related to: YARN-5292 NM Container lifecycle and state transitions to support for PAUSED container state.
• relates to: YARN-4742 [Umbrella] Enhancements to Distributed Scheduling
• relates to: YARN-5542 Scheduling of opportunistic containers
• requires: YARN-4597 Introduce ContainerScheduler and a SCHEDULED state to NodeManager container lifecycle

Sub-Tasks

• Dynamically prioritize execution of opportunistic containers (NM queue reordering): Open
• Policies for choosing which opportunistic containers to kill: Open
• Cleanup ContainerScheduler tests to remove long sleep times: Open