[YARN-6963] Prevent other containers from staring when a container is re-initializing - ASF JIRA

Add vote

Voters

Watch issue

Watchers

Create sub-task

Link

Clone

Update Comment Author

Replace String in Comment

Update Comment Visibility

Delete Comments

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Open
Priority: Major
Resolution: Unresolved
Affects Version/s: None
Fix Version/s: None
Component/s: None
Labels:
None

Target Version/s:

3.4.0

Description

Further to discussions in ~~YARN-6920~~.
Container re-initialization will lead to momentary relinquishing of NM resources when the container is brought down followed by re-claiming of the same resources when it is re-launched. If there are Opportunistic containers in the queue, it can lead to un-necessary churn if one of those opportunistic containers are started and immediately killed.
This JIRA tracks changes required to prevent the above by ensuring the resources for a container are 'locked' for the during of the container lifetime - including the time it takes for a re-initialization.