-
Type:
Improvement
-
Status: Resolved
-
Priority:
Major
-
Resolution: Won't Do
-
Affects Version/s: None
-
Fix Version/s: None
-
Component/s: None
-
Labels:None
YARN-6675 adds NM over-allocation support by modifying the existing ContainerScheduler and providing a utilizationBased resource tracker.
However, the implementation adds a lot of complexity to ContainerScheduler, and future tweak of over-allocation strategy based on how much containers have been launched is even more complicated.
As such, this Jira proposes a new ContainerScheduler that always launch guaranteed containers immediately and queues opportunistic containers. It relies on a periodical check to launch opportunistic containers.
- supercedes
-
YARN-6675 Add NM support to launch opportunistic containers based on overallocation
-
- Resolved
-