Details
-
Improvement
-
Status: Resolved
-
Major
-
Resolution: Won't Do
-
None
-
None
-
None
-
None
Description
YARN-6675 adds NM over-allocation support by modifying the existing ContainerScheduler and providing a utilizationBased resource tracker.
However, the implementation adds a lot of complexity to ContainerScheduler, and future tweak of over-allocation strategy based on how much containers have been launched is even more complicated.
As such, this Jira proposes a new ContainerScheduler that always launch guaranteed containers immediately and queues opportunistic containers. It relies on a periodical check to launch opportunistic containers.
Attachments
Attachments
Issue Links
- supercedes
-
YARN-6675 Add NM support to launch opportunistic containers based on overallocation
- Resolved