[REEF-35] Include vCore-checking in the YARN Container matching algorithm

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: REEF-Runtime-YARN
• Assignee: John Yang
• Reporter: John Yang
• Created: 11/Nov/14 07:13
• Updated: 12/Nov/14 01:01

Description

This issue has been discovered while working on REEF-6.

As a workaround for YARN-2380, the part that examines vCores was removed from the matching algorithm

But this can result in allocating less vCores than requested. This happens when not using the default CapacityScheduler and also when certain race conditions are met.

Once YARN-2380 is resolved, we should be able to do vCore matching again.

Issue Links

• is blocked by: YARN-2380 The normalizeRequests method in SchedulerUtils always resets the vCore to 1