[YARN-8159] [Umbrella] Fixes for Multiple Resource Type Preemption in Capacity Scheduler

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: capacity scheduler
• Assignee: Unassigned
• Reporter: Zian Chen
• Created: 13/Apr/18 01:08
• Updated: 14/Apr/18 18:01

Description

There're a couple of JIRAs open for multiple resource types preemption in CS. It might be better to group them to make sure everybody is on the same page. 

In addition to that, I don't believe our preemption logic can properly handle multiple resource type preemption when YARN-5881 is being used. (Different percentage of shares for different resource types). We may need some overhaul of the preemption logics for that.

Sub-Tasks

• when DRF is used, preemption does not trigger due to incorrect idealAssigned: Open
• Inter Queue preemption is not happening when DRF is configured: Patch Available
• Add unit test to validate queue priority preemption works under node partition.: Resolved