[YARN-5919] FairSharePolicy is not reasonable when sorting the application

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 2.7.1
• Component/s: yarn
• Labels: fairscheduler

Environment

CentOS-7.1

• Flags: Patch
• Assignee: Unassigned
• Reporter: Chenyu Zheng
• Created: 21/Nov/16 10:01
• Updated: 08/Dec/16 00:38

Description

I use the FairSharePolicy to sort the runnableApps in FSLeafQueue. For the comparation of FSAppAttempt, s1Needy and s1Needy must be negtive. So FairSharePolicy will use useToWeightRatio to compare. This algorithm only consider the ResourceUsage of the FSAppAttempt. There is a unreasonable phenomenon: A low ResourceUsage FsAppAttemp with no demand(or request) will be in front of the queue, then skip this chance of assigning container.