[YARN-4433] Minimum and increment capacity support should be supported by AbstractYarnScheduler

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Assignee: Wangda Tan
• Reporter: Wangda Tan
• Created: 08/Dec/15 01:07
• Updated: 08/Dec/15 01:14

Description

Currently, only FairScheduler supports increment capacity different from minimum capacity, it will be useful if we can support this feature in other schedulers.

Default behavior of minimum/increment resources:

• Minimum-allocation should > 0
• Minimum-allocation should be multiple times of increment (to avoid resource fragmentation).

Different scheduler implementation can overwrite this behavior.

With this we can have a more fine-grained granularity of resources allocation. (In existing CapacityScheduler without this feature, if minimum-allocation set to 5G, you can only get 5G, 10G, .... With this feature, if you have minimum-allocation set to 5G, and increment-allocation set to 1G, you can ask 5G, 6G, 7G...)