[YARN-10795] [Umbrella] Improve Capacity Scheduler reinitialisation performance - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Resolved
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: None
Component/s: capacity scheduler
Labels:
None

Description

Mostly due to CapacitySchedulerConfiguration#getPropsWithPrefix or similar methods, the CapacityScheduler#reinit method has some quadratic complexity part with respect to queue numbers. Over 1000+ queues, it is a matter of minutes, which is too high to be a viable option when it is used in mutation api.

Attachments

Sub-Tasks

There are no Sub-Tasks for this issue.

Activity

People

Assignee:: Unassigned

Reporter:: Andras Gyori

Votes:: 0 Vote for this issue

Watchers:: 3 Start watching this issue

Dates

Created:: 31/May/21 07:00

Updated:: 16/Feb/22 14:00

Resolved:: 06/Oct/21 10:11

Time Tracking

Estimated:

Not Specified

Remaining:

Logged:

2h 10m

Include sub-tasks