Details
-
Improvement
-
Status: Closed
-
Major
-
Resolution: Fixed
-
0.20.205.0
-
None
-
None
-
0.20.1xx-Secondary
Description
In capacity scheduler, number of users in a queue needing slots are calculated based on whether users' jobs have any pending tasks.
This works fine for map tasks. However, for reduce tasks, jobs do not need reduce slots until the minimum number of map tasks have been completed.
Here, we add checking whether reduce is ready to schedule (i.e. if a job has completed enough map tasks) when we increment number of users in a queue needing reduce slots.