Affects Version/s: None
Fix Version/s: 0.21.0
observing the cluster over the last day - one thing i noticed is that small jobs (single digit tasks) are not doing a good job competing against large jobs. what seems to happen is that:
- large job comes along and needs to wait for a while for other large jobs.
- slots are slowly transfered from one large job to another
- small tasks keep waiting forever.
is this an artifact of deficit based scheduling? it seems that long pending large jobs are out-scheduling small jobs
|Status||Open [ 1 ]||Resolved [ 5 ]|
|Fix Version/s||0.21.0 [ 12314045 ]|
|Resolution||Duplicate [ 3 ]|
|Status||Resolved [ 5 ]||Closed [ 6 ]|