Details
-
Improvement
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
Description
At now, our scheduling policies become stackable stateless filter functions which filter executors which can run specific task (NEMO-53). If we make this scheduling policy (or scheduling filter) as an execution property on each vertex, we can modify the scheduling behavior of the target vertices only. This can make our scheduling more flexible.
Attachments
Issue Links
- blocks
-
NEMO-59 Skewed data-aware executor allocation
- Resolved
-
NEMO-71 Add LocationShareAssignmentPass and Example Application
- Resolved
-
NEMO-51 Intermediate data location aware scheduling
- Resolved
-
NEMO-75 Rename SchedulingPolicy
- Resolved
- is blocked by
-
NEMO-53 Make SchedulingPolicy Stackable
- Resolved
-
NEMO-102 Stage Partitioning by PhysicalPlanGenerator
- Resolved
- links to