Details
-
Sub-task
-
Status: Open
-
Major
-
Resolution: Unresolved
-
None
-
None
-
None
Description
In order to provide a global optimal scheduling for mutable FPGA resource, it seems an easy and direct way to utilize constraint node labels(YARN-3409) instead of extending the global scheduler(YARN-3926) to match both resource count and attributes.
The rough idea is that the AM sets the constraint node label expression to request containers on the nodes whose FPGA devices has the matching IP, and then NM resource handler update the node constraint label if there's FPGA device re-configuration.