[YARN-9015] [DevicePlugin] Add an interface for device plugin to provide customized scheduler

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.3.0
• Hadoop Flags: Reviewed
• Assignee: Zhankun Tang
• Reporter: Zhankun Tang
• Created: 13/Nov/18 09:32
• Updated: 12/Dec/18 20:09
• Resolved: 12/Dec/18 19:55

Description

A vendor might need a customized scheduling policy for their devices. It could be scheduled based on topology, resource utilization, virtualization, device attribute and so on.

We'll provide another optional interface "DevicePluginScheduler" for the vendor device plugin to implement. Once it's implemented, the framework will prefer it to the default scheduler.

This would bring more flexibility to the framework's scheduling mechanism.

Issue Links

• depends upon: YARN-8882 [YARN-8851] Add a shared device mapping manager (scheduler) for device plugins