Description
At present, we support GPU/FPGA device in YARN through a native, coupling way. But it's difficult for a vendor to implement such a device plugin because the developer needs much knowledge of YARN internals. And this brings burden to the community to maintain both YARN core and vendor-specific code.
Here we propose a new device plugin framework to ease vendor device plugin development and provide a more flexible way to integrate with YARN NM.
Attachments
Attachments
Issue Links
- relates to
-
YARN-9473 [Umbrella] Support Vector Engine ( a new accelerator hardware) based on pluggable device framework
-
- Resolved
-