Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-8851

[Umbrella] A pluggable device plugin framework to ease vendor plugin development

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: yarn
    • Labels:
      None

      Description

      At present, we support GPU/FPGA device in YARN through a native, coupling way. But it's difficult for a vendor to implement such a device plugin because the developer needs much knowledge of YARN internals. And this brings burden to the community to maintain both YARN core and vendor-specific code.

      Here we propose a new device plugin framework to ease vendor device plugin development and provide a more flexible way to integrate with YARN NM.

        Attachments

        1. [YARN-8851] YARN_New_Device_Plugin_Framework_Design_Proposal.pdf
          457 kB
          Zhankun Tang
        2. [YARN-8851] YARN_New_Device_Plugin_Framework_Design_Proposal-3.pdf
          457 kB
          Zhankun Tang
        3. [YARN-8851] YARN_New_Device_Plugin_Framework_Design_Proposal-4.pdf
          471 kB
          Zhankun Tang
        4. YARN-8851-trunk.001.patch
          137 kB
          Zhankun Tang
        5. YARN-8851-trunk.002.patch
          138 kB
          Zhankun Tang
        6. YARN-8851-WIP2-trunk.001.patch
          45 kB
          Zhankun Tang
        7. YARN-8851-WIP3-trunk.001.patch
          45 kB
          Zhankun Tang
        8. YARN-8851-WIP4-trunk.001.patch
          48 kB
          Zhankun Tang
        9. YARN-8851-WIP5-trunk.001.patch
          96 kB
          Zhankun Tang
        10. YARN-8851-WIP6-trunk.001.patch
          97 kB
          Zhankun Tang
        11. YARN-8851-WIP7-trunk.001.patch
          111 kB
          Zhankun Tang
        12. YARN-8851-WIP8-trunk.001.patch
          128 kB
          Zhankun Tang
        13. YARN-8851-WIP9-trunk.001.patch
          131 kB
          Zhankun Tang

          Issue Links

            Activity

              People

              • Assignee:
                tangzhankun Zhankun Tang
                Reporter:
                tangzhankun Zhankun Tang
              • Votes:
                0 Vote for this issue
                Watchers:
                15 Start watching this issue

                Dates

                • Created:
                  Updated: