Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-9473

[Umbrella] Support Vector Engine ( a new accelerator hardware) based on pluggable device framework

    Details

    • Type: New Feature
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: nodemanager
    • Labels:
      None

      Description

      As the heterogeneous computation trend rises, new acceleration hardware like GPU, FPGA is used to satisfy various requirements.

      And a new hardware Vector Engine (VE) which released by NEC company is another example. The VE is like GPU but has different characteristics. It's suitable for machine learning and HPC due to better memory bandwidth and no PCIe bottleneck.

      Please Check here for more VE details:

      https://www.nextplatform.com/2017/11/22/deep-dive-necs-aurora-vector-engine/

      https://www.hotchips.org/hc30/2conf/2.14_NEC_vector_NEC_SXAurora_TSUBASA_HotChips30_finalb.pdf

      As we know, YARN-8851 is a pluggable device framework which provides an easy way to develop a plugin for such new accelerators. This JIRA proposes to develop a new VE plugin based on that framework and be implemented as current GPU's "NvidiaGPUPluginForRuntimeV2" plugin.

       

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                pbacsko Peter Bacsko
                Reporter:
                tangzhankun Zhankun Tang
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated: