Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-9473

[Umbrella] Support Vector Engine ( a new accelerator hardware) based on pluggable device framework

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.3.0
    • Component/s: nodemanager
    • Labels:
      None

      Description

      As the heterogeneous computation trend rises, new acceleration hardware like GPU, FPGA is used to satisfy various requirements.

      And a new hardware Vector Engine (VE) which released by NEC company is another example. The VE is like GPU but has different characteristics. It's suitable for machine learning and HPC due to better memory bandwidth and no PCIe bottleneck.

      Please Check here for more VE details:

      https://www.nextplatform.com/2017/11/22/deep-dive-necs-aurora-vector-engine/

      https://www.hotchips.org/hc30/2conf/2.14_NEC_vector_NEC_SXAurora_TSUBASA_HotChips30_finalb.pdf

      As we know, YARN-8851 is a pluggable device framework which provides an easy way to develop a plugin for such new accelerators. This JIRA proposes to develop a new VE plugin based on that framework and be implemented as current GPU's "NvidiaGPUPluginForRuntimeV2" plugin.

       

        Attachments

        Issue Links

          Activity

            People

            • Assignee:
              pbacsko Peter Bacsko
              Reporter:
              tangzhankun Zhankun Tang

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment