Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-9897

Add an Aarch64 CI for YARN

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: build, test
    • Labels:
      None

      Description

      As YARN is the resource manager of Hadoop and there are large number of other software that also uses YARN for resource management. The capability of running YARN on platforms with different architecture and managing hardware resources with different architecture could be very important and useful.

      Aarch64(ARM) architecture is currently the dominate architecture in small devices like phone, IOT devices, security cameras, drones etc. With the increasing compuiting capability and the increasing connection speed like 5G network, there could be greate posibility and opportunity for world chaging inovations and new market if we can managing and make use of those devices as well.

      Currently, all YARN CIs are based on x86 architecture and we have been performing tests on Aarch64 and proposing possible solutions for problems we have meet, like:
      https://issues.apache.org/jira/browse/HADOOP-16614
      we have done all YARN tests and it turns out there are only a few problems, and we can provide possible solutions for discussion.

      We want to propose to add an Aarch64 CI for YARN to promote the support for YARN on Aarch64 platforms. We are willing to provide machines to the current CI system and manpower to mananging the CI and fxing problems that occours.

        Attachments

        1. hadoop_build.log
          1.81 MB
          Zhenyu Zheng

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              Kevin_Zheng Zhenyu Zheng
            • Votes:
              1 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated: