Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-16358

Add an ARM CI for Hadoop

    XMLWordPrintableJSON

    Details

    • Type: Task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.3.0
    • Component/s: build
    • Labels:
      None

      Description

      Now the CI of Hadoop is handled by jenkins. While the tests are running under x86 ARCH, the ARM arch has not being considered. This leads an problem that we don't have a way to test every pull request that if it'll break the Hadoop deployment on ARM or not.

      We should add a CI system that support ARM arch. Using it, Hadoop can officially support arm release in the future. Here I'd like to introduce OpenLab to the community. OpenLab is a open source CI system that can test any open source software on either x86 or arm ARCH, it's mainly used by github projects. Now some projects has integrated it already. Such as containerd (a graduated CNCF project, the arm build will be triggerd in every PR, https://github.com/containerd/containerd/pulls), terraform and so on.

      OpenLab uses the open source CI software Zuul for CI system. Zuul is used by OpenStack community as well. integrating with OpneLab is quite easy using its github app. All config info is open source as well.

      If apache Hadoop community has interested with it, we can help for the integration.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Kevin_Zheng Zhenyu Zheng
                Reporter:
                Kevin_Zheng Zhenyu Zheng
              • Votes:
                2 Vote for this issue
                Watchers:
                14 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: