Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-34341

./build/mvn error output on aarch64

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 3.1.2
    • 3.2.0
    • Build
    • None

    Description

      You can see the below error ouput in every spark arm jenkins job [1]:

      /build/zinc-0.3.15/bin/nailgun: line 50: /root/dev/spark/build/zinc-0.3.15/bin/ng/linux32/ng: cannot execute binary file: Exec format error

      And you can also reproduce this error output using the simple cmd: `build/mvn -v` on aarch64:

      root@yikun-arm:~/dev/spark# uname -a
      Linux yikun-arm 4.15.0-70-generic #79-Ubuntu SMP Tue Nov 12 10:36:10 UTC 2019 aarch64 aarch64 aarch64 GNU/Linux
      root@yikun-arm:~/dev/spark# uname -m
      aarch64
      root@yikun-arm:~/dev/spark# build/mvn -v
      /root/dev/spark/build/zinc-0.3.15/bin/nailgun: line 50: /root/dev/spark/build/zinc-0.3.15/bin/ng/linux32/ng: cannot execute binary file: Exec format error
      /root/dev/spark/build/zinc-0.3.15/bin/nailgun: line 50: /root/dev/spark/build/zinc-0.3.15/bin/ng/linux32/ng: cannot execute binary file: Exec format error
      Using `mvn` from path: /root/dev/spark/build/apache-maven-3.6.3/bin/mvn
      Apache Maven 3.6.3 (cecedd343002696d0abb50b32b541b8a6ba2883f)
      Maven home: /root/dev/spark/build/apache-maven-3.6.3
      Java version: 1.8.0_222, vendor: Private Build, runtime: /usr/lib/jvm/java-8-openjdk-arm64/jre
      Default locale: en, platform encoding: UTF-8
      OS name: "linux", version: "4.15.0-70-generic", arch: "aarch64", family: "unix"
      /root/dev/spark/build/zinc-0.3.15/bin/nailgun: line 50: /root/dev/spark/build/zinc-0.3.15/bin/ng/linux32/ng: cannot execute binary file: Exec format error

      The reason of this error output is that the zinc is not supported well on aarch64, unfortunately, the stand alone zinc is deprecated now[2], so that we have no chance to support it on aarch64 in stand alone verison.

      Looks like we should skip the zinc related command on aarch64 platform first, and then upgrade the sbt/zinc[3] in future.
       

      [1] https://amplab.cs.berkeley.edu/jenkins/job/spark-master-test-maven-arm/547/consoleFull
      [2] https://github.com/typesafehub/zinc
      [3] https://github.com/sbt/zinc

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            yikunkero Yikun Jiang
            yikunkero Yikun Jiang
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment