Uploaded image for project: 'Bigtop'
  1. Bigtop
  2. BIGTOP-3473

Building Hadoop 3.2.1 fails in checking jar contents



    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • None
    • 3.0.0
    • hadoop
    • None


      I encountered the following error in building Hadoop 3.2.1 on some distros.

      $ git status 
      On branch master
      Your branch is up to date with 'origin/master'.
      nothing to commit, working tree clean
      $ git log -1
      commit 26a92e4340fee6ab2f6aa6a5925faf33d41ec181 (HEAD -> master, upstream/master, origin/master, origin/HEAD)
      Author: Masatake Iwasaki <iwasakims@apache.org>
      Date:   Fri Dec 18 22:12:14 2020 +0900
          BIGTOP-3280. Bump Hadoop to 3.2.1. (#704)
      $ ./gradlew allclean hadoop-pkg -Dbuildwithdeps=true
      [INFO] -------< org.apache.hadoop:hadoop-client-check-test-invariants >--------
      [INFO] Building Apache Hadoop Client Packaging Invariants for Test 3.2.1 [92/97]
      [INFO] --------------------------------[ pom ]---------------------------------
      [INFO] --- exec-maven-plugin:1.3.1:exec (check-jar-contents) @ hadoop-client-check-test-invariants ---
      [ERROR] Found artifact with unexpected contents: '/home/vagrant/bigtop/output/hadoop/hadoop-3.2.1/hadoop-client-modules/hadoop-client-minicluster/target/hadoop-client-minicluster-3.2.1.jar'
          Please check the following and either correct the build or update
          the allowed list with reasoning.
      [INFO] ------------------------------------------------------------------------
      [INFO] Reactor Summary:
      [INFO] Apache Hadoop Main 3.2.1 ........................... SUCCESS [01:37 min]
      [INFO] Apache Hadoop Client Test Minicluster .............. SUCCESS [02:59 min]
      [INFO] Apache Hadoop Client Packaging Invariants for Test . FAILURE [  0.695 s]
      [INFO] Apache Hadoop Client Packaging Integration Tests ... SKIPPED
      [INFO] Apache Hadoop Distribution ......................... SKIPPED
      [INFO] Apache Hadoop Client Modules ....................... SKIPPED
      [INFO] Apache Hadoop Cloud Storage ........................ SKIPPED
      [INFO] Apache Hadoop Cloud Storage Project 3.2.1 .......... SKIPPED
      [INFO] ------------------------------------------------------------------------
      [INFO] ------------------------------------------------------------------------
      [INFO] Total time: 46:00 min
      [INFO] Finished at: 2021-01-05T05:09:23Z
      [INFO] ------------------------------------------------------------------------
      [ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.3.1:exec (check-jar-contents) on project hadoop-client-check-test-invariants: Command execution failed.: Process exited with an error: 1 (Exit value: 1) -> [Help 1]
      [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
      [ERROR] Re-run Maven using the -X switch to enable full debug logging.
      [ERROR] For more information about the errors and possible solutions, please read the following articles:
      [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
      [ERROR] After correcting the problems, you can resume the build with the command
      [ERROR]   mvn <goals> -rf :hadoop-client-check-test-invariants
      debian/rules:39: recipe for target 'override_dh_auto_build' failed
      make[1]: *** [override_dh_auto_build] Error 1
      make[1]: Leaving directory '/home/vagrant/bigtop/output/hadoop/hadoop-3.2.1'
      debian/rules:27: recipe for target 'build' failed
      make: *** [build] Error 2
      dpkg-buildpackage: error: debian/rules build subprocess returned exit status 2
      debuild: fatal error at line 1152:
      dpkg-buildpackage -rfakeroot -us -uc -ui -b
      > Task :hadoop-deb FAILED
      FAILURE: Build failed with an exception.


        Issue Links



              iwasakims Masatake Iwasaki
              sekikn Kengo Seki
              0 Vote for this issue
              2 Start watching this issue