[OOZIE-3213] Oozie mkdistro.sh failing with oozie-core-4.3.1-tests.jar isn't a file

• Type: Bug
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 4.3.1
• Component/s: build, scripts

Environment

$ uname -a
Linux testlab 4.13.0-38-generic #43~16.04.1-Ubuntu SMP Wed Mar 14 17:48:43 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux

 

$ mvn -v
Apache Maven 3.3.9
Maven home: /usr/share/maven
Java version: 1.8.0_162, vendor: Oracle Corporation
Java home: /usr/lib/jvm/java-8-openjdk-amd64/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "linux", version: "4.13.0-38-generic", arch: "amd64", family: "unix"

• Assignee: Unassigned
• Reporter: anup saurav
• Created: 07/Apr/18 08:26
• Updated: 07/Apr/18 08:29

Description

$ ./bin/mkdistro.sh -U -D skipTests -D hadoopversion=3 -rf :oozie-distro

[INFO] Scanning for projects...
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.oozie:oozie-hadoop-utils:jar:hadoop-2-4.3.1
[WARNING] 'build.plugins.plugin.version' for com.atlassian.maven.plugins:maven-clover2-plugin is missing. @ org.apache.oozie:oozie-main:4.3.1, /home/anup/Downloads/oozie/pom.xml, line 1697, column 21
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.oozie:oozie-hadoop-distcp:jar:hadoop-2-4.3.1
[WARNING] 'build.plugins.plugin.version' for com.atlassian.maven.plugins:maven-clover2-plugin is missing. @ org.apache.oozie:oozie-main:4.3.1, /home/anup/Downloads/oozie/pom.xml, line 1697, column 21
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.oozie:oozie-hadoop-auth:jar:hadoop-2-4.3.1
[WARNING] 'build.plugins.plugin.version' for com.atlassian.maven.plugins:maven-clover2-plugin is missing. @ org.apache.oozie:oozie-main:4.3.1, /home/anup/Downloads/oozie/pom.xml, line 1697, column 21
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.oozie:oozie-hadooplibs:pom:4.3.1
[WARNING] 'build.plugins.plugin.version' for com.atlassian.maven.plugins:maven-clover2-plugin is missing. @ org.apache.oozie:oozie-main:4.3.1, /home/anup/Downloads/oozie/pom.xml, line 1697, column 21
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.oozie:oozie-client:jar:4.3.1
[WARNING] 'build.plugins.plugin.version' for com.atlassian.maven.plugins:maven-clover2-plugin is missing. @ org.apache.oozie:oozie-main:4.3.1, /home/anup/Downloads/oozie/pom.xml, line 1697, column 21
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.oozie:oozie-core:jar:4.3.1
[WARNING] 'build.plugins.plugin.version' for com.atlassian.maven.plugins:maven-clover2-plugin is missing. @ org.apache.oozie:oozie-main:4.3.1, /home/anup/Downloads/oozie/pom.xml, line 1697, column 21
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.oozie:oozie-sharelib-streaming:jar:4.3.1
[WARNING] 'build.plugins.plugin.version' for com.atlassian.maven.plugins:maven-clover2-plugin is missing. @ org.apache.oozie:oozie-main:4.3.1, /home/anup/Downloads/oozie/pom.xml, line 1697, column 21
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.oozie:oozie-sharelib-hcatalog:jar:4.3.1
[WARNING] 'build.plugins.plugin.version' for com.atlassian.maven.plugins:maven-clover2-plugin is missing. @ org.apache.oozie:oozie-main:4.3.1, /home/anup/Downloads/oozie/pom.xml, line 1697, column 21
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.oozie:oozie-sharelib-pig:jar:4.3.1
[WARNING] 'build.plugins.plugin.version' for com.atlassian.maven.plugins:maven-clover2-plugin is missing. @ org.apache.oozie:oozie-main:4.3.1, /home/anup/Downloads/oozie/pom.xml, line 1697, column 21
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.oozie:oozie-sharelib-hive:jar:4.3.1
[WARNING] 'build.plugins.plugin.version' for com.atlassian.maven.plugins:maven-clover2-plugin is missing. @ org.apache.oozie:oozie-main:4.3.1, /home/anup/Downloads/oozie/pom.xml, line 1697, column 21
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.oozie:oozie-sharelib-hive2:jar:4.3.1
[WARNING] 'build.plugins.plugin.version' for com.atlassian.maven.plugins:maven-clover2-plugin is missing. @ org.apache.oozie:oozie-main:4.3.1, /home/anup/Downloads/oozie/pom.xml, line 1697, column 21
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.oozie:oozie-sharelib-sqoop:jar:4.3.1
[WARNING] 'build.plugins.plugin.version' for com.atlassian.maven.plugins:maven-clover2-plugin is missing. @ org.apache.oozie:oozie-main:4.3.1, /home/anup/Downloads/oozie/pom.xml, line 1697, column 21
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.oozie:oozie-sharelib-oozie:jar:4.3.1
[WARNING] 'build.plugins.plugin.version' for com.atlassian.maven.plugins:maven-clover2-plugin is missing. @ org.apache.oozie:oozie-main:4.3.1, /home/anup/Downloads/oozie/pom.xml, line 1697, column 21
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.oozie:oozie-sharelib-distcp:jar:4.3.1
[WARNING] 'build.plugins.plugin.version' for com.atlassian.maven.plugins:maven-clover2-plugin is missing. @ org.apache.oozie:oozie-main:4.3.1, /home/anup/Downloads/oozie/pom.xml, line 1697, column 21
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.oozie:oozie-sharelib-spark:jar:4.3.1
[WARNING] 'build.plugins.plugin.version' for com.atlassian.maven.plugins:maven-clover2-plugin is missing. @ org.apache.oozie:oozie-main:4.3.1, /home/anup/Downloads/oozie/pom.xml, line 1697, column 21
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.oozie:oozie-sharelib:pom:4.3.1
[WARNING] 'build.plugins.plugin.version' for com.atlassian.maven.plugins:maven-clover2-plugin is missing. @ org.apache.oozie:oozie-main:4.3.1, /home/anup/Downloads/oozie/pom.xml, line 1697, column 21
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.oozie:oozie-webapp:war:4.3.1
[WARNING] 'build.plugins.plugin.version' for com.atlassian.maven.plugins:maven-clover2-plugin is missing. @ org.apache.oozie:oozie-main:4.3.1, /home/anup/Downloads/oozie/pom.xml, line 1697, column 21
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.oozie:oozie-examples:jar:4.3.1
[WARNING] 'build.plugins.plugin.version' for com.atlassian.maven.plugins:maven-clover2-plugin is missing. @ org.apache.oozie:oozie-main:4.3.1, /home/anup/Downloads/oozie/pom.xml, line 1697, column 21
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.oozie:oozie-docs:war:4.3.1
[WARNING] 'build.plugins.plugin.version' for com.atlassian.maven.plugins:maven-clover2-plugin is missing. @ org.apache.oozie:oozie-main:4.3.1, /home/anup/Downloads/oozie/pom.xml, line 1697, column 21
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.oozie:oozie-tools:jar:4.3.1
[WARNING] 'build.plugins.plugin.version' for com.atlassian.maven.plugins:maven-clover2-plugin is missing. @ org.apache.oozie:oozie-main:4.3.1, /home/anup/Downloads/oozie/pom.xml, line 1697, column 21
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.oozie.test:oozie-mini:jar:4.3.1
[WARNING] 'build.plugins.plugin.version' for com.atlassian.maven.plugins:maven-clover2-plugin is missing. @ org.apache.oozie:oozie-main:4.3.1, /home/anup/Downloads/oozie/pom.xml, line 1697, column 21
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.oozie:oozie-distro:jar:4.3.1
[WARNING] 'build.plugins.plugin.version' for com.atlassian.maven.plugins:maven-clover2-plugin is missing. @ org.apache.oozie:oozie-main:4.3.1, /home/anup/Downloads/oozie/pom.xml, line 1697, column 21
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.oozie:oozie-zookeeper-security-tests:jar:4.3.1
[WARNING] 'build.plugins.plugin.version' for com.atlassian.maven.plugins:maven-clover2-plugin is missing. @ org.apache.oozie:oozie-main:4.3.1, /home/anup/Downloads/oozie/pom.xml, line 1697, column 21
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.oozie:oozie-main:pom:4.3.1
[WARNING] 'build.plugins.plugin.version' for com.atlassian.maven.plugins:maven-clover2-plugin is missing. @ line 1697, column 21
[WARNING]
[WARNING] It is highly recommended to fix these problems because they threaten the stability of your build.
[WARNING]
[WARNING] For this reason, future Maven versions might no longer support building such malformed projects.
[WARNING]
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Build Order:
[INFO]
[INFO] Apache Oozie Distro
[INFO] Apache Oozie ZooKeeper Security Tests
Downloading: https://repo.maven.apache.org/maven2/com/atlassian/maven/plugins/maven-clover2-plugin/maven-metadata.xml
Downloading: https://repository.cloudera.com/artifactory/ext-release-local/com/atlassian/maven/plugins/maven-clover2-plugin/maven-metadata.xml
Downloaded: https://repo.maven.apache.org/maven2/com/atlassian/maven/plugins/maven-clover2-plugin/maven-metadata.xml (540 B at 0.2 KB/sec)
Downloaded: https://repository.cloudera.com/artifactory/ext-release-local/com/atlassian/maven/plugins/maven-clover2-plugin/maven-metadata.xml (381 B at 0.2 KB/sec)
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Apache Oozie Distro 4.3.1
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] — maven-clean-plugin:2.5:clean (default-clean) @ oozie-distro —
[INFO] Deleting /home/anup/Downloads/oozie/distro/target
[INFO]
[INFO] — maven-remote-resources-plugin:1.5:process (default) @ oozie-distro —
Downloading: https://repository-master.mulesoft.org/nexus/content/groups/public/org/pentaho/pentaho-aggdesigner-algorithm/5.1.5-jhyde/pentaho-aggdesigner-algorithm-5.1.5-jhyde.pom
Downloading: http://repo1.maven.org/maven2/org/pentaho/pentaho-aggdesigner-algorithm/5.1.5-jhyde/pentaho-aggdesigner-algorithm-5.1.5-jhyde.pom
Downloading: https://repository.apache.org/content/groups/snapshots/org/pentaho/pentaho-aggdesigner-algorithm/5.1.5-jhyde/pentaho-aggdesigner-algorithm-5.1.5-jhyde.pom
Downloading: http://www.datanucleus.org/downloads/maven2/org/pentaho/pentaho-aggdesigner-algorithm/5.1.5-jhyde/pentaho-aggdesigner-algorithm-5.1.5-jhyde.pom
[INFO]
[INFO] — maven-resources-plugin:2.5:resources (default-resources) @ oozie-distro —
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/anup/Downloads/oozie/distro/src/main/resources
[INFO] Copying 3 resources
[INFO]
[INFO] — maven-compiler-plugin:2.3.2:compile (default-compile) @ oozie-distro —
[INFO] No sources to compile
[INFO]
[INFO] — maven-resources-plugin:2.5:testResources (default-testResources) @ oozie-distro —
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/anup/Downloads/oozie/distro/src/test/resources
[INFO] Copying 3 resources
[INFO]
[INFO] — maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ oozie-distro —
[INFO] No sources to compile
[INFO]
[INFO] — maven-surefire-plugin:2.12.2:test (default-test) @ oozie-distro —
[INFO] Tests are skipped.
[INFO]
[INFO] — maven-jar-plugin:2.3.1:jar (default-jar) @ oozie-distro —
[INFO] Building jar: /home/anup/Downloads/oozie/distro/target/oozie-distro-4.3.1.jar
[INFO]
[INFO] — maven-site-plugin:2.0-beta-6:attach-descriptor (attach-descriptor) @ oozie-distro —
[INFO]
[INFO] — maven-antrun-plugin:1.6:run (default) @ oozie-distro —
[INFO] Executing tasks

main:
[get] Destination already exists (skipping): /home/anup/Downloads/oozie/distro/downloads/tomcat-6.0.53.tar.gz
[mkdir] Created dir: /home/anup/Downloads/oozie/distro/target/tomcat
[gunzip] Expanding /home/anup/Downloads/oozie/distro/downloads/tomcat-6.0.53.tar.gz to /home/anup/Downloads/oozie/distro/target/tomcat/tomcat-6.0.53.tar
[untar] Expanding: /home/anup/Downloads/oozie/distro/target/tomcat/tomcat-6.0.53.tar into /home/anup/Downloads/oozie/distro/target/tomcat
[delete] Deleting directory /home/anup/Downloads/oozie/distro/target/tomcat/oozie-server/webapps
[mkdir] Created dir: /home/anup/Downloads/oozie/distro/target/tomcat/oozie-server/webapps
[delete] Deleting: /home/anup/Downloads/oozie/distro/target/tomcat/oozie-server/conf/server.xml
[copy] Copying 1 file to /home/anup/Downloads/oozie/distro/target/tomcat/oozie-server/conf
[copy] Copying 1 file to /home/anup/Downloads/oozie/distro/target/tomcat/oozie-server/conf
[mkdir] Created dir: /home/anup/Downloads/oozie/distro/target/tomcat/oozie-server/conf/ssl
[copy] Copying 1 file to /home/anup/Downloads/oozie/distro/target/tomcat/oozie-server/conf/ssl
[copy] Copying 1 file to /home/anup/Downloads/oozie/distro/target/tomcat/oozie-server/conf/ssl
[copy] Copying 1 file to /home/anup/Downloads/oozie/distro/target/tomcat/oozie-server/conf/ssl
[copy] Copying 3 files to /home/anup/Downloads/oozie/distro/target/tomcat/oozie-server/webapps/ROOT
[INFO] Executed tasks
[INFO]
[INFO] — maven-assembly-plugin:2.2.1:single (default-cli) @ oozie-distro —
[INFO] Reading assembly descriptor: ../src/main/assemblies/distro.xml
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Oozie Distro ................................ FAILURE [ 15.583 s]
[INFO] Apache Oozie ZooKeeper Security Tests .............. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 20.616 s
[INFO] Finished at: 2018-04-07T13:54:13+05:30
[INFO] Final Memory: 48M/405M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-assembly-plugin:2.2.1:single (default-cli) on project oozie-distro: Failed to create assembly: Error adding file to archive: /home/anup/Downloads/oozie/distro/./../core/target/oozie-core-4.3.1-tests.jar isn't a file. -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException

ERROR, Oozie distro creation failed

I also tried by adding below lines in pom.xml file:

<repository>
<id>Codehaus repository</id>
<name>codehaus-mule-repo</name>
<url>https://repository-master.mulesoft.org/nexus/content/groups/public/</url>
<layout>default</layout>
<snapshots>
<enabled>true</enabled>
</snapshots>
</repository>