[MAPREDUCE-7386] Maven parallel builds (skipping tests) fail

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 3.4.0, 3.3.5
• Fix Version/s: 3.4.0
• Component/s: build
• Labels: pull-request-available

Environment

The problem occurred while using the Hadoop development environment (Ubuntu)

• Target Version/s: 3.4.0, 3.3.5
• Assignee: Steve Vaughan
• Reporter: Steve Vaughan
• Created: 07/Jun/22 00:51
• Updated: 16/Mar/23 14:21
• Resolved: 04/Nov/22 11:51

Description

Running a parallel build fails during assembly with the following error when running either package or install:

org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.apache.maven.plugins:maven-assembly-plugin:2.4:single (package-mapreduce) on project hadoop-mapreduce: Failed to create assembly: Artifact: org.apache.hadoop:hadoop-mapreduce-client-core:jar:3.4.0-SNAPSHOT (included by module) does not have an artifact with a file. Please ensure the package phase is run before the assembly is generated. 

Caused by: org.apache.maven.plugin.MojoExecutionException: Failed to create assembly: Artifact: org.apache.hadoop:hadoop-mapreduce-client-core:jar:3.4.0-SNAPSHOT (included by module) does not have an artifact with a file. Please ensure the package phase is run before the assembly is generated.  

The command executed was:

$ mvn -nsu clean install -Pdist,native -DskipTests -Dtar -Dmaven.javadoc.skip=true -T 2C 

Adding dependencies to the assembly plugin configuration addresses the issue 

Issue Links

• blocks: HADOOP-18394 Enable parallel building in pre-commit jobs
• is blocked by: HADOOP-18417 Upgrade Maven Surefire plugin to 3.0.0-M7
• is related to: YARN-11458 Maven parallel build fails when Yarn UI v2 is enabled
• links to: GitHub Pull Request #4415
• links to: GitHub Pull Request #5337