[MNG-5750] Sporadic failures in concurrent build

• Type: Bug
• Status: Reopened
• Priority: Critical
• Resolution: Unresolved
• Affects Version/s: 3.1.1, 3.2.1, 3.2.2, 3.2.5
• Fix Version/s: 4.x / Backlog, waiting-for-feedback
• Component/s: General
• Environment: SLES 3.0.80-0.7-default SMP x86_64 GNU/Linux Oracle HotSpot JDK 7u25; windows server 2008 x64 Oracle HotSpot JDK 7u65/8u25
• Assignee: Unassigned
• Reporter: Alexander Ashitkin
• Created: 08/Jan/15 01:56
• Updated: 14/Jul/21 10:31

Description

We have a large project of 300+ modules which regularly fails with different kind of errors in different places. The issue is reliably reproduced with parallel build and is not happens in single threaded. The optimal concurrency level for our project ~10 threads. At this level ~%20 of builds fail. To workaround the issue we reduced concurrency to 4 in development builds and reverted production build to 1 thread.

Main point of failures:

1. Surefire ClassNotFound. Reported and investigated in SUREFIRE-1132. Points to a problem with MavenProject#getArtifacts - empty set unexpectedly returned.
2. Compiler - unexpected failure because of incorrect classpath (literally all dependencies are not on the classpath), like:

   20:20:54 [ERROR] /D:/jenkins/work/workspace/..Request.java:[3,30] package ... does not exist
   20:20:54 [ERROR] /D:/jenkins/work/workspace/..Request.java:[4,30] package ... does not exist
   20:20:54 [ERROR] /D:/jenkins/work/workspace/..Request.java:[8,25] package ... does not exist
   20:20:54 [ERROR] /D:/jenkins/work/workspace/..Request.java:[9,21] package org.joda.time does not exist
   20:20:54 [ERROR] /D:/jenkins/work/workspace/..Request.java:[11,37] package com.google.common.base does not exist
   20:20:54 [ERROR] /D:/jenkins/work/workspace/..Request.java:[11,1] static import only from classes and interfaces
   20:20:54 [ERROR] /D:/jenkins/work/workspace/..Request.java:[12,37] package com.google.common.base does not exist
   20:20:54 [ERROR] /D:/jenkins/work/workspace/..Request.java:[12,1] static import only from classes and interfaces
   

3. Jar - unexpected NPE. Reported with stack traces in MJAR-192. (assembly plusgin seems to be also affected)

At this point the issue looks like problem with MavenProject#getArtifacts in concurrent builds.

To help with the issue im happy to implement or evaluate any custom assembly to trace this down. Unfortunately i cannot submit my project - it is proprietary.

Thanks in advance, Alexander

Issue Links

• is depended upon by: MJAR-192 Sporadic NPE in maven-jar-plugin:2.5:jar
• is depended upon by: SUREFIRE-1132 Surefire: regular isolated classloader failures in parallelbuild
• is related to: MNG-5700 Update to plexus-interpolation 1.21 to avoid potential thread safety problems
• relates to: MNG-5960 MojoExecutor overriding resolved artifacts of concurrently built MavenProject