Uploaded image for project: 'Maven Resolver'
  1. Maven Resolver
  2. MRESOLVER-114

ArtifactNotFoundExceptions when building in parallel

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.4.2
    • 1.5.0, 1.6.0, 1.6.1
    • Resolver
    • None

    Description

      We have a multi-module project with quite many modules and many dependencies and observe pretty random ArtifactNotFoundExceptions when building in parallel with an empty local repository.

      The "funny" thing is that Maven did in fact download the jar that it complained about not finding.

      In this example Maven said it could not find edu.tum.cs:cup-runtime:jar:11a (see stacktrace below)
      But it also said: Downloaded from central-mirror: https://mirror.xy.com/repository/maven-all-mirror/edu/tum/cs/cup-runtime/11a/cup-runtime-11a.jar.

      When looking into the local repository after the failed build we found the cup-runtime.jar in the correct place with the correct checksum.

      We tried the following to "fix" the problem:

      • build with and without the takari extensions (takari-local-repository & takari-smart-builder) using --builder smart
      • also build with io.takari.aether:aether-connector-okhttp extension
      • only execute goal package instead of install
      • build with these properties: -Daether.connector.basic.threads=1 -Daether.connector.resumeDownloads=false

      But nothing helped.

      Unfortunately it seems to be a race condition and we cannot reproduce it consistently but it happens in about 1 out of 5 builds.

      ...
[2019-11-18T16:46:29.370Z] [INFO] Downloaded from central-mirror: https://mirror.xy.com/repository/maven-all-mirror/edu/tum/cs/cup-runtime/11a/cup-runtime-11a.jar (13 kB at 738 kB/s)
...
[2019-11-18T16:46:30.894Z] [ERROR] Failed to execute goal on project xy: Could not resolve dependencies for project xy: The following artifacts could not be resolved: edu.tum.cs:cup-runtime:jar:11a, org.checkerframework:checker-qual:jar:2.5.7, org.ow2.asm:asm:jar:7.2, cglib:cglib:jar:3.3.0: Could not find artifact edu.tum.cs:cup-runtime:jar:11a -> [Help 1]
[2019-11-18T16:46:30.894Z] org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal on project xy: Could not resolve dependencies for project xy: The following artifacts could not be resolved: edu.tum.cs:cup-runtime:jar:11a, org.checkerframework:checker-qual:jar:2.5.7, org.ow2.asm:asm:jar:7.2, cglib:cglib:jar:3.3.0: Could not find artifact edu.tum.cs:cup-runtime:jar:11a
[2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.getDependencies (LifecycleDependencyResolver.java:269)
[2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.resolveProjectDependencies (LifecycleDependencyResolver.java:147)
[2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.MojoExecutor.ensureDependenciesAreResolved (MojoExecutor.java:248)
[2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:202)
[2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:156)
[2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:148)
[2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:117)
[2019-11-18T16:46:30.894Z]     at io.takari.maven.builder.smart.SmartBuilderImpl.buildProject (SmartBuilderImpl.java:205)
[2019-11-18T16:46:30.894Z]     at io.takari.maven.builder.smart.SmartBuilderImpl$ProjectBuildTask.run (SmartBuilderImpl.java:77)
[2019-11-18T16:46:30.894Z]     at java.util.concurrent.Executors$RunnableAdapter.call (Executors.java:515)
[2019-11-18T16:46:30.894Z]     at java.util.concurrent.FutureTask.run (FutureTask.java:264)
[2019-11-18T16:46:30.894Z]     at java.util.concurrent.ThreadPoolExecutor.runWorker (ThreadPoolExecutor.java:1128)
[2019-11-18T16:46:30.894Z]     at java.util.concurrent.ThreadPoolExecutor$Worker.run (ThreadPoolExecutor.java:628)
[2019-11-18T16:46:30.894Z]     at java.lang.Thread.run (Thread.java:834)
[2019-11-18T16:46:30.894Z] Caused by: org.apache.maven.project.DependencyResolutionException: Could not resolve dependencies for project xy: The following artifacts could not be resolved: edu.tum.cs:cup-runtime:jar:11a, org.checkerframework:checker-qual:jar:2.5.7, org.ow2.asm:asm:jar:7.2, cglib:cglib:jar:3.3.0: Could not find artifact edu.tum.cs:cup-runtime:jar:11a
[2019-11-18T16:46:30.894Z]     at org.apache.maven.project.DefaultProjectDependenciesResolver.resolve (DefaultProjectDependenciesResolver.java:209)
[2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.getDependencies (LifecycleDependencyResolver.java:243)
[2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.resolveProjectDependencies (LifecycleDependencyResolver.java:147)
[2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.MojoExecutor.ensureDependenciesAreResolved (MojoExecutor.java:248)
[2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:202)
[2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:156)
[2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:148)
[2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:117)
[2019-11-18T16:46:30.894Z]     at io.takari.maven.builder.smart.SmartBuilderImpl.buildProject (SmartBuilderImpl.java:205)
[2019-11-18T16:46:30.894Z]     at io.takari.maven.builder.smart.SmartBuilderImpl$ProjectBuildTask.run (SmartBuilderImpl.java:77)
[2019-11-18T16:46:30.894Z]     at java.util.concurrent.Executors$RunnableAdapter.call (Executors.java:515)
[2019-11-18T16:46:30.894Z]     at java.util.concurrent.FutureTask.run (FutureTask.java:264)
[2019-11-18T16:46:30.894Z]     at java.util.concurrent.ThreadPoolExecutor.runWorker (ThreadPoolExecutor.java:1128)
[2019-11-18T16:46:30.894Z]     at java.util.concurrent.ThreadPoolExecutor$Worker.run (ThreadPoolExecutor.java:628)
[2019-11-18T16:46:30.894Z]     at java.lang.Thread.run (Thread.java:834)
[2019-11-18T16:46:30.894Z] Caused by: org.eclipse.aether.resolution.DependencyResolutionException: The following artifacts could not be resolved: edu.tum.cs:cup-runtime:jar:11a, org.checkerframework:checker-qual:jar:2.5.7, org.ow2.asm:asm:jar:7.2, cglib:cglib:jar:3.3.0: Could not find artifact edu.tum.cs:cup-runtime:jar:11a
[2019-11-18T16:46:30.894Z]     at org.eclipse.aether.internal.impl.DefaultRepositorySystem.resolveDependencies (DefaultRepositorySystem.java:357)
[2019-11-18T16:46:30.894Z]     at org.apache.maven.project.DefaultProjectDependenciesResolver.resolve (DefaultProjectDependenciesResolver.java:202)
[2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.getDependencies (LifecycleDependencyResolver.java:243)
[2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.resolveProjectDependencies (LifecycleDependencyResolver.java:147)
[2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.MojoExecutor.ensureDependenciesAreResolved (MojoExecutor.java:248)
[2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:202)
[2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:156)
[2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:148)
[2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:117)
[2019-11-18T16:46:30.894Z]     at io.takari.maven.builder.smart.SmartBuilderImpl.buildProject (SmartBuilderImpl.java:205)
[2019-11-18T16:46:30.894Z]     at io.takari.maven.builder.smart.SmartBuilderImpl$ProjectBuildTask.run (SmartBuilderImpl.java:77)
[2019-11-18T16:46:30.894Z]     at java.util.concurrent.Executors$RunnableAdapter.call (Executors.java:515)
[2019-11-18T16:46:30.894Z]     at java.util.concurrent.FutureTask.run (FutureTask.java:264)
[2019-11-18T16:46:30.894Z]     at java.util.concurrent.ThreadPoolExecutor.runWorker (ThreadPoolExecutor.java:1128)
[2019-11-18T16:46:30.894Z]     at java.util.concurrent.ThreadPoolExecutor$Worker.run (ThreadPoolExecutor.java:628)
[2019-11-18T16:46:30.894Z]     at java.lang.Thread.run (Thread.java:834)
[2019-11-18T16:46:30.894Z] Caused by: org.eclipse.aether.resolution.ArtifactResolutionException: The following artifacts could not be resolved: edu.tum.cs:cup-runtime:jar:11a, org.checkerframework:checker-qual:jar:2.5.7, org.ow2.asm:asm:jar:7.2, cglib:cglib:jar:3.3.0: Could not find artifact edu.tum.cs:cup-runtime:jar:11a
[2019-11-18T16:46:30.894Z]     at org.eclipse.aether.internal.impl.DefaultArtifactResolver.resolve (DefaultArtifactResolver.java:424)
[2019-11-18T16:46:30.894Z]     at org.eclipse.aether.internal.impl.DefaultArtifactResolver.resolveArtifacts (DefaultArtifactResolver.java:229)
[2019-11-18T16:46:30.894Z]     at org.eclipse.aether.internal.impl.DefaultRepositorySystem.resolveDependencies (DefaultRepositorySystem.java:340)
[2019-11-18T16:46:30.894Z]     at org.apache.maven.project.DefaultProjectDependenciesResolver.resolve (DefaultProjectDependenciesResolver.java:202)
[2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.getDependencies (LifecycleDependencyResolver.java:243)
[2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.resolveProjectDependencies (LifecycleDependencyResolver.java:147)
[2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.MojoExecutor.ensureDependenciesAreResolved (MojoExecutor.java:248)
[2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:202)
[2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:156)
[2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:148)
[2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:117)
[2019-11-18T16:46:30.894Z]     at io.takari.maven.builder.smart.SmartBuilderImpl.buildProject (SmartBuilderImpl.java:205)
[2019-11-18T16:46:30.894Z]     at io.takari.maven.builder.smart.SmartBuilderImpl$ProjectBuildTask.run (SmartBuilderImpl.java:77)
[2019-11-18T16:46:30.894Z]     at java.util.concurrent.Executors$RunnableAdapter.call (Executors.java:515)
[2019-11-18T16:46:30.894Z]     at java.util.concurrent.FutureTask.run (FutureTask.java:264)
[2019-11-18T16:46:30.894Z]     at java.util.concurrent.ThreadPoolExecutor.runWorker (ThreadPoolExecutor.java:1128)
[2019-11-18T16:46:30.894Z]     at java.util.concurrent.ThreadPoolExecutor$Worker.run (ThreadPoolExecutor.java:628)
[2019-11-18T16:46:30.894Z]     at java.lang.Thread.run (Thread.java:834)
[2019-11-18T16:46:30.894Z] Caused by: org.eclipse.aether.transfer.ArtifactNotFoundException: Could not find artifact edu.tum.cs:cup-runtime:jar:11a
[2019-11-18T16:46:30.894Z]     at org.eclipse.aether.internal.impl.DefaultArtifactResolver.resolve (DefaultArtifactResolver.java:414)
[2019-11-18T16:46:30.894Z]     at org.eclipse.aether.internal.impl.DefaultArtifactResolver.resolveArtifacts (DefaultArtifactResolver.java:229)
[2019-11-18T16:46:30.894Z]     at org.eclipse.aether.internal.impl.DefaultRepositorySystem.resolveDependencies (DefaultRepositorySystem.java:340)
[2019-11-18T16:46:30.894Z]     at org.apache.maven.project.DefaultProjectDependenciesResolver.resolve (DefaultProjectDependenciesResolver.java:202)
[2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.getDependencies (LifecycleDependencyResolver.java:243)
[2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.resolveProjectDependencies (LifecycleDependencyResolver.java:147)
[2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.MojoExecutor.ensureDependenciesAreResolved (MojoExecutor.java:248)
[2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:202)
[2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:156)
[2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:148)
[2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:117)
[2019-11-18T16:46:30.894Z]     at io.takari.maven.builder.smart.SmartBuilderImpl.buildProject (SmartBuilderImpl.java:205)
[2019-11-18T16:46:30.894Z]     at io.takari.maven.builder.smart.SmartBuilderImpl$ProjectBuildTask.run (SmartBuilderImpl.java:77)
[2019-11-18T16:46:30.894Z]     at java.util.concurrent.Executors$RunnableAdapter.call (Executors.java:515)
[2019-11-18T16:46:30.894Z]     at java.util.concurrent.FutureTask.run (FutureTask.java:264)
[2019-11-18T16:46:30.894Z]     at java.util.concurrent.ThreadPoolExecutor.runWorker (ThreadPoolExecutor.java:1128)
[2019-11-18T16:46:30.894Z]     at java.util.concurrent.ThreadPoolExecutor$Worker.run (ThreadPoolExecutor.java:628)
[2019-11-18T16:46:30.894Z]     at java.lang.Thread.run (Thread.java:834)

      Attachments

        1. BasicRepositoryConnector.java
          24 kB
          Eva Müller
        2. DefaultArtifactResolver.java
          34 kB
          Eva Müller
        3. maven-debug-log.txt
          3.15 MB
          Rainer Reich
        4. mvn-build-120.log
          49.50 MB
          Eva Müller
        5. mvn-build-120-sorted.txt
          19 kB
          Eva Müller
        6. mvn-build-134.log
          43.53 MB
          Eva Müller
        7. mvn-build-134-sorted.txt
          31 kB
          Eva Müller
        8. mvn-build-144.log
          38.66 MB
          Eva Müller
        9. mvn-build-144-sorted.txt
          26 kB
          Eva Müller

        Issue Links

          causes

          Bug - A problem which impairs or prevents the functions of the product. MNG-5315 Artifact resolution sporadically fails in parallel builds

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed
          is fixed by

          New Feature - A new feature of the product, which has yet to be developed. MRESOLVER-123 Provide a global locking sync context by default

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. MRESOLVER-131 Introduce a Redisson-based SyncContextFactory

          • Major - Major loss of function.
          • Closed
          links to

          Web Link [v0.11.2] DefaultFileManager thread safe?

          Web Link [v0.11.2] LockingSyncContext not used

          Web Link GitHub Pull Request #41

          Web Link GitHub Pull Request #42

          Web Link GitHub Pull Request #60

          Activity

            People

              michael-o Michael Osipov
              rreich Rainer Reich
              Votes:
              3 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 20m
                  20m