[MRESOLVER-7] Download dependency POMs in parallel in BF collector

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: Aether 1.0.2
• Fix Version/s: 1.9.0
• Component/s: Resolver
• Assignee: Tamas Cservenak
• Reporter: Harald Wellmann
• Created: 05/Nov/16 13:56
• Updated: 24/Feb/23 13:15
• Resolved: 26/Oct/22 06:52

Description

Background

When building a project with dependencies not yet available in the local repository, I noticed that Maven 3.3.9/Aether 1.0.2 first downloads the dependency POMs sequentially and then proceeds downloading the dependency JARs with up to 5 threads in parallel.

Due to this, when first building a project with a large number of dependencies, downloading a large number of small POMs may take a lot longer than downloading the much larger JARs, or even longer than building the project itself, especially when a repository manager is used which increases the download latency.

Enhancement

Download POMs of (transitive) dependencies in parallel to significantly speed up initial builds of large projects.

Issue Links

• blocks: MNG-5896 Download dependency POMs in parallel
• causes: MRESOLVER-92 Revert MRESOLVER-7
• is duplicated by: MNG-6958 mvn only uses a single thread for downloading poms.
• is part of: MNG-6672 Upgrade Maven Resolver to 1.4.2
• is related to: MRESOLVER-32 Support parallel artifact/metadata uploads
• relates to: MNG-6712 Downgrade maven-resolver:1.4.0 to 1.3.3
• links to: GitHub Pull Request #2
• links to: GitHub Pull Request #10
• links to: GitHub Pull Request #30
• links to: GitHub Pull Request #142
• links to: GitHub Pull Request #178