[HADOOP-17650] Fails to build using Maven 3.8.1

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Fix Version/s: 3.4.0, 3.3.3
• Component/s: build
• Labels: pull-request-available
• Target Version/s: 3.4.0

Release Note

In order to resolve build issues with Maven 3.8.1, we have to bump SolrJ to latest version 8.8.2 as of now. Solr is used by YARN application catalog. Hence, we would recommend upgrading Solr cluster accordingly before upgrading entire Hadoop cluster to 3.4.0 if the YARN application catalog service is used.

• Assignee: Viraj Jasani
• Reporter: Wei-Chiu Chuang
• Created: 20/Apr/21 02:44
• Updated: 20/Apr/22 15:49
• Resolved: 26/Apr/21 06:49

Description

The latest Maven (3.8.1) errors out when building Hadoop (tried trunk)

[ERROR] Failed to execute goal on project hadoop-yarn-applications-catalog-webapp: Could not resolve dependencies for project org.apache.hadoop:hadoop-yarn-applications-catalog-webapp:war:3.4.0-SNAPSHOT: Failed to collect dependencies at org.apache.solr:solr-core:jar:7.7.0 -> org.restlet.jee:org.restlet:jar:2.3.0: Failed to read artifact descriptor for org.restlet.jee:org.restlet:jar:2.3.0: Could not transfer artifact org.restlet.jee:org.restlet:pom:2.3.0 from/to maven-default-http-blocker (http://0.0.0.0/): Blocked mirror for repositories: [maven-restlet (http://maven.restlet.org, default, releases+snapshots), apache.snapshots (http://repository.apache.org/snapshots, default, disabled)] -> [Help 1]

According to https://maven.apache.org/docs/3.8.1/release-notes.html#how-to-fix-when-i-get-a-http-repository-blocked we need to update our Maven repo.

 

Maven 3.6.3 is good.

 

(For what is worth, I used my company's mirror to bypass this error. Not sure what is a good fix for Hadoop itself)

Issue Links

• is depended upon by: HADOOP-18198 Release Hadoop 3.3.3: hadoop-3.3.2 with some fixes
• is related to: YARN-11068 Update transitive log4j2 dependency to 2.17.1
• links to: GitHub Pull Request #2939
• links to: GitHub Pull Request #4206