[HBASE-27065] Build against Hadoop 3.3.3

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.5.0
• Fix Version/s: 2.5.0, 3.0.0-alpha-3
• Component/s: build
• Hadoop Flags: Reviewed
• Assignee: Andrew Kyle Purtell
• Reporter: Andrew Kyle Purtell
• Created: 26/May/22 21:19
• Updated: 28/Jun/22 09:50
• Resolved: 27/May/22 21:05

Description

When building against Hadoop 3.3.3 and any future version of Hadoop incorporating reload4j, the new Enforcer rule we have active in branch-2.5 and up to exclude other logging frameworks besides log4j2 will trigger. We need to add exclusions to prevent that from happening so the build will succeed.

Tested with mvn clean install assembly:single -DskipTests -Dhadoop-three.version=3.3.3 on master branch and with mvn clean install assembly:single -DskipTests -Dhadoop.profile=3.0 -Dhadoop-three.version=3.3.3 on branch-2.5.

I also needed to exclude leveldbjni-all via hadoop-hdfs to avoid a LICENSE file generation error. hadoop-hdfs is messy and exports this among findbugs and other clutter. Anyway, better to exclude something we do not require than add an unnecessary supplemental model.

Issue Links

• breaks: HBASE-27103 All MR UTs are broken because of ClassNotFound
• relates to: BIGTOP-3710 Fix build failure of HBase on aarch64 due to error in check-aggregate-license
• links to: GitHub Pull Request #4467
• links to: GitHub Pull Request #4471