[HBASE-26907] Update Hadoop3 versions for JEP 223 compliance

• Type: Task
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: 2.5.0, 3.0.0-alpha-3, 2.4.12
• Component/s: build
• Assignee: Unassigned
• Reporter: Nick Dimiduk
• Created: 30/Mar/22 12:28
• Updated: 16/Aug/22 12:26
• Resolved: 16/Aug/22 12:25

Description

It happened that my JDK version upgraded to 11.0.14.1. Running unit tests involving the HDFS mini cluster now fails with a stack trace that ends with

Caused by: java.lang.IllegalArgumentException: Invalid Java version 11.0.14.1                                                                                                                               
        at org.eclipse.jetty.util.JavaVersion.parseJDK9(JavaVersion.java:71)                                                                                                                                
        at org.eclipse.jetty.util.JavaVersion.parse(JavaVersion.java:49)                                                                                                                                    
        at org.eclipse.jetty.util.JavaVersion.<clinit>(JavaVersion.java:43)

We are using hadoop-3.2.0, which uses jetty-9.3.24. This is a Jetty issue has been fixed upstream in Jetty via https://github.com/eclipse/jetty.project/issues/2090. Hadoop has upgraded its Jetty version to 9.4.20 in HADOOP-16152, which is available as of hadoop-3.2.2.

Issue Links

• is blocked by: HDFS-16586 Purge FsDatasetAsyncDiskService threadgroup; it causes BPServiceActor$CommandProcessingThread IllegalThreadStateException 'fatal exception and exit'
• is blocked by: HBASE-26970 TestMetaFixed fails reliably with Hadoop 3.2.3 and Hadoop 3.3.2
• is blocked by: HBASE-26954 Compilation of master vs hadoop-3.3.2 fails
• is superceded by: HBASE-27148 Move minimum hadoop 3 support version to 3.2.3
• is superceded by: HBASE-27294 Add new hadoop releases in our hadoop checks
• links to: GitHub Pull Request #4305