[HIVE-26473] Upgrade to Java17

• Type: Improvement
• Status: In Progress
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 4.0.0
• Component/s: Hive
• Labels: pull-request-available
• Target Version/s: 4.1.0
• Assignee: Akshat Mathur
• Reporter: dingwei2019
• Created: 16/Aug/22 01:51
• Updated: 31/Oct/24 21:58

Description

we know that jdk11 is a LTS version, but the technical support will be end in September 2023. JDK17 is the next generation LTS version, and will support a least to 2026. 

for G1GC, Java17 will get 8.66% faster than  Java11, for ParallelGC, the percent will be 6.54%. If we upgrade to java17, we will get more performance improvementthan Java11.

 

I suggest, we upgrade hive version to support java17.

Issue Links

• relates to: HADOOP-17177 Java 17 support
• links to: GitHub Pull Request #5012
• links to: GitHub Pull Request #5404

Sub-Tasks

• Build and CI Config updates for Hive Jdk-17: Open
• Jdk-17 Compile time support for Hive: Open
• Mockito upgrade to 5.0.0 for Hive jdk-17: Open
• JDK17: Change in behaviour of DAY_OF_YEAR in timestamp: Open
• Hadoop shaded class path issue fix: Open
• Antler code too long issue: Open
• Add opens java.base/java.net for hadoop client opts: Open
• Datanucleus upgrade for jdk-17: Open
• Add nashorn javascript engine as an explicit dependency: In Progress
• Change final fields modification to be invoked using MethodHandles: In Progress
• Upgrade spotbugs-maven-plugin for jdk-17 support & minimize new spotbugs: In Progress
• Upgrade Kudu to 1.17.0 for JDK-17 support: In Progress
• Fix gzip compression & Math radians qtest issues: In Progress
• Datetime changes for jdk-17 support: In Progress
• Enable netty to use reflection setAccessible & fix SocketTimeoutException error message case issue: In Progress
• Add 'at jdk' as masked pattern to account for changed stack trace due to new module system: In Progress
• Upgrade apache-directory-server to 2.0.0-M1 for JDK17 support: In Progress
• Add opens configs for tez: Open
• Add opens tez configs for llap: Open
• Add --add-opens options to tez configs for Iceberg compatibility: In Progress
• Add --add-opens options to MR configs for session compatibility: In Progress
• Increase Tez container & AM memory size to address OOM issues: In Progress
• Configure add-opens for child JVM spawned for TestPermsGrp: In Progress
• Configure Javadocs for JDK17 compatibility: In Progress
• Patched Datanucleus RDBMS: Open
• Fix issues in errorPrune profile for jdk-17: Open
• beeline command start up gives error for --add-opens java.net error: Open
• Add License for https://www.eclipse.org/org/documents/edl-v10.php: Open
• Java 17 formats and convention upgrades: Open
• Fix hadoop shaded avro refection issue: Open
• Update maven target and source to 17: Open
• TestContribCliDriver test failure for dboutput.q: Open
• Add --add-opens for multiple modules for JDK-17 runtime: In Progress
• JDK17: Change in behaviour of MILLI_OF_DAY in timestamp: Open
• Add opens for java.time: Open
• Fix nighty verify issue regarding patched-datanucleus module: Open
• Add jvm arg in various surefire plugins: Open
• Fix java.lang.reflect.InaccessibleObjectException for TestExecDriver for jdk-17 compatibility: Open
• Fix Hadoop RunJar not found issue for TestExecDriver: Open
• Disable removeUnusedImport for jdk-17: Open
• DataNucleus upgrade to 6.0.8 for jdk-17: Open
• Upgrade to java 17 in github actions for docker image: Open
• Fix testSelectiveHdfsPatternMaskOnlyHdfsPath test failures: Open
• Fix checkDanglingQOut test failure: Open