[HIVE-23938] LLAP: JDK11 - some GC log file rotation related jvm arguments cannot be used anymore

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.0.0-alpha-1
• Labels: pull-request-available
• Assignee: László Bodor
• Reporter: László Bodor
• Created: 27/Jul/20 12:11
• Updated: 17/Nov/22 08:47
• Resolved: 12/Oct/20 12:42

Description

https://github.com/apache/hive/blob/master/llap-server/bin/runLlapDaemon.sh#L55

JAVA_OPTS_BASE="-server -Djava.net.preferIPv4Stack=true -XX:+UseNUMA -XX:+PrintGCDetails -verbose:gc -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=4 -XX:GCLogFileSize=100M -XX:+PrintGCDateStamps"

on JDK11 I got something like:

+ exec /usr/lib/jvm/jre-11-openjdk/bin/java -Dproc_llapdaemon -Xms32000m -Xmx64000m -Dhttp.maxConnections=17 -XX:+UseG1GC -XX:+ResizeTLAB -XX:+UseNUMA -XX:+AggressiveOpts -XX:MetaspaceSize=1024m -XX:InitiatingHeapOccupancyPercent=80 -XX:MaxGCPauseMillis=200 -XX:+PreserveFramePointer -XX:AllocatePrefetchStyle=2 -Dhttp.maxConnections=10 -Dasync.profiler.home=/grid/0/async-profiler -server -Djava.net.preferIPv4Stack=true -XX:+UseNUMA -XX:+PrintGCDetails -verbose:gc -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=4 -XX:GCLogFileSize=100M -XX:+PrintGCDateStamps -Xloggc:/grid/2/yarn/container-logs/application_1595375468459_0113/container_e26_1595375468459_0113_01_000009/gc_2020-07-27-12.log 
... 
org.apache.hadoop.hive.llap.daemon.impl.LlapDaemon

OpenJDK 64-Bit Server VM warning: Option AggressiveOpts was deprecated in version 11.0 and will likely be removed in a future release.
Unrecognized VM option 'UseGCLogFileRotation'
Error: Could not create the Java Virtual Machine.
Error: A fatal exception has occurred. Program will exit.

These are not valid in JDK11:

-XX:+UseGCLogFileRotation
-XX:NumberOfGCLogFiles    
-XX:GCLogFileSize
-XX:+PrintGCTimeStamps    
-XX:+PrintGCDateStamps

Instead something like:

-Xlog:gc*,safepoint:gc.log:time,uptime:filecount=4,filesize=100M

Issue Links

• is related to: HIVE-22415 Upgrade to Java 11
• links to: GitHub Pull Request #1430