[FLINK-22711] NoClassDefFoundError when running Flink 1.11.1 in openJDK8u292-b10

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Cannot Reproduce
• Affects Version/s: 1.11.1
• Component/s: Runtime / Metrics
• Assignee: Unassigned
• Reporter: zlzhang0122
• Created: 19/May/21 08:16
• Updated: 30/Jun/21 14:59
• Resolved: 01/Jun/21 10:29

Description

I'm running Flink 1.11.1 on yarn and when I use openJDK8u292-b10(which is the newest version of openJDK8), Some times I got the exception like this:

 

// code placeholder
org.apache.flink.runtime.entrypoint.ClusterEntrypoint        - Shutting YarnJobClusterEntrypoint down with application status FAILED. Diagnostics java.lang.NoClassDefFoundError: Could not initialize class jdk.internal.platform.cgroupv1.Metrics
	at java.lang.Class.forName0(Native Method)
	at java.lang.Class.forName(Class.java:264)
	at jdk.internal.platform.Metrics.systemMetrics(Metrics.java:59)
	at jdk.internal.platform.Container.metrics(Container.java:41)
	at sun.management.OperatingSystemImpl.<init>(OperatingSystemImpl.java:46)
	at sun.management.ManagementFactoryHelper.getOperatingSystemMXBean(ManagementFactoryHelper.java:106)
	at java.lang.management.ManagementFactory.getOperatingSystemMXBean(ManagementFactory.java:374)
	at org.apache.flink.runtime.metrics.util.MetricUtils.instantiateCPUMetrics(MetricUtils.java:231)
	at org.apache.flink.runtime.metrics.util.MetricUtils.instantiateStatusMetrics(MetricUtils.java:132)
	at org.apache.flink.runtime.metrics.util.MetricUtils.createAndInitializeStatusMetricGroup(MetricUtils.java:120)
	at org.apache.flink.runtime.metrics.util.MetricUtils.instantiateProcessMetricGroup(MetricUtils.java:82)
	at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.initializeServices(ClusterEntrypoint.java:277)
	at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.runCluster(ClusterEntrypoint.java:208)
	at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.lambda$startCluster$0(ClusterEntrypoint.java:169)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:422)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1805)
	at org.apache.flink.runtime.security.contexts.HadoopSecurityContext.runSecured(HadoopSecurityContext.java:41)
	at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.startCluster(ClusterEntrypoint.java:168)
	at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.runClusterEntrypoint(ClusterEntrypoint.java:517)
	at org.apache.flink.yarn.entrypoint.YarnJobClusterEntrypoint.main(YarnJobClusterEntrypoint.java:89)

If I use openJDK8u232-b09, the exception will disappear, so I'm not quite sure where this came in,  maybe by Flink or by openJDK.