[FLINK-29874] Streaming File Sink end-to-end test failed on azure due to ClassNotFoundException

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Duplicate
• Component/s: BuildSystem / Shaded, Connectors / FileSystem, Tests
• Assignee: Unassigned
• Reporter: Leonard Xu
• Created: 04/Nov/22 01:57
• Updated: 04/Nov/22 14:37
• Resolved: 04/Nov/22 14:37

Description

The failure should be related to the flink shaded netty dependency.

2022-11-03 12:45:04,240 INFO  org.apache.flink.runtime.rpc.akka.AkkaRpcService             [] - Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at akka://flink-metrics/user/rpc/MetricQueryService .
2022-11-03 12:45:04,283 INFO  org.apache.flink.runtime.dispatcher.FileExecutionGraphInfoStore [] - Initializing FileExecutionGraphInfoStore: Storage directory /tmp/executionGraphStore-461fd7ed-fbc0-4890-ae27-858af6391ea7, expiration time 3600000, maximum cache size 52428800 bytes.
2022-11-03 12:45:04,379 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint        [] - Shutting StandaloneSessionClusterEntrypoint down with application status FAILED. Diagnostics org.apache.flink.util.FlinkException: Could not create the DispatcherResourceManagerComponent.
	at org.apache.flink.runtime.entrypoint.component.DefaultDispatcherResourceManagerComponentFactory.create(DefaultDispatcherResourceManagerComponentFactory.java:288)
	at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.runCluster(ClusterEntrypoint.java:293)
	at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.lambda$startCluster$1(ClusterEntrypoint.java:232)
	at org.apache.flink.runtime.security.contexts.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:28)
	at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.startCluster(ClusterEntrypoint.java:229)
	at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.runClusterEntrypoint(ClusterEntrypoint.java:729)
	at org.apache.flink.runtime.entrypoint.StandaloneSessionClusterEntrypoint.main(StandaloneSessionClusterEntrypoint.java:59)
Caused by: org.apache.flink.util.ConfigurationException: Failed to initialize SSLEngineFactory for REST server endpoint.
	at org.apache.flink.runtime.rest.RestServerEndpointConfiguration.fromConfiguration(RestServerEndpointConfiguration.java:161)
	at org.apache.flink.runtime.rest.RestServerEndpoint.<init>(RestServerEndpoint.java:118)
	at org.apache.flink.runtime.webmonitor.WebMonitorEndpoint.<init>(WebMonitorEndpoint.java:225)
	at org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint.<init>(DispatcherRestEndpoint.java:68)
	at org.apache.flink.runtime.rest.SessionRestEndpointFactory.createRestEndpoint(SessionRestEndpointFactory.java:62)
	at org.apache.flink.runtime.entrypoint.component.DefaultDispatcherResourceManagerComponentFactory.create(DefaultDispatcherResourceManagerComponentFactory.java:166)
	... 6 more
Caused by: org.apache.flink.configuration.IllegalConfigurationException: openSSL not available
	at org.apache.flink.runtime.net.SSLUtils.getSSLProvider(SSLUtils.java:188)
	at org.apache.flink.runtime.net.SSLUtils.createRestNettySSLContext(SSLUtils.java:367)
	at org.apache.flink.runtime.net.SSLUtils.createRestServerSSLEngineFactory(SSLUtils.java:142)
	at org.apache.flink.runtime.rest.RestServerEndpointConfiguration.fromConfiguration(RestServerEndpointConfiguration.java:159)
	... 11 more
Caused by: java.lang.ClassNotFoundException: org.apache.flink.shaded.netty4.io.netty.internal.tcnative.SSLContext
	at java.net.URLClassLoader.findClass(URLClassLoader.java:387)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:418)
	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:351)
	at java.lang.Class.forName0(Native Method)
	at java.lang.Class.forName(Class.java:348)
	at org.apache.flink.shaded.netty4.io.netty.handler.ssl.OpenSsl.<clinit>(OpenSsl.java:136)
	at org.apache.flink.runtime.net.SSLUtils.getSSLProvider(SSLUtils.java:184)
	... 14 more

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=42785&view=logs&j=af184cdd-c6d8-5084-0b69-7e9c67b35f7a&t=160c9ae5-96fd-516e-1c91-deb81f59292a

Issue Links

• duplicates: FLINK-29889 netty-tcnative-static does not bundle tcnative-classes
• is related to: FLINK-29886 networkThroughput 1000,100ms,OpenSSL Benchmark is failing
• is related to: FLINK-29862 Upgrade to flink-shaded 16.1