Description
Openjdk8 is based on alpine 3.9, this means that the version shipped of libssl is 1.1.1b-r1:
sh-4.4# apk list | grep ssl libssl1.1-1.1.1b-r1 x86_64 {openssl} (OpenSSL) [installed]
The hadoop distro ships wildfly-openssl-1.0.4.Final.jar, which is affected by https://issues.jboss.org/browse/JBEAP-16425.
This results on error running runtime errors (using spark as an example)
2019-07-04 22:32:40,339 INFO openssl.SSL: WFOPENSSL0002 OpenSSL Version OpenSSL 1.1.1b 26 Feb 2019 2019-07-04 22:32:40,363 WARN streaming.FileStreamSink: Error while looking for metadata directory. Exception in thread "main" java.lang.NullPointerException at org.wildfly.openssl.CipherSuiteConverter.toJava(CipherSuiteConverter.java:284)
In my tests creating a Docker image with an updated version of wildly, solves the issue: 1.0.7.Final
Attachments
Issue Links
- depends upon
-
HADOOP-16460 ABFS: fix for Sever Name Indication (SNI)
- Resolved
- duplicates
-
HADOOP-16405 Upgrade Wildfly Openssl version to 1.0.7.Final
- Resolved
- relates to
-
SPARK-28258 Incopatibility betweek spark docker image and hadoop 3.2 and azure tools
- Resolved