[HADOOP-16986] s3a to not need wildfly on the classpath

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.3.0
• Fix Version/s: 3.3.0
• Component/s: fs/s3
• Target Version/s: 3.3.1

Release Note

hadoop-aws can use native openssl libraries for better HTTPS performance -consult the S3A performance document for details.

To enable this, wildfly.jar is declared as a compile-time dependency of the hadoop-aws module, so ensuring it ends up on the classpath of the hadoop command line, distribution packages and downstream modules.

It is however, still optional, unless fs.s3a.ssl.channel.mode is set to openssl

• Assignee: Steve Loughran
• Reporter: Steve Loughran
• Created: 14/Apr/20 18:16
• Updated: 20/Apr/20 13:48
• Resolved: 20/Apr/20 13:46

Description

see : https://github.com/apache/hadoop/pull/1948 and HADOOP-16855

• remove a hard dependency on wildfly.jar being on the classpath for S3; it's used if present, but handled if not
• even if openssl is requested
• and NPEs are caught and swallowed in case wildfly 1.0.4.Final ever gets on the classpath again

Issue Links

• is related to: HADOOP-16346 Stabilize S3A OpenSSL support
• relates to: HADOOP-16855 ABFS: hadoop-dist fails to add wildfly in class path for hadoop-azure
• links to: GitHub Pull Request #1948