[HDFS-14037] Fix SSLFactory truststore reloader thread leak in URLConnectionFactory

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.0.4, 3.3.0, 3.2.1, 3.1.3
• Component/s: hdfs-client, webhdfs
• Assignee: Takanobu Asanuma
• Reporter: Takanobu Asanuma
• Created: 30/Oct/18 04:49
• Updated: 17/Aug/23 03:32
• Resolved: 26/Mar/19 18:32

Description

This is reported by yoshiata. It is a similar issue as HADOOP-11368 and YARN-5309 in URLConnectionFactory.

SSLFactory in newSslConnConfigurator and subsequently creates the ReloadingX509TrustManager instance which in turn starts a trust store reloader thread.
However, the SSLFactory is never destroyed and hence the trust store reloader threads are not killed.

We observed many leaked threads when we used swebhdfs via NiFi cluster.

"Truststore reloader thread" Id=221 TIMED_WAITING  on null
        at java.lang.Thread.sleep(Native Method)
        at org.apache.hadoop.security.ssl.ReloadingX509TrustManager.run(ReloadingX509TrustManager.java:189)
        at java.lang.Thread.run(Thread.java:748)