[TEZ-4399] ShuffleHandler fails with SSLHandshakeException not found when SSL is enabled

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 0.9.2, 0.10.1
• Fix Version/s: 0.9.3, 0.10.2
• Assignee: Himanshu Mishra
• Reporter: Himanshu Mishra
• Created: 30/Mar/22 10:40
• Updated: 01/Apr/22 08:48
• Resolved: 01/Apr/22 08:48

Description

When SSL is enabled on Tez Shuffle service setting tez.shuffle.ssl.enabled to true. ShuffleHandler fails with following trace:

WARN org.apache.tez.shaded.io.netty.channel.ChannelInitializer (Tez Shuffle Handler Worker #1): Failed to initialize a channel. Closing: [id: 0xd616d5cc, L:/127.0.0.1:13563 - R:/127.0.0.1:56454]
java.lang.NoClassDefFoundError: org/apache/tez/shaded/javax/net/ssl/SSLHandshakeException
	at org.apache.tez.auxservices.ShuffleHandler$3.initChannel(ShuffleHandler.java:604)
	at org.apache.tez.auxservices.ShuffleHandler$3.initChannel(ShuffleHandler.java:599)
	at org.apache.tez.shaded.io.netty.channel.ChannelInitializer.initChannel(ChannelInitializer.java:129)
	at org.apache.tez.shaded.io.netty.channel.ChannelInitializer.handlerAdded(ChannelInitializer.java:112)
	at org.apache.tez.shaded.io.netty.channel.AbstractChannelHandlerContext.callHandlerAdded(AbstractChannelHandlerContext.java:938)
	at org.apache.tez.shaded.io.netty.channel.DefaultChannelPipeline.callHandlerAdded0(DefaultChannelPipeline.java:609)
	at org.apache.tez.shaded.io.netty.channel.DefaultChannelPipeline.access$100(DefaultChannelPipeline.java:46)
    ...
Caused by: java.lang.ClassNotFoundException: org.apache.tez.shaded.javax.net.ssl.SSLHandshakeException 

 

Also, DagDeleteTracker does not respect config tez.runtime.shuffle.ssl.enable and uses http protocol which fails when SSL is enabled.

 

 

 

Issue Links

• links to: GitHub Pull Request #196