[SPARK-34110] Upgrade ZooKeeper to 3.6.2

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.2.0
• Fix Version/s: 3.2.0
• Component/s: Build
• Assignee: Yuming Wang
• Reporter: Yuming Wang
• Created: 14/Jan/21 05:35
• Updated: 16/Jan/21 05:13
• Resolved: 16/Jan/21 05:13

Description

When running Spark on JDK 14:

21/01/13 20:25:32,533 WARN [Driver-SendThread(apache-spark-zk-3.vip.hadoop.com:2181)] zookeeper.ClientCnxn:1164 : Session 0x0 for server apache-spark-zk-3.vip.hadoop.com/<unresolved>:2181, unexpected error, closing socket connection and attempting reconnect
java.lang.IllegalArgumentException: Unable to canonicalize address apache-spark-zk-3.vip.hadoop.com/<unresolved>:2181 because it's not resolvable
	at org.apache.zookeeper.SaslServerPrincipal.getServerPrincipal(SaslServerPrincipal.java:65)
	at org.apache.zookeeper.SaslServerPrincipal.getServerPrincipal(SaslServerPrincipal.java:41)
	at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1001)
	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)

Please see ZOOKEEPER-3779 for more details.

Issue Links

• is caused by: ZOOKEEPER-3779 Zookeeper client 3.4.x fails to connect when using Java 14
• links to: [Github] Pull Request #31177 (wangyum)