[SPARK-35134] setup.py will copy different version netty jars into deps/jars when execute PySpark pip packaging tests

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.2.0
• Fix Version/s: 3.2.0
• Component/s: Tests
• Assignee: Yang Jie
• Reporter: Yang Jie
• Created: 19/Apr/21 06:48
• Updated: 12/Dec/22 18:10
• Resolved: 20/Apr/21 05:39

Description

https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137500/console

 
copying deps/jars/netty-all-4.1.51.Final.jar -> pyspark-3.2.0.dev0/deps/jars
copying deps/jars/netty-buffer-4.1.50.Final.jar -> pyspark-3.2.0.dev0/deps/jars
copying deps/jars/netty-codec-4.1.50.Final.jar -> pyspark-3.2.0.dev0/deps/jars
copying deps/jars/netty-common-4.1.50.Final.jar -> pyspark-3.2.0.dev0/deps/jars
copying deps/jars/netty-handler-4.1.50.Final.jar -> pyspark-3.2.0.dev0/deps/jars
copying deps/jars/netty-resolver-4.1.50.Final.jar -> pyspark-3.2.0.dev0/deps/jars
copying deps/jars/netty-transport-4.1.50.Final.jar -> pyspark-3.2.0.dev0/deps/jars
copying deps/jars/netty-transport-native-epoll-4.1.50.Final.jar -> pyspark-3.2.0.dev0/deps/jars
 

Master relies on netty 4.1.51 but there will copy 4.1.51 and 4.1.50 to pyspark-3.2.0.dev0/deps/jars

 

-------------------------------------

 

https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137547/console

 
copying deps/jars/netty-all-4.1.63.Final.jar -> pyspark-3.2.0.dev0/deps/jars
copying deps/jars/netty-buffer-4.1.50.Final.jar -> pyspark-3.2.0.dev0/deps/jars
copying deps/jars/netty-codec-4.1.50.Final.jar -> pyspark-3.2.0.dev0/deps/jars
copying deps/jars/netty-common-4.1.50.Final.jar -> pyspark-3.2.0.dev0/deps/jars
copying deps/jars/netty-handler-4.1.50.Final.jar -> pyspark-3.2.0.dev0/deps/jars
copying deps/jars/netty-resolver-4.1.50.Final.jar -> pyspark-3.2.0.dev0/deps/jars
copying deps/jars/netty-transport-4.1.50.Final.jar -> pyspark-3.2.0.dev0/deps/jars
copying deps/jars/netty-transport-native-epoll-4.1.50.Final.jar -> pyspark-3.2.0.dev0/deps/jars
 

SPARK-35132 try to upgrade netty to 4.1.63.Final, but  still copy 4.1.63 and 4.1.50 to pyspark-3.2.0.dev0/deps/jars

 

 

 

Issue Links

• links to: [Github] Pull Request #32230 (LuciferYang)
• links to: [Github] Pull Request #32230 (LuciferYang)