[ARROW-1818] Examine Java Dependencies

• Type: Task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.8.0
• Component/s: Java
• External issue URL: https://github.com/apache/arrow/issues/17813
• Assignee: Bryan Cutler
• Reporter: Bryan Cutler
• Created: 15/Nov/17 19:13
• Updated: 11/Jan/23 07:17
• Resolved: 29/Aug/22 14:14

Description

While integrating the latest Arrow Java with Spark master, I noticed some possible binary incompatibilities with dependencies. I'd like to examine these a little closer and make sure there are no problems before 0.8 is cut.

 Found version conflict(s) in library dependencies; some are suspected to be binary incompatible:
[warn] 
[warn] 	* com.google.code.findbugs:jsr305:3.0.2 is selected over {1.3.9, 3.0.0}
[warn] 	    +- org.apache.arrow:arrow-vector:0.8.0-SNAPSHOT       (depends on 3.0.2)
[warn] 	    +- org.apache.arrow:arrow-memory:0.8.0-SNAPSHOT       (depends on 3.0.2)
[warn] 	    +- org.apache.hadoop:hadoop-common:2.7.3              (depends on 3.0.0)
[warn] 	    +- org.apache.spark:spark-unsafe_2.11:2.3.0-SNAPSHOT  (depends on 1.3.9)
[warn] 	    +- org.apache.spark:spark-core_2.11:2.3.0-SNAPSHOT    (depends on 1.3.9)
[warn] 	    +- org.apache.spark:spark-network-common_2.11:2.3.0-SNAPSHOT (depends on 1.3.9)
[warn] 
[warn] 	* io.netty:netty:3.9.9.Final is selected over {3.6.2.Final, 3.7.0.Final}
[warn] 	    +- org.apache.spark:spark-core_2.11:2.3.0-SNAPSHOT    (depends on 3.9.9.Final)
[warn] 	    +- org.apache.hadoop:hadoop-hdfs:2.7.3                (depends on 3.6.2.Final)
[warn] 	    +- org.apache.zookeeper:zookeeper:3.4.6               (depends on 3.6.2.Final)
[warn] 
[warn] 	* io.netty:netty-all:4.0.47.Final is selected over 4.0.23.Final
[warn] 	    +- org.apache.hadoop:hadoop-hdfs:2.7.3                (depends on 4.0.23.Final)
[warn] 	    +- org.apache.spark:spark-core_2.11:2.3.0-SNAPSHOT    (depends on 4.0.23.Final)
[warn] 	    +- org.apache.spark:spark-network-common_2.11:2.3.0-SNAPSHOT (depends on 4.0.23.Final)
[warn] 
[warn] 	* commons-net:commons-net:3.1 is selected over 2.2
[warn] 	    +- org.apache.hadoop:hadoop-common:2.7.3              (depends on 3.1)
[warn] 	    +- org.apache.spark:spark-core_2.11:2.3.0-SNAPSHOT    (depends on 2.2)