[HUDI-8233] rename hudi-spark-client jar to include the scala binary version

• Type: Task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Fix Version/s: 1.1.0
• Assignee: Unassigned
• Reporter: PJ Fanning
• Created: 21/Sep/24 21:17
• Updated: 30/Oct/24 01:17

Description

https://mvnrepository.com/artifact/org.apache.hudi/hudi-spark-client/1.0.0-beta2

hudi-spark-client depends on scala-collections-compat and Apache Spark jars that are built for Scala 2.12.

Ideally, to follow Scala jar naming norms, you should have hudi-spark-client_2.12.jar for Scala 2.12 users and hudi-spark-client_2.13.jar for Scala 2.13 users.

You already add the Scala version suffix to some other Hudi jars.

This is another one that looks like it should have a _2.12 suffix in the name.
https://mvnrepository.com/artifact/org.apache.hudi/hudi-spark3-common/1.0.0-beta2

If you look at hudi-spark3.5.x_2.13, it has a dependency on hudi-spark-client and it has Scala 2.12 dependencies. This is likely to cause a real complications for users.

https://repo1.maven.org/maven2/org/apache/hudi/hudi-spark3.5.x_2.13/1.0.0-beta2/hudi-spark3.5.x_2.13-1.0.0-beta2.pom

Issue Links

• relates to: HUDI-7736 Support Scala 2.13 for Spark 3.3 and 3.4 integration