[SPARK-1844] Support maven-style dependency resolution in sbt build

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Auto Closed
• Component/s: Build
• Labels: bulk-closed
• Assignee: Josh Rosen
• Reporter: Patrick Wendell
• Created: 15/May/14 07:41
• Updated: 06/Jun/19 13:58
• Resolved: 06/Jun/19 13:58

Description

[Currently this is a brainstorm/wish - not sure it's possible]

Ivy/sbt and maven use fundamentally different strategies when transitive dependencies conflict (i.e. when we have two copies of library Y in our dependency graph on different versions).

This actually means our sbt and maven builds have been divergent for a long time.

Ivy/sbt have a pluggable notion of a conflict manager. The default chooses the newest version of the dependency. SBT allows this to be changed though.

Maven employs the nearest wins policy which means the version closes to the project root is chosen.

It would be nice to be able to have matching semantics in the builds. We could do this by writing a conflict manger in sbt that mimics Maven's behavior. The fact that IVY-813 has existed for 6 years without anyone doing this makes me wonder if that is not possible or very hard

Issue Links

• duplicates: IVY-813 Add a nearest conflict manager
• links to: [Github] Pull Request #12310 (JoshRosen)