[SPARK-35863] Upgrade Ivy to 2.5.0

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.1.2
• Fix Version/s: 3.2.0
• Component/s: Spark Submit
• Assignee: Adam Binford
• Reporter: Adam Binford
• Created: 23/Jun/21 12:51
• Updated: 25/Jun/21 14:37
• Resolved: 25/Jun/21 14:37

Description

Apache Ivy 2.5.0 was released nearly two years ago. The new bug fixes and features can be found here: https://ant.apache.org/ivy/history/latest-milestone/release-notes.html

Most notably, the adding of ivy.maven.lookup.sources and ivy.maven.lookup.javadoc configs can significantly speed up module resolution time if these are turned off, especially behind a proxy. These could arguably be turned off by default, because when submitting jobs you probably don't care about the sources or javadoc jars.

Issue Links

• links to: [Github] Pull Request #33088 (Kimahriman)