[SPARK-19297] Add ability for --packages tag to pull latest version

• Type: New Feature
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 2.1.0
• Labels: features newbie
• Target Version/s: 3.0.1
• Assignee: Unassigned
• Reporter: Steven Landes
• Created: 19/Jan/17 21:50
• Updated: 22/Oct/20 00:05
• Resolved: 22/Oct/20 00:05

Description

It would be super-convenient, in a development environment, to be able to use the --packages argument to point spark to the latest version of a package instead of specifying a specific version.

For example, instead of the following:

--packages com.databricks:spark-csv_2.11:1.5.0

I could just put in this:

--packages com.databricks:spark-csv_2.11:latest