Details
-
Improvement
-
Status: Resolved
-
Minor
-
Resolution: Fixed
-
None
-
None
Description
Currently we have a use case that needs to upload different jars to Spark according to scala version. For now only after launching Spark application can we know which version of Scala it depends on. It makes hard for some services which needs to support different Scala + Spark versions to pick the right jars.
So here propose to print out Scala version according to Spark version in "spark-submit --version", so that user could leverage this output to make the choice without needing to launching application.