Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-17686

Propose to print Scala version in "spark-submit --version" command

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • None
    • 2.1.0
    • Spark Submit
    • None

    Description

      Currently we have a use case that needs to upload different jars to Spark according to scala version. For now only after launching Spark application can we know which version of Scala it depends on. It makes hard for some services which needs to support different Scala + Spark versions to pick the right jars.

      So here propose to print out Scala version according to Spark version in "spark-submit --version", so that user could leverage this output to make the choice without needing to launching application.

      Attachments

        Activity

          People

            jerryshao Saisai Shao
            jerryshao Saisai Shao
            Votes:
            1 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: