Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-3787

Assembly jar name is wrong when we build with sbt omitting -Dhadoop.version

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.2.0
    • 1.2.1, 1.3.0
    • Build
    • None

    Description

      When we build with sbt with profile for hadoop and without property for hadoop version like:

      sbt/sbt -Phadoop-2.2 assembly
      

      jar name is always used default version (1.0.4).

      When we build with maven with same condition for sbt, default version for each profile is used.
      For instance, if we build like:

      mvn -Phadoop-2.2 package
      

      jar name is used hadoop2.2.0 as a default version of hadoop-2.2.

      Attachments

        Activity

          People

            sarutak Kousuke Saruta
            sarutak Kousuke Saruta
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: