Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-887

mvn package doesn't include yarn in the repl-bin shaded jar

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.8.0
    • 0.8.0
    • Build
    • None

    Description

      If you build with sbt (SPARK_WITH_YARN=true sbt/sbt package assembly) it will add the Yarn classes (YarnClientImpl) into the repl assembled jar ./repl/target/spark-repl-assembly-0.8.0-SNAPSHOT.jar , but if you build with mvn -Phadoop2-yarn package it doesn't add the Yarn class in the repl shaded jar (./repl-bin/target/spark-repl-bin-0.8.0-SNAPSHOT-shaded.jar)

      We should keep these consistent. This matters for https://github.com/mesos/spark/pull/868 as it is relying on the YarnClientImpl being in the jar.

      Attachments

        Activity

          People

            matei Matei Alexandru Zaharia
            tgraves Thomas Graves
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: