Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-12345

Mesos cluster mode is broken

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 1.6.0
    • Fix Version/s: 1.6.0
    • Component/s: Mesos
    • Labels:
      None
    • Target Version/s:

      Description

      The same setup worked in 1.5.2 but is now failing for 1.6.0-RC2.

      The driver is confused about where SPARK_HOME is. It resolves `mesos.executor.uri` or `spark.mesos.executor.home` relative to the filesystem where the driver runs, which is wrong.

      I1215 15:00:39.411212 28032 exec.cpp:134] Version: 0.25.0
      I1215 15:00:39.413512 28037 exec.cpp:208] Executor registered on slave 130bdc39-44e7-4256-8c22-602040d337f1-S1
      bin/spark-submit: line 27: /Users/dragos/workspace/Spark/dev/rc-tests/spark-1.6.0-bin-hadoop2.6/bin/spark-class: No such file or directory
      

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                tnachen Timothy Chen
                Reporter:
                andrewor14 Andrew Or
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: