Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-26516

zeppelin with spark on mesos: environment variable setting

    XMLWordPrintableJSON

    Details

    • Type: Question
    • Status: Resolved
    • Priority: Major
    • Resolution: Invalid
    • Affects Version/s: 2.4.0
    • Fix Version/s: None
    • Component/s: Mesos, Spark Core
    • Labels:
      None

      Description

      I am trying to use zeppelin with spark on mesos mode following Apache Zeppelin on Spark Cluster Mode.

      In the instruction, we should set these environment variables:

      export MASTER=mesos://127.0.1.1:5050
      export MESOS_NATIVE_JAVA_LIBRARY=[PATH OF libmesos.so]
      export SPARK_HOME=[PATH OF SPARK HOME]
      

      As far as I know, these environment variables are used by zeppelin, so it should be set in localhost rather than in docker container(if i am wrong please correct me).

      But mesos and spark is running inside docker container, so do we need to set these environment variables so that they are pointing to the path inside the docker container? If so, how should one achieve that?

      Thanks in advance.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              keineahnung2345 Yui Hirasawa
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: