[SPARK-26516] zeppelin with spark on mesos: environment variable setting

• Type: Question
• Status: Resolved
• Priority: Major
• Resolution: Invalid
• Affects Version/s: 2.4.0
• Component/s: Mesos, Spark Core
• Assignee: Unassigned
• Reporter: Yui Hirasawa
• Created: 02/Jan/19 07:59
• Updated: 03/Jan/19 02:05
• Resolved: 03/Jan/19 02:05

Description

I am trying to use zeppelin with spark on mesos mode following Apache Zeppelin on Spark Cluster Mode.

In the instruction, we should set these environment variables:

export MASTER=mesos://127.0.1.1:5050
export MESOS_NATIVE_JAVA_LIBRARY=[PATH OF libmesos.so]
export SPARK_HOME=[PATH OF SPARK HOME]

As far as I know, these environment variables are used by zeppelin, so it should be set in localhost rather than in docker container(if i am wrong please correct me).

But mesos and spark is running inside docker container, so do we need to set these environment variables so that they are pointing to the path inside the docker container? If so, how should one achieve that?

Thanks in advance.