[MESOS-6168] Mesos Spark cluster not working as expected

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: agent, master
• Assignee: Unassigned
• Reporter: Sankar Mittapally
• Created: 15/Sep/16 07:16
• Updated: 15/Sep/16 14:43

Description

Hi,

I have set it up a Mesos cluster with three master nodes and two slaves(quorum is 2). I have installed the spark on one of the master node and exported MESOS_NATIVE_JAVA_LIBRARY path and spark.executor.uri path in master node. I tried to connect the spark-shell with master node IP.

spark-shell --master mesos://ip:5050

It is able to connect the mesos cluster but any slave is not taking the framework which was created by sparkshell and showing failed in Mesos Master console.

Can you guys suggest me, what went wrong here and how to fix this.