[ZEPPELIN-3932] spark_mesos Dockerfile should be updated

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 0.8.0
• Fix Version/s: 0.8.0
• Component/s: documentation
• Labels: docker mesos spark
• Flags: Patch, Important
• Assignee: Unassigned
• Reporter: Yui Hirasawa
• Created: 02/Jan/19 02:00
• Updated: 05/Jan/19 05:18

Description

In the [spark_mesos example - Dockerfile|https://github.com/apache/zeppelin/blob/master/scripts/docker/spark-cluster-managers/spark_mesos/Dockerfile], there are some issues.

1. The original used SPARK_VERSION=2.1.2 is not available now, update it to 2.4.0
2. There is no package named libevent2-devel, it should be corrected to libevent-devel
3. Update from centos6 to centos7
4. Update from jdk7 to jdk8

 In the [spark_mesos example - entrypoint.sh|https://github.com/apache/zeppelin/blob/master/scripts/docker/spark-cluster-managers/spark_mesos/entrypoint.sh]:

1. Follow the instructionszeppelin on spark mesos mode - configure spark interpreter in zeppelin add the two environment variables.
2. add --hostname flag to the command mesos-master. This solves the problem of "Failed to connect to xx.xx.xx.xx:5050". 

Issue Links

• links to: GitHub Pull Request #3279