Uploaded image for project: 'Zeppelin'
  1. Zeppelin
  2. ZEPPELIN-3932

spark_mesos Dockerfile should be updated

    XMLWordPrintableJSON

    Details

    • Flags:
      Patch, Important

      Description

      In the [spark_mesos example - Dockerfile|https://github.com/apache/zeppelin/blob/master/scripts/docker/spark-cluster-managers/spark_mesos/Dockerfile], there are some issues.

      1. The original used SPARK_VERSION=2.1.2 is not available now, update it to 2.4.0
      2. There is no package named libevent2-devel, it should be corrected to libevent-devel
      3. Update from centos6 to centos7
      4. Update from jdk7 to jdk8

       In the [spark_mesos example - entrypoint.sh|https://github.com/apache/zeppelin/blob/master/scripts/docker/spark-cluster-managers/spark_mesos/entrypoint.sh]:

      1. Follow the instructionszeppelin on spark mesos mode - configure spark interpreter in zeppelin add the two environment variables.
      2. add --hostname flag to the command mesos-master. This solves the problem of "Failed to connect to xx.xx.xx.xx:5050". 

        Attachments

        1. mesos failed to connect 2.png
          104 kB
          Yui Hirasawa

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                keineahnung2345 Yui Hirasawa
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:

                  Time Tracking

                  Estimated:
                  Original Estimate - 72h
                  72h
                  Remaining:
                  Time Spent - 1.5h Remaining Estimate - 70.5h
                  70.5h
                  Logged:
                  Time Spent - 1.5h Remaining Estimate - 70.5h
                  1.5h