Uploaded image for project: 'Bigtop'
  1. Bigtop
  2. BIGTOP-2074

spark-worker doesn't start during deploy from master

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.0.0
    • 1.1.0
    • deployment
    • None

    • Official Bigtop ubuntu-14.04 docker image with Hiera 1.3.0

    Description

      spark-worker refuses to start automatically after puppet apply. The error message is as follows

      15/09/26 07:05:54 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://sparkWorker@ignite.docker:7078]
15/09/26 07:05:54 INFO Remoting: Remoting now listens on addresses: [akka.tcp://sparkWorker@ignite.docker:7078]
15/09/26 07:05:54 INFO util.Utils: Successfully started service 'sparkWorker' on port 7078.
Exception in thread "main" org.apache.spark.SparkException: Invalid master URL: spark://:7077
        at org.apache.spark.util.Utils$.extractHostPortFromSparkUrl(Utils.scala:1986)
        at org.apache.spark.deploy.master.Master$.toAkkaUrl(Master.scala:879)

      Attachments

        1. BIGTOP-2074.patch
          2 kB
          Evans Ye

        Issue Links

          is broken by

          Improvement - An improvement or enhancement to an existing feature or task. BIGTOP-1974 Revise SPARK_HOME/conf/spark-env.sh

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              evans_ye Evans Ye
              cos Konstantin I Boudnik
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: