Uploaded image for project: 'Bigtop'
  1. Bigtop
  2. BIGTOP-2074

spark-worker doesn't start during deploy from master

          Details

          • Type: Bug
          • Status: Resolved
          • Priority: Major
          • Resolution: Fixed
          • Affects Version/s: 1.0.0
          • Fix Version/s: 1.1.0
          • Component/s: deployment
          • Labels:
            None
          • Environment:

            Official Bigtop ubuntu-14.04 docker image with Hiera 1.3.0

            Description

            spark-worker refuses to start automatically after puppet apply. The error message is as follows

            15/09/26 07:05:54 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://sparkWorker@ignite.docker:7078]
15/09/26 07:05:54 INFO Remoting: Remoting now listens on addresses: [akka.tcp://sparkWorker@ignite.docker:7078]
15/09/26 07:05:54 INFO util.Utils: Successfully started service 'sparkWorker' on port 7078.
Exception in thread "main" org.apache.spark.SparkException: Invalid master URL: spark://:7077
        at org.apache.spark.util.Utils$.extractHostPortFromSparkUrl(Utils.scala:1986)
        at org.apache.spark.deploy.master.Master$.toAkkaUrl(Master.scala:879)

              Attachments

                Issue Links

                is broken by

                Improvement - An improvement or enhancement to an existing feature or task. BIGTOP-1974 Revise SPARK_HOME/conf/spark-env.sh

                • Major - Major loss of function.
                • Resolved

                  Activity

                    People

                    • Assignee:
                      evans_ye Evans Ye
                      Reporter:
                      cos Konstantin Boudnik
                    • Votes:
                      0 Vote for this issue
                      Watchers:
                      3 Start watching this issue

                      Dates

                      • Created:
                        Updated:
                        Resolved: