Uploaded image for project: 'Bigtop'
  1. Bigtop
  2. BIGTOP-2074

spark-worker doesn't start during deploy from master

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.0.0
    • Fix Version/s: 1.1.0
    • Component/s: deployment
    • Labels:
      None
    • Environment:

      Official Bigtop ubuntu-14.04 docker image with Hiera 1.3.0

      Description

      spark-worker refuses to start automatically after puppet apply. The error message is as follows

      15/09/26 07:05:54 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://sparkWorker@ignite.docker:7078]
      15/09/26 07:05:54 INFO Remoting: Remoting now listens on addresses: [akka.tcp://sparkWorker@ignite.docker:7078]
      15/09/26 07:05:54 INFO util.Utils: Successfully started service 'sparkWorker' on port 7078.
      Exception in thread "main" org.apache.spark.SparkException: Invalid master URL: spark://:7077
              at org.apache.spark.util.Utils$.extractHostPortFromSparkUrl(Utils.scala:1986)
              at org.apache.spark.deploy.master.Master$.toAkkaUrl(Master.scala:879)
      

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                evans_ye Evans Ye
                Reporter:
                cos Konstantin Boudnik
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: