[SPARK-8941] Standalone cluster worker does not accept multiple masters on launch

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Duplicate
• Affects Version/s: 1.4.0, 1.4.1
• Component/s: Deploy, Documentation
• Assignee: Unassigned
• Reporter: Jesper Lundgren
• Created: 09/Jul/15 04:38
• Updated: 13/Jul/15 09:44
• Resolved: 13/Jul/15 09:44

Description

Before 1.4 it was possible to launch a worker node using a comma separated list of master nodes.

ex:
sbin/start-slave.sh 1 "spark://localhost:7077,localhost:7078"
starting org.apache.spark.deploy.worker.Worker, logging to /Users/jesper/Downloads/spark-1.4.0-bin-cdh4/sbin/../logs/spark-jesper-org.apache.spark.deploy.worker.Worker-1-Jespers-MacBook-Air.local.out
failed to launch org.apache.spark.deploy.worker.Worker:
Default is conf/spark-defaults.conf.
15/07/09 12:33:06 INFO Utils: Shutdown hook called

Spark 1.2 and 1.3.1 accepts multiple masters in this format.

update: start-slave.sh only expects master lists in 1.4 (no instance number)

Issue Links

• duplicates: SPARK-9007 start-slave.sh changed API in 1.4 and the documentation got updated to mention the old API
• duplicates: SPARK-6443 Support HA in standalone cluster mode