[SPARK-16364] Allow spark-submit to upload jars to nodes in cluster mode

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Duplicate
• Affects Version/s: 1.6.2
• Component/s: Spark Submit

Environment

Stand-Alone cluster

• Assignee: Unassigned
• Reporter: Ashic Mahtab
• Created: 04/Jul/16 12:31
• Updated: 05/Jul/16 17:01
• Resolved: 05/Jul/16 16:57

Description

Currently, it seems that with a stand-alone cluster, running spark-submit with --deploy-mode cluster requires the target jar to be visible from all nodes. It would be convenient if spark-submit had the option to copy the jar to the relevant nodes, instead of requiring it to already by present.

Issue Links

• duplicates: SPARK-4160 Standalone cluster mode does not upload all needed jars to driver node