[SPARK-13577] Allow YARN to handle multiple jars, archive when uploading Spark dependencies

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Component/s: Spark Core, YARN
• Target Version/s: 2.0.0
• Assignee: Marcelo Masiero Vanzin
• Reporter: Marcelo Masiero Vanzin
• Created: 29/Feb/16 20:57
• Updated: 17/May/20 18:17
• Resolved: 11/Mar/16 14:10

Description

See parent bug for more details.

Before we remove assemblies from Spark, we need the YARN backend to understand how to find and upload multiple jars containing the Spark code. as a feature request made during spec review, we should also allow the Spark code to be provided as an archive that would be uploaded as a single file to the cluster, but exploded when downloaded to the containers.

Issue Links

• links to: [Github] Pull Request #11500 (vanzin)