[SPARK-6833] Extend `addPackage` so that any given R file can be sourced in the worker before functions are run.

• Type: New Feature
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 1.5.0
• Component/s: SparkR
• Target Version/s: 1.5.0
• External issue URL: https://sparkr.atlassian.net/browse/SPARKR-93
• Assignee: Sun Rui
• Reporter: Shivaram Venkataraman
• Created: 09/Apr/15 23:07
• Updated: 02/Jul/15 13:07
• Resolved: 01/Jul/15 16:18

Description

Similar to how extra python files or packages can be specified (in zip / egg formats), it will be good to support the ability to add extra R files to the executors working directory.

One thing that needs to be investigated is if this will just work out of the box using the spark-submit flag --files ?