[SPARK-22402] Allow fetcher URIs to be downloaded to specific locations relative to Mesos Sandbox

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Incomplete
• Affects Version/s: 2.2.0, 2.3.0
• Component/s: Mesos
• Labels: bulk-closed
• Assignee: Unassigned
• Reporter: Arthur Rand
• Created: 30/Oct/17 21:08
• Updated: 08/Oct/19 05:43
• Resolved: 08/Oct/19 05:43

Description

Currently spark.mesos.uris will only place files in the sandbox, but some configuration files and applications may need to be in specific locations. The Mesos proto allows for this with the optional output_file field (https://github.com/apache/mesos/blob/master/include/mesos/mesos.proto#L671). We can expose this through the command line with --conf spark.mesos.uris=<uri>:<path>