[SPARK-6081] DriverRunner doesn't support pulling HTTP/HTTPS URIs

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.0.0
• Fix Version/s: 1.4.0
• Component/s: Spark Submit
• Target Version/s: 1.4.0
• Assignee: Timothy Chen
• Reporter: Timothy Chen
• Created: 28/Feb/15 17:45
• Updated: 11/Jul/17 22:10
• Resolved: 14/Apr/15 18:49

Description

Standalone cluster mode according to the docs supports specifying http|https jar urls, but when actually called the urls passed to the driver runner is not able to pull http uris due to the usage of hadoopfs get.

Issue Links

• is related to: SPARK-6355 Spark standalone cluster does not support local:/ url for jar file
• links to: [Github] Pull Request #4832 (tnachen)