[FLINK-5631] [yarn] Support downloading additional jars from non-HDFS paths

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.3.0
• Component/s: Deployment / YARN
• Assignee: Haohui Mai
• Reporter: Haohui Mai
• Created: 24/Jan/17 22:54
• Updated: 02/Oct/19 17:45
• Resolved: 13/Feb/17 19:55

Description

Currently the YarnResourceManager and YarnApplicationMasterRunner always register the additional jars using the YARN filesystem object. This is problematic as the paths might require another filesystem.

To support localizing from non-HDFS paths (e.g., s3, http or viewfs), the cleaner approach is to get the filesystem object from the path.

Issue Links

• links to: GitHub Pull Request #3202