Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-5631

[yarn] Support downloading additional jars from non-HDFS paths

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.3.0
    • Component/s: YARN
    • Labels:
      None

      Description

      Currently the YarnResourceManager and YarnApplicationMasterRunner always register the additional jars using the YARN filesystem object. This is problematic as the paths might require another filesystem.

      To support localizing from non-HDFS paths (e.g., s3, http or viewfs), the cleaner approach is to get the filesystem object from the path.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                wheat9 Haohui Mai
                Reporter:
                wheat9 Haohui Mai
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: