Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-7766

Introduce a new config property for YARN Service dependency tarball location

    XMLWordPrintableJSON

    Details

    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      Introduce a new config property (something like yarn.service.framework.path in-line with mapreduce.application.framework.path) for YARN Service dependency tarball location. This will provide flexibility to the user/cluster-admin to upload the dependency tarball to a location of their choice. If this config property is not set, YARN Service client will default to uploading all dependency jars from the client-host's classpath for every service launch request (as it does today).

      Also, accept an optional destination HDFS location for -enableFastLaunch command, to specify the location where user/cluster-admin wants to upload the tarball. If not specified, let's default it to the location we use today. The cluster-admin still needs to set yarn.service.framework.path to this default location otherwise it will not be used. So the command-line will become something like this -

      yarn app -enableFastLaunch [<Destination Folder>]

        Attachments

        1. YARN-7766.004.patch
          16 kB
          Gour Saha
        2. YARN-7766.003.patch
          16 kB
          Gour Saha
        3. YARN-7766.002.patch
          19 kB
          Gour Saha
        4. YARN-7766.001.patch
          19 kB
          Gour Saha

          Activity

            People

            • Assignee:
              gsaha Gour Saha
              Reporter:
              gsaha Gour Saha
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: