Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-7766

Introduce a new config property for YARN Service dependency tarball location

    XMLWordPrintableJSON

Details

    • Reviewed

    Description

      Introduce a new config property (something like yarn.service.framework.path in-line with mapreduce.application.framework.path) for YARN Service dependency tarball location. This will provide flexibility to the user/cluster-admin to upload the dependency tarball to a location of their choice. If this config property is not set, YARN Service client will default to uploading all dependency jars from the client-host's classpath for every service launch request (as it does today).

      Also, accept an optional destination HDFS location for -enableFastLaunch command, to specify the location where user/cluster-admin wants to upload the tarball. If not specified, let's default it to the location we use today. The cluster-admin still needs to set yarn.service.framework.path to this default location otherwise it will not be used. So the command-line will become something like this -

      yarn app -enableFastLaunch [<Destination Folder>]

      Attachments

        1. YARN-7766.004.patch
          16 kB
          Gour Saha
        2. YARN-7766.003.patch
          16 kB
          Gour Saha
        3. YARN-7766.002.patch
          19 kB
          Gour Saha
        4. YARN-7766.001.patch
          19 kB
          Gour Saha

        Activity

          People

            gsaha Gour Saha
            gsaha Gour Saha
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: