Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-5072

Support comma separated list of includes and excludes files

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • None
    • None
    • resourcemanager

    Description

      When a yarn cluster shares the same hosts as the underlying HDFS cluster, we have yarn.resourcemanager.nodes.include-path point to the same file or symlink of the dfs.hosts file used by HDFS to make admin easier.

      If we want to set up a yarn cluster to run on the same hosts of several HDFS clusters combined, it means yarn.resourcemanager.nodes.include-path should be able to point to a list of files each of which belongs to one HDFS cluster.

      Backward compatibility, it seems ok to continue to reuse yarn.resourcemanager.nodes.include-path as long as it can still take a single file.

      Attachments

        1. YARN-5072.patch
          22 kB
          Ming Ma

        Activity

          People

            mingma Ming Ma
            mingma Ming Ma
            Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated: