Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-116

RM is missing ability to add include/exclude files without a restart

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 2.0.0-alpha
    • 2.0.3-alpha, 0.23.5
    • resourcemanager
    • None

    Description

      The "yarn.resourcemanager.nodes.include-path" default value is "", if we need to add an include file, we must currently restart the RM.

      I suggest that for adding an include or exclude file, there should be no need to restart the RM. We may only execute the refresh command. The HDFS NameNode already has this ability.

      Fix is to the modify HostsFileReader class instances:

      From:

      public HostsFileReader(String inFile, 
                               String exFile)
      

      To:

       public HostsFileReader(Configuration conf, 
                               String NODES_INCLUDE_FILE_PATH,String DEFAULT_NODES_INCLUDE_FILE_PATH,
                              String NODES_EXCLUDE_FILE_PATH,String DEFAULT_NODES_EXCLUDE_FILE_PATH)
      

      And thus, we can read the config file dynamically when a refreshNodes is invoked and therefore have no need to restart the ResourceManager.

      Attachments

        1. YARN-116.patch
          8 kB
          Harsh J
        2. HADOOP-835-1.patch
          8 kB
          xieguiming
        3. HADOOP-835-0.patch
          6 kB
          xieguiming
        4. HADOOP-835.patch
          1 kB
          xieguiming

        Activity

          People

            xieguiming xieguiming
            xieguiming xieguiming
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: