Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-140

Add capacity-scheduler-default.xml to provide a default set of configurations for the capacity scheduler.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.0.3-alpha
    • capacityscheduler
    • None

    Description

      When setting up the capacity scheduler users are faced with problems like:

      FATAL org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Error starting ResourceManager
      java.lang.IllegalArgumentException: Illegal capacity of -1 for queue root
      

      Which basically arises from missing basic configurations, which in many cases, there is no need to explicitly provide, and a default configuration will be sufficient. For example, to address the error above, the user need to add a capacity of 100 to the root queue.

      So, we need to add a capacity-scheduler-default.xml, this will be helpful to provide the basic set of default configurations required to run the capacity scheduler. The user can still override existing configurations or provide new ones in capacity-scheduler.xml. This is similar to *-default.xml vs *-site.xml for yarn, core, mapred, hdfs, etc.

      Attachments

        1. YARN-140_rev9.patch
          12 kB
          Ahmed Radwan
        2. YARN-140_rev9_svn_mv.patch
          1 kB
          Ahmed Radwan
        3. YARN-140_rev8_onlyForJenkins.patch
          26 kB
          Ahmed Radwan
        4. YARN-140_rev7_onlyForJenkins.patch
          20 kB
          Ahmed Radwan
        5. YARN-140_rev6_onlyForJenkins.patch
          18 kB
          Ahmed Radwan
        6. YARN-140_rev6.patch
          13 kB
          Ahmed Radwan
        7. YARN-140_rev5_onlyForJenkins.patch
          18 kB
          Ahmed Radwan
        8. YARN-140_rev5.patch
          13 kB
          Ahmed Radwan
        9. YARN-140_rev5_svn_mv.patch
          1 kB
          Ahmed Radwan
        10. YARN-140_rev4.patch
          18 kB
          Ahmed Radwan
        11. YARN-140_rev3.patch
          17 kB
          Ahmed Radwan
        12. YARN-140_rev2.patch
          18 kB
          Ahmed Radwan
        13. YARN-140.patch
          9 kB
          Ahmed Radwan

        Issue Links

          Activity

            People

              ahmed.radwan Ahmed Radwan
              ahmed.radwan Ahmed Radwan
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: