Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-8828

When config ReservationSystem ,the RM start failed.

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 3.1.0
    • Fix Version/s: None
    • Component/s: capacity scheduler
    • Labels:
    • Target Version/s:

      Description

      I tested ReservationSystem in Hadooop 3.0,but it seems have problem.

      1.config yarn.resourcemanager.reservation-system.enable = true in RM yarn-site.xml 

      2.select a leaf queue "bbb" ,config yarn.scheduler.capacity.root.bbb.reservable = true  in capacity-scheduler.xml,as follow

      <property>

      <name>yarn.scheduler.capacity.root.bbb.reservable</name>
      <value>true</value>
      </property>

      3.then restart RM ,the RM start failed .The error stack log is as follows:

      2018-09-27 11:30:15,691 | FATAL | main | Error starting ResourceManager | ResourceManager.java:1517
      org.apache.hadoop.service.ServiceStateException: java.io.IOException: mapping contains invalid or non-leaf queue : bbb
      at org.apache.hadoop.service.ServiceStateException.convert(ServiceStateException.java:105)
      at org.apache.hadoop.service.AbstractService.init(AbstractService.java:173)
      at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:108)
      at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMActiveServices.serviceInit(ResourceManager.java:813)
      at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164)
      at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.createAndInitActiveServices(ResourceManager.java:1214)
      at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:315)
      at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164)
      at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1510)
      Caused by: java.io.IOException: mapping contains invalid or non-leaf queue : bbb
      at org.apache.hadoop.yarn.server.resourcemanager.placement.UserGroupMappingPlacementRule.validateAndGetQueueMapping(UserGroupMappingPlacementRule.java:316)
      at org.apache.hadoop.yarn.server.resourcemanager.placement.UserGroupMappingPlacementRule.get(UserGroupMappingPlacementRule.java:280)
      at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.getUserGroupMappingPlacementRule(CapacityScheduler.java:668)
      at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.updatePlacementRules(CapacityScheduler.java:689)
      at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.initializeQueues(CapacityScheduler.java:716)
      at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.initScheduler(CapacityScheduler.java:360)
      at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.serviceInit(CapacityScheduler.java:425)
      at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164)
      ... 7 more

       

      I am sure the queue "bbb" is a leaf queue.

        Attachments

        1. capacity-scheduler.xml
          8 kB
          yimeng
        2. yarn-site.xml
          15 kB
          yimeng

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              jj336013 yimeng
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated: