[YARN-8828] When config ReservationSystem ,the RM start failed.

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.1.0
• Component/s: capacity scheduler
• Labels: usability
• Target Version/s: 3.1.0
• Assignee: Unassigned
• Reporter: yimeng
• Created: 27/Sep/18 03:42
• Updated: 05/Dec/18 11:28

Description

I tested ReservationSystem in Hadooop 3.0,but it seems have problem.

1.config yarn.resourcemanager.reservation-system.enable = true in RM yarn-site.xml 

2.select a leaf queue "bbb" ,config yarn.scheduler.capacity.root.bbb.reservable = true  in capacity-scheduler.xml,as follow

<property>

<name>yarn.scheduler.capacity.root.bbb.reservable</name>
<value>true</value>
</property>

3.then restart RM ,the RM start failed .The error stack log is as follows:

2018-09-27 11:30:15,691 | FATAL | main | Error starting ResourceManager | ResourceManager.java:1517
org.apache.hadoop.service.ServiceStateException: java.io.IOException: mapping contains invalid or non-leaf queue : bbb
at org.apache.hadoop.service.ServiceStateException.convert(ServiceStateException.java:105)
at org.apache.hadoop.service.AbstractService.init(AbstractService.java:173)
at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:108)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMActiveServices.serviceInit(ResourceManager.java:813)
at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.createAndInitActiveServices(ResourceManager.java:1214)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:315)
at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1510)
Caused by: java.io.IOException: mapping contains invalid or non-leaf queue : bbb
at org.apache.hadoop.yarn.server.resourcemanager.placement.UserGroupMappingPlacementRule.validateAndGetQueueMapping(UserGroupMappingPlacementRule.java:316)
at org.apache.hadoop.yarn.server.resourcemanager.placement.UserGroupMappingPlacementRule.get(UserGroupMappingPlacementRule.java:280)
at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.getUserGroupMappingPlacementRule(CapacityScheduler.java:668)
at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.updatePlacementRules(CapacityScheduler.java:689)
at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.initializeQueues(CapacityScheduler.java:716)
at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.initScheduler(CapacityScheduler.java:360)
at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.serviceInit(CapacityScheduler.java:425)
at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164)
... 7 more

 

I am sure the queue "bbb" is a leaf queue.