[YARN-4911] Bad placement policy in FairScheduler causes the RM to crash

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.9.0, 3.0.0-alpha2
• Component/s: fairscheduler
• Labels: supportability
• Hadoop Flags: Reviewed
• Assignee: Ray Chiang
• Reporter: Ray Chiang
• Created: 01/Apr/16 23:59
• Updated: 22/Nov/16 01:52
• Resolved: 21/Oct/16 04:05

Description

When you have a fair-scheduler.xml with the rule:

<queuePlacementPolicy>
<rule name="default" queue="okay1" create="false" />
</queuePlacementPolicy>

and the queue okay1 doesn't exist, the following exception occurs in the RM:

2016-04-01 16:56:33,383 FATAL org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Error in handling event type APP_ADDED to the scheduler
java.lang.IllegalStateException: Should have applied a rule before reaching here
at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.QueuePlacementPolicy.assignAppToQueue(QueuePlacementPolicy.java:173)
at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.assignToQueue(FairScheduler.java:728)
at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.addApplication(FairScheduler.java:634)
at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.handle(FairScheduler.java:1224)
at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.handle(FairScheduler.java:112)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$SchedulerEventDispatcher$EventProcessor.run(ResourceManager.java:691)
at java.lang.Thread.run(Thread.java:745)

which causes the RM to crash.