[YARN-2340] NPE thrown when RM restart after queue is STOPPED. There after RM can not recovery application's and remain in standby

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 2.4.1
• Fix Version/s: 2.7.0, 2.6.1, 3.0.0-alpha1
• Component/s: resourcemanager, scheduler
• Labels: 2.6.1-candidate

Environment

Capacityscheduler with Queue a, b

• Target Version/s: 2.7.0
• Hadoop Flags: Reviewed
• Assignee: Rohith Sharma K S
• Reporter: Nishan Shetty
• Created: 23/Jul/14 15:18
• Updated: 30/Aug/16 01:30
• Resolved: 23/Dec/14 05:55

Description

While job is in progress make Queue state as STOPPED and then restart RM

Observe that standby RM fails to come up as acive throwing below NPE

2014-07-23 18:43:24,432 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1406116264351_0014_000002 State change from NEW to SUBMITTED
2014-07-23 18:43:24,433 FATAL org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Error in handling event type APP_ATTEMPT_ADDED to the scheduler
java.lang.NullPointerException
at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.addApplicationAttempt(CapacityScheduler.java:568)
at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.handle(CapacityScheduler.java:916)
at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.handle(CapacityScheduler.java:101)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$SchedulerEventDispatcher$EventProcessor.run(ResourceManager.java:602)
at java.lang.Thread.run(Thread.java:662)
2014-07-23 18:43:24,434 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Exiting, bbye..

Issue Links

• is related to: YARN-2308 NPE happened when RM restart after CapacityScheduler queue configuration changed