[YARN-3675] FairScheduler: RM quits when node removal races with continousscheduling on the same node

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 2.8.0, 2.7.1, 3.0.0-alpha1
• Component/s: fairscheduler
• Target Version/s: 2.7.1
• Hadoop Flags: Reviewed
• Assignee: Anubhav Dhoot
• Reporter: Anubhav Dhoot
• Created: 18/May/15 22:38
• Updated: 06/Jun/18 06:56
• Resolved: 21/May/15 20:45

Description

With continuous scheduling, scheduling can be done on a node thats just removed causing errors like below.

12:28:53.782 AM FATAL org.apache.hadoop.yarn.server.resourcemanager.ResourceManager

Error in handling event type APP_ATTEMPT_REMOVED to the scheduler
java.lang.NullPointerException
	at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt.unreserve(FSAppAttempt.java:469)
	at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.completedContainer(FairScheduler.java:815)
	at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.removeApplicationAttempt(FairScheduler.java:763)
	at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.handle(FairScheduler.java:1217)
	at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.handle(FairScheduler.java:111)
	at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$SchedulerEventDispatcher$EventProcessor.run(ResourceManager.java:684)
	at java.lang.Thread.run(Thread.java:745)
12:28:53.783 AM	 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager Exiting, bbye..

Issue Links

• is related to: YARN-5195 RM intermittently crashed with NPE while handling APP_ATTEMPT_REMOVED event when async-scheduling enabled in CapacityScheduler