[MAPREDUCE-5743] TestRMContainerAllocator is failing

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.3.0, 3.0.0-alpha1
• Fix Version/s: 2.3.0
• Hadoop Flags: Reviewed
• Assignee: Ted Yu
• Reporter: Ted Yu
• Created: 11/Jan/14 14:28
• Updated: 12/May/16 18:23
• Resolved: 06/Feb/14 06:41

Description

From https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1666/console :

Tests run: 14, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 63.12 sec <<< FAILURE! - in org.apache.hadoop.mapreduce.v2.app.TestRMContainerAllocator
testCompletedTasksRecalculateSchedule(org.apache.hadoop.mapreduce.v2.app.TestRMContainerAllocator)  Time elapsed: 2.083 sec  <<< ERROR!
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.lang.NullPointerException
	at org.apache.hadoop.yarn.server.resourcemanager.scheduler.AbstractYarnScheduler.getTransferredContainers(AbstractYarnScheduler.java:50)
	at org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService.registerApplicationMaster(ApplicationMasterService.java:277)
	at org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator.register(RMCommunicator.java:154)
	at org.apache.hadoop.mapreduce.v2.app.TestRMContainerAllocator$MyContainerAllocator.register(TestRMContainerAllocator.java:1476)
	at org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator.serviceStart(RMCommunicator.java:112)
	at org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator.serviceStart(RMContainerAllocator.java:219)
	at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
	at org.apache.hadoop.mapreduce.v2.app.TestRMContainerAllocator$MyContainerAllocator.<init>(TestRMContainerAllocator.java:1444)
	at org.apache.hadoop.mapreduce.v2.app.TestRMContainerAllocator$RecalculateContainerAllocator.<init>(TestRMContainerAllocator.java:1629)
	at org.apache.hadoop.mapreduce.v2.app.TestRMContainerAllocator.testCompletedTasksRecalculateSchedule(TestRMContainerAllocator.java:1665)

In above case getMasterContainer() returned null.

AbstractYarnScheduler#getTransferredContainers() should check such condition.

Issue Links

• is duplicated by: MAPREDUCE-5726 TestRMContainerAllocator#testCompletedTasksRecalculateSchedule fails
• relates to: YARN-1041 Protocol changes for RM to bind and notify a restarted AM of existing containers
• relates to: YARN-1474 Make schedulers services