[OOZIE-1029] MiniMRCluster fails to start when used against YARN

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: trunk
• Fix Version/s: 3.3.2
• Component/s: tests
• Assignee: Robert Kanter
• Reporter: Robert Kanter
• Created: 23/Oct/12 20:12
• Updated: 20/Jul/13 00:03
• Resolved: 26/Oct/12 23:31

Description

When using YARN (via invoking maven with -Phadoop-3), any tests using the MiniMRCluster get an error because MiniMRCluster fails to start.

For example:

org.apache.hadoop.yarn.YarnException: Failed to Start org.apache.hadoop.mapred.MiniMRCluster
	at org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:78)
	at org.apache.hadoop.mapred.MiniMRClientClusterFactory.create(MiniMRClientClusterFactory.java:71)
	at org.apache.hadoop.mapred.MiniMRCluster.<init>(MiniMRCluster.java:180)
	at org.apache.hadoop.mapred.MiniMRCluster.<init>(MiniMRCluster.java:170)
	at org.apache.hadoop.mapred.MiniMRCluster.<init>(MiniMRCluster.java:162)
	at org.apache.oozie.test.XTestCase.setUpEmbeddedHadoop(XTestCase.java:725)
	at org.apache.oozie.test.XTestCase.setUp(XTestCase.java:281)
	at org.apache.oozie.test.XFsTestCase.setUp(XFsTestCase.java:58)
        ...
Caused by: org.apache.hadoop.yarn.YarnException: java.lang.IllegalStateException: Queue configuration missing child queue names for root
	at org.apache.hadoop.yarn.server.MiniYARNCluster$ResourceManagerWrapper.start(MiniYARNCluster.java:184)
	at org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:68)
	... 26 more
Caused by: java.lang.IllegalStateException: Queue configuration missing child queue names for root
	at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.parseQueue(CapacityScheduler.java:307)
	at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.initializeQueues(CapacityScheduler.java:232)
	at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.reinitialize(CapacityScheduler.java:202)
	at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.init(ResourceManager.java:201)
	at org.apache.hadoop.yarn.server.MiniYARNCluster$ResourceManagerWrapper.start(MiniYARNCluster.java:164)
	... 27 more

Issue Links

• blocks: OOZIE-1030 TestPigMain fails again hadoop trunk (-Phadoop-3)
• blocks: OOZIE-1031 TestPigActionExecutor fails against hadoop trunk (-Phadoop-3)
• blocks: OOZIE-1011 Tests from OOZIE-994 fail when run against Hadoop trunk
• relates to: OOZIE-1040 Revert OOZIE-1029 once YARN-140 is part of a Hadoop release