[GIRAPH-819] Number of containers required for a job

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.1.0
• Fix Version/s: 1.1.0
• Component/s: lib, mapreduce
• Labels: patch
• Assignee: Unassigned
• Reporter: Rafal Wojdyla
• Created: 14/Dec/13 00:54
• Updated: 30/Jan/14 20:02
• Resolved: 30/Jan/14 19:47

Description

Java 1.6.x
Giraph trunk - revert java 1.7 support.
Hadoop 2.2.0.x

Job submission fails due to:

13/11/28 12:02:14 INFO yarn.GiraphYarnClient: Running Client
13/11/28 12:02:14 INFO client.RMProxy: Connecting to ResourceManager at master/192.168.1.100:8045
13/11/28 12:02:15 INFO yarn.GiraphYarnClient: Got node report from ASM for, nodeId=kreator:46477, nodeAddresskreator:8042, nodeRackName/default-rack, nodeNumContainers7
13/11/28 12:02:15 INFO yarn.GiraphYarnClient: Got node report from ASM for, nodeId=exotica:46645, nodeAddressexotica:8042, nodeRackName/default-rack, nodeNumContainers8
Exception in thread "main" java.lang.RuntimeException: Giraph job requires 2 containers to run; cluster only hosts 15
	at org.apache.giraph.yarn.GiraphYarnClient.checkPerNodeResourcesAvailable(GiraphYarnClient.java:230)
	at org.apache.giraph.yarn.GiraphYarnClient.run(GiraphYarnClient.java:125)