[GIRAPH-158] Support YARN (next generation MapReduce)

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Labels: features hadoop
• Assignee: Unassigned
• Reporter: Eugene Joseph Koontz
• Created: 18/Mar/12 05:17
• Updated: 15/Feb/13 16:32
• Resolved: 15/Feb/13 16:32

Description

YARN is a re-architecturing of the Hadoop MapReduce framework, described here:
http://hadoop.apache.org/common/docs/r0.23.0/hadoop-yarn/hadoop-yarn-site/YARN.html

It would be good to offer support within Giraph for this framework.

Issue Links

• duplicates: GIRAPH-13 Port Giraph to YARN
• is blocked by: GIRAPH-162 BspCase.setup() should catch FileNotFoundException thrown from org.apache.hadoop.fs.FileSystem.listStatus()
• is related to: GIRAPH-144 GiraphJob should not extend Job (users should not be able to call Job methods like waitForCompletion or setMapper..etc)
• relates to: HAMA-431 MapReduce NG integration