[GIRAPH-91] Large-memory improvements (Memory reduced vertex implementation, fast failure, added settings)

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.1.0
• Fix Version/s: 0.1.0
• Assignee: Avery Ching
• Reporter: Avery Ching
• Created: 16/Nov/11 22:02
• Updated: 31/Jan/12 23:26
• Resolved: 17/Nov/11 18:33

Description

Current vertex implementation uses a HashMap for storing the edges, which is quite memory heavy for large graphs. The default settings in Giraph need to be improved for large graphs and heaps of >20G.