[FLINK-1734] Insufficient memory allocation in Gelly

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Not A Problem
• Affects Version/s: 0.10.0
• Component/s: Library / Graph Processing, Runtime / Task

Environment

Local (tested with dop 1 and 3)

• Assignee: Unassigned
• Reporter: Robert Waury
• Created: 18/Mar/15 14:39
• Updated: 06/Oct/15 15:51
• Resolved: 18/Mar/15 23:14

Description

For a simple Gelly job running in a 3GB heap only ~130 MB are allocated to the internal hash table. This causes to job to fail while loading the input data for even moderately sized problems. For smaller heaps the fraction allocated becomes even smaller.

The code and data to reproduce this behavior were posted on the user mailing list:
http://apache-flink-incubator-user-mailing-list-archive.2336050.n4.nabble.com/RuntimeException-Gelly-API-Memory-ran-out-Compaction-failed-td866.html