[FLINK-2085] Add an option to the MemoryManager to allocate memory as needed, rather than preallocating it

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Implemented
• Affects Version/s: 0.9
• Fix Version/s: 0.9
• Component/s: Runtime / Task
• Assignee: Stephan Ewen
• Reporter: Stephan Ewen
• Created: 22/May/15 16:32
• Updated: 26/May/15 14:24
• Resolved: 26/May/15 14:24

Description

Currently, the memory manager pre-allocates all memory.

We should introduce an option where it allocates bytes as needed and releases them when not needed any more. This will allow us to run streaming jobs and batch jobs concurrently, without blocking the memory for the streaming jobs.