[SPARK-10956] Introduce common memory management interface for execution and storage

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.6.0
• Component/s: Spark Core
• Target Version/s: 1.6.0
• Assignee: Andrew Or
• Reporter: Andrew Or
• Created: 06/Oct/15 19:27
• Updated: 09/Oct/15 04:45
• Resolved: 09/Oct/15 04:45

Description

The first step towards implementing a solution for SPARK-10000 is to refactor the existing code to go through a common MemoryManager interface. This issue is concerned only with the introduction of this interface, preserving the existing behavior as much as possible. In the near future, we will implement an alternate MemoryManager that shares memory between storage and execution more efficiently.

For a high level design doc, see SPARK-10000.

Issue Links

• links to: [Github] Pull Request #9000 (andrewor14)