Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-10000 Consolidate storage and execution memory management
  3. SPARK-10956

Introduce common memory management interface for execution and storage

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.6.0
    • Spark Core
    • None

    Description

      The first step towards implementing a solution for SPARK-10000 is to refactor the existing code to go through a common MemoryManager interface. This issue is concerned only with the introduction of this interface, preserving the existing behavior as much as possible. In the near future, we will implement an alternate MemoryManager that shares memory between storage and execution more efficiently.

      For a high level design doc, see SPARK-10000.

      Attachments

        Activity

          People

            andrewor14 Andrew Or
            andrewor14 Andrew Or
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: