Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-10000 Consolidate storage and execution memory management
  3. SPARK-10956

Introduce common memory management interface for execution and storage

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.6.0
    • Component/s: Spark Core
    • Labels:
      None
    • Target Version/s:

      Description

      The first step towards implementing a solution for SPARK-10000 is to refactor the existing code to go through a common MemoryManager interface. This issue is concerned only with the introduction of this interface, preserving the existing behavior as much as possible. In the near future, we will implement an alternate MemoryManager that shares memory between storage and execution more efficiently.

      For a high level design doc, see SPARK-10000.

        Attachments

          Activity

            People

            • Assignee:
              andrewor14 Andrew Or
              Reporter:
              andrewor14 Andrew Or
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: