Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-1733

Pluggable storage support for BlockManager

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Won't Fix
    • None
    • None
    • Spark Core
    • None

    Description

      Since there are Pluggable storage support mentioned in 1.0 meetup. And we are planning to do something on this part. So I create this issue to document some of my initial ideas. Just try to figure out what is the plan on this part, and to find out what should be covered and have a discussion on the approaching

      Attachments

        1. plugable storage idea.pdf
          57 kB
          Raymond Liu

        Issue Links

          relates to

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-2044 Pluggable interface for shuffles

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-2275 More general Storage Interface for Shuffle / Spill etc.

          • Major - Major loss of function.
          • Closed
          There are no Sub-Tasks for this issue.

          Activity

            People

              Unassigned Unassigned
              colorant Raymond Liu
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: