Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-3471

Automatic resource manager for SparkContext in Scala?

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Minor
    • Resolution: Not A Problem
    • 1.0.2
    • None
    • Spark Core
    • None

    Description

      After discussion in SPARK-2972, it seems like a good idea to add "automatic resource management" semantics to SparkContext (i.e. "with" in Python (SPARK-3458), Closeable/AutoCloseable in Java (SPARK-3470)).

      I have no knowledge of Scala whatsoever, but a quick search seems to indicate that there isn't a standard mechanism for this - someone with real Scala knowledge should take a look and make a decision...

      Attachments

        Issue Links

          relates to

          New Feature - A new feature of the product, which has yet to be developed. SPARK-3458 enable use of python's "with" statements for SparkContext management

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. SPARK-3470 Have JavaSparkContext implement Closeable/AutoCloseable

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              roji Shay Rojansky
              Votes:
              1 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: