Uploaded image for project: 'SystemDS'
  1. SystemDS
  2. SYSTEMDS-1346

Python MLContext Should Accept New SparkSession

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • SystemML 0.15
    • APIs
    • None

    Description

      Currently, our Python MLContext API only accepts the older SparkContext, typically referred to with the variable name sc. We should extend this API to accept either the older SparkContext, or the newer SparkSession, the latter of which is typically referred to with the variable name spark.

      Attachments

        Issue Links

          is related to

          Sub-task - The sub-task of the issue SYSTEMDS-1798 provide getScriptExecutionString and getScriptString for Python Script object

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. SYSTEMDS-1347 Java Scala MLContext API accept SparkSession

          • Major - Major loss of function.
          • Closed

          Activity

            People

              niketanpansare Niketan Pansare
              dusenberrymw Mike Dusenberry
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: