Uploaded image for project: 'SystemDS'
  1. SystemDS
  2. SYSTEMDS-1896

Update python tests to use getOrCreate

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • SystemML 1.0.0
    • Test
    • None
    • RedHat Linux 7.3 with Spark 2.1.0 and Hadoop 2.7.3.
    • Sprint 6

    Description

      Use SparkContext.getOrCreate or SparkSession.builder.getOrCreate in python tests to avoid "Cannot run multiple SparkContexts at once" error observed in some environments running scripts under src/main/python/tests with spark-submit.

      Attachments

        Activity

          People

            gweidner Glenn Weidner
            gweidner Glenn Weidner
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: