Uploaded image for project: 'SystemML'
  1. SystemML
  2. SYSTEMML-1896

Update python tests to use getOrCreate

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: SystemML 1.0.0
    • Component/s: Test
    • Labels:
      None
    • Environment:
      RedHat Linux 7.3 with Spark 2.1.0 and Hadoop 2.7.3.
    • Sprint:
      Sprint 6

      Description

      Use SparkContext.getOrCreate or SparkSession.builder.getOrCreate in python tests to avoid "Cannot run multiple SparkContexts at once" error observed in some environments running scripts under src/main/python/tests with spark-submit.

        Attachments

          Activity

            People

            • Assignee:
              gweidner Glenn Weidner
              Reporter:
              gweidner Glenn Weidner
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: