Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-972

PySpark's "cannot run multiple SparkContexts at once" message should give source locations

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • None
    • 1.0.0
    • PySpark
    • None

    Description

      It can be difficult to debug PySpark's "Cannot run multiple SparkContexts at once" error message if you're not sure where the first context is being created; it would be helpful if the SparkContext class remembered the linenumber/location where the active context was created and printed it in the error message.

      Attachments

        Issue Links

          Activity

            People

              jyotiska Jyotiska NK
              joshrosen Josh Rosen
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: