Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-8577

ScalaReflectionLock.synchronized can cause deadlock

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Not A Problem
    • 1.4.0
    • None
    • SQL
    • None

    Description

      Just a heads up, i was doing some basic coding using DataFrame, Row, StructType, etc. in my own project and i ended up with deadlocks in my sbt tests due to the usage of ScalaReflectionLock.synchronized in the spark sql code.
      the issue went away when i changed my build to have:
      parallelExecution in Test := false
      so that the tests run consecutively...

      Attachments

        Issue Links

          is related to

          Task - A task that needs to be done. SPARK-19810 Remove support for Scala 2.10

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              koert koert kuipers
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: