Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-41597 Improve PySpark errors
  3. SPARK-42824

Provide a clear error message for unsupported JVM attributes.

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.4.0
    • 3.4.1
    • Connect
    • None

    Description

      There are attributes, such as "_jvm", that were accessible in PySpark but cannot be accessed in Spark Connect. We need to display appropriate error messages for these cases.

      Attachments

        Activity

          People

            itholic Haejoon Lee
            itholic Haejoon Lee
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: