Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-8742

Improve SparkR error messages for DataFrame API

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Blocker
    • Resolution: Fixed
    • 1.4.1
    • 1.5.0
    • SparkR
    • None

    Description

      Currently all DataFrame API errors result in following generic error:

      Error: returnStatus == 0 is not TRUE
      

      This is because invokeJava in backend.R does not inspect error messages. For most use cases it is critical to return better error messages. Initially, we can return the stack trace from the JVM. In future we can inspect the errors and translate them to human-readable error messages.

      Attachments

        Activity

          People

            falaki Hossein Falaki
            falaki Hossein Falaki
            Shivaram Venkataraman Shivaram Venkataraman
            Votes:
            1 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: