Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-8742

Improve SparkR error messages for DataFrame API

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 1.4.1
    • Fix Version/s: 1.5.0
    • Component/s: SparkR
    • Labels:
      None
    • Target Version/s:

      Description

      Currently all DataFrame API errors result in following generic error:

      Error: returnStatus == 0 is not TRUE
      

      This is because invokeJava in backend.R does not inspect error messages. For most use cases it is critical to return better error messages. Initially, we can return the stack trace from the JVM. In future we can inspect the errors and translate them to human-readable error messages.

        Attachments

          Activity

            People

            • Assignee:
              falaki Hossein Falaki
              Reporter:
              falaki Hossein Falaki
              Shepherd:
              Shivaram Venkataraman

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment