Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-17838

Strict type checking for arguments with a better messages across APIs.

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.2.0
    • SparkR
    • None

    Description

      It seems there should be more strict type checking for arguments in SparkR APIs. This was discussed in several PRs.

      https://github.com/apache/spark/pull/15239#discussion_r82445435

      Roughly it seems there are three cases as below:

      The first case below was described in https://github.com/apache/spark/pull/15239#discussion_r82445435

      • Check for zero-length variable name

      Some of other cases below were handled in https://github.com/apache/spark/pull/15231#discussion_r80417904

      • Catch the exception from JVM and format it as pretty
      • Check strictly types before calling JVM in SparkR

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            gurwls223 Hyukjin Kwon
            gurwls223 Hyukjin Kwon
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment