Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-10750

ML Param validate should print better error information

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • None
    • 1.6.0
    • ML
    • None

    Description

      Currently when you set illegal value for params of array type (such as IntArrayParam, DoubleArrayParam, StringArrayParam), it will throw IllegalArgumentException but with incomprehensible error information.
      For example:

      val vectorSlicer = new VectorSlicer().setInputCol("features").setOutputCol("result")
      vectorSlicer.setIndices(Array.empty).setNames(Array("f1", "f4", "f1"))

      It will throw IllegalArgumentException as:
      vectorSlicer_b3b4d1a10f43 parameter names given invalid value [Ljava.lang.String;@798256c5.
      java.lang.IllegalArgumentException: vectorSlicer_b3b4d1a10f43 parameter names given invalid value [Ljava.lang.String;@798256c5.

      Users can not understand which params were set incorrectly.

      Attachments

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            yanboliang Yanbo Liang
            yanboliang Yanbo Liang
            Joseph K. Bradley Joseph K. Bradley
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment