Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-14768

Remove expectedType arg for PySpark Param

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • None
    • 2.0.0
    • ML, PySpark
    • None

    Description

      We could go ahead and removed the expectedType in 2.0. The only reason to keep it is to avoid breaking 3rd party implementations of PipelineStages in Python which happen to be using the expectedType arg. I doubt there are many such implementations.

      Keeping that argument has led to problems with mixing the expectedType and typeConverter args, as in https://github.com/apache/spark/pull/12480

      Attachments

        Activity

          People

            jason412 Jason C Lee
            josephkb Joseph K. Bradley
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: