Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-14768

Remove expectedType arg for PySpark Param

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.0.0
    • Component/s: ML, PySpark
    • Labels:
      None
    • Target Version/s:

      Description

      We could go ahead and removed the expectedType in 2.0. The only reason to keep it is to avoid breaking 3rd party implementations of PipelineStages in Python which happen to be using the expectedType arg. I doubt there are many such implementations.

      Keeping that argument has led to problems with mixing the expectedType and typeConverter args, as in https://github.com/apache/spark/pull/12480

        Attachments

          Activity

            People

            • Assignee:
              jason412 Jason C Lee
              Reporter:
              josephkb Joseph K. Bradley
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: