Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-4875

Separate Transformer, Estimator params

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Minor
    • Resolution: Duplicate
    • Affects Version/s: 1.2.0
    • Fix Version/s: None
    • Component/s: ML
    • Labels:
      None
    • Target Version/s:

      Description

      Currently, in spark.ml, an Estimator and its Model (Transformer) both use the same set of parameters. (E.g., LogisticRegression) The problem is that some Estimator parameters are not relevant for Transformers, so it is non-sensical to include them in the Transformers.

      Proposal: When a parameter is only relevant to the Estimator, only include it in the Estimator. In these cases, if there is a separate parameter trait (e.g., LogisticRegressionParams), that trait should be separated into a model params trait and an estimator params trait which inherits from the model params:

      trait LogisticRegressionModelParams
      trait LogisticRegressionParams extends LogisticRegressionModelParams
      

      In cases where the 2 classes use the same set of parameters, then they may share the same params trait.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                josephkb Joseph K. Bradley
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: