Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-20861

Pyspark CrossValidator & TrainValidationSplit should delegate parameter looping to estimators

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 2.1.1
    • Fix Version/s: 2.2.0, 2.3.0
    • Component/s: ML, PySpark
    • Labels:
      None

      Description

      The CrossValidator & TrainValidationSplit should call estimator.fit with all their parameter maps instead of passing params one by one to fit. This behaviour would make Python spark more consistent with Scala spark and allow individual to parallelize or optimize for fitting over multiple parameter maps.

        Attachments

          Activity

            People

            • Assignee:
              bago.amirbekian Bago Amirbekian
              Reporter:
              bago.amirbekian Bago Amirbekian
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: