[SPARK-7653] ML Pipeline and meta-algs should take random seed param

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Incomplete
• Component/s: ML
• Labels: bulk-closed
• Assignee: Unassigned
• Reporter: Joseph K. Bradley
• Created: 15/May/15 00:53
• Updated: 21/May/19 04:32
• Resolved: 21/May/19 04:32

Description

ML Pipelines and other meta-algorithms should implement HasSeed. If the seed is set, then the meta-alg will use that seed to generate new seeds to pass to every component PipelineStage.

• Note: This may require a little discussion about whether HasSeed should be a public API.

This will make it easier for users to have reproducible results for entire pipelines (rather than setting the seed for each stage manually).

Sub-Tasks

• Add random seed Param to PySpark CrossValidator: Resolved
• Add random seed Param to Scala CrossValidator: Resolved
• Add random seed Param to ML Pipeline: Resolved
• Add random seed Param to PySpark ML Pipeline: Resolved