[SPARK-14772] Python ML Params.copy treats uid, paramMaps differently than Scala

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.1.0
• Fix Version/s: 2.1.1, 2.2.0
• Component/s: ML, PySpark
• Target Version/s: 2.1.1, 2.2.0
• Assignee: Bryan Cutler
• Reporter: Joseph K. Bradley
• Shepherd: Joseph K. Bradley
• Created: 20/Apr/16 22:30
• Updated: 16/May/17 10:08
• Resolved: 26/Feb/17 04:03

Description

In PySpark, ml.param.Params.copy does not quite match the Scala implementation:

• It does not copy the UID
• It does not respect the difference between defaultParamMap and paramMap. This is an issue with _copyValues.

Issue Links

• Is contained by: SPARK-14771 Python ML Param and UID issues
• relates to: SPARK-20506 ML, Graph 2.2 QA: Programming guide update and migration guide
• links to: [Github] Pull Request #12888 (hujy)
• links to: [Github] Pull Request #16772 (BryanCutler)
• links to: [Github] Pull Request #17048 (BryanCutler)