[SPARK-14924] Tuning estimatorParamMaps with OneVsRest.classifier fails during persistence

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Incomplete
• Component/s: ML, PySpark
• Labels: bulk-closed
• Assignee: Unassigned
• Reporter: Xusen Yin
• Created: 26/Apr/16 18:14
• Updated: 21/May/19 04:36
• Resolved: 21/May/19 04:36

Description

ovr = OneVsRest()
epms = [{ovr.classifier: xxxx}, {ovr.classifier: xxx}]
cv = CrossValidator(estimator=ovr, estimatorParamMaps=epms, ...)
cv.load()

fails because classifier cannot be serialized via JSON.

Issue Links

• is related to: SPARK-14706 Python ML persistence integration test