[SPARK-12424] The implementation of ParamMap#filter is wrong.

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.6.0, 2.0.0
• Fix Version/s: 1.6.1, 2.0.0
• Component/s: ML
• Assignee: Kousuke Saruta
• Reporter: Kousuke Saruta
• Created: 18/Dec/15 15:40
• Updated: 28/Dec/15 20:35
• Resolved: 28/Dec/15 20:35

Description

ParamMap#filter uses `mutable.Map#filterKeys`. The return type of `filterKey` is collection.Map, not mutable.Map but the result is casted to mutable.Map using `asInstanceOf` so we get `ClassCastException`.
Also, the return type of Map#filterKeys is not Serializable. It's the issue of Scala (https://issues.scala-lang.org/browse/SI-6654).

Issue Links

• links to: [Github] Pull Request #10381 (sarutak)