[SPARK-26315] auto cast threshold from Integer to Float in approxSimilarityJoin of BucketedRandomProjectionLSHModel

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 2.3.2
• Fix Version/s: 2.3.3, 2.4.1, 3.0.0
• Component/s: MLlib, PySpark
• Assignee: Song Ci
• Reporter: Song Ci
• Created: 10/Dec/18 06:02
• Updated: 17/Dec/18 07:33
• Resolved: 15/Dec/18 14:43

Description

when I was using 

// code placeholder
BucketedRandomProjectionLSHModel.approxSimilarityJoin(dt_features, dt_features, distCol="EuclideanDistance", threshold=20.)

I was confused then that this method reported an exception some java method (dataset, dataset, integer, string) fingerprint can not be found.... I think if I give an integer, and the python method of pyspark should be auto-cast this to float if needed. 

Issue Links

• links to: GitHub Pull Request #23313