[SPARK-18408] API Improvements for LSH

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.1.0
• Component/s: ML
• Assignee: Yun Ni
• Reporter: Yun Ni
• Created: 10/Nov/16 22:57
• Updated: 08/Dec/16 07:27
• Resolved: 28/Nov/16 23:15

Description

As the first improvements to current LSH Implementations, we are planning to do the followings:

• Change output schema to Array of Vector instead of Vectors
• Use numHashTables as the dimension of Array and numHashFunctions as the dimension of Vector
• Rename RandomProjection to BucketedRandomProjectionLSH, MinHash to MinHashLSH
• Make randUnitVectors/randCoefficients private
• Make Multi-Probe NN Search and hashDistance private for future discussion

Issue Links

• Is contained by: SPARK-18392 LSH API, algorithm, and documentation follow-ups
• links to: [Github] Pull Request #15874 (Yunni)