[SPARK-23217] Add cosine distance measure to ClusteringEvaluator

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.3.0
• Fix Version/s: 2.4.0
• Component/s: ML
• Assignee: Marco Gaido
• Reporter: Marco Gaido
• Created: 25/Jan/18 17:30
• Updated: 16/Feb/18 12:28
• Resolved: 13/Feb/18 20:51

Description

SPARK-22119 introduced the cosine distance measure for KMeans. Therefore it would be useful to provide also an implementation of ClusteringEvaluator using the cosine distance measure.

 

Attached you can find a design document for it.

Issue Links

• relates to: SPARK-14516 Clustering evaluator
• relates to: SPARK-22119 Add cosine distance to KMeans
• links to: [Github] Pull Request #20396 (mgaido91)
• links to: [Github] Pull Request #20627 (mgaido91)