[MAHOUT-929] Refactor Clustering (Vector Classification) into a Separate Postprocess with Outlier Pruning

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.6
• Fix Version/s: 0.7
• Component/s: classic
• Assignee: Paritosh Ranjan
• Reporter: Jeff Eastman
• Created: 16/Dec/11 19:41
• Updated: 31/Jan/24 22:14
• Resolved: 09/May/12 22:07

Description

The current clustering drivers have a -cp option to produce clusteredPoints directory containing the input vectors classified by the final clusters produced by the algorithm. These options are redundantly implemented in those drivers.

• Factor out & implement an independent post processor to perform the classification step independently of the various clustering implementations.

• Implement a pluggable outlier removal capability for this classifier.

• Consider building off of the ClusterClassifier & ClusterIterator ideas.

Issue Links

• incorporates: MAHOUT-930 Refactor Vector Classifaction out of Clustering - Make Classification abstract
• incorporates: MAHOUT-931 Implement a pluggable outlier removal capability for cluster classifiers
• incorporates: MAHOUT-933 Implement mapreduce version of ClusterIterator

Sub-Tasks

• Refactor KMeans Clustering into a separate post process with outlier pruning: Closed
• Refactor Canopy Clustering into a separate post process with outlier pruning: Closed
• Refactor Dirichlet Clustering into a separate post process with outlier pruning: Closed
• Refactor Fuzzy K Means Clustering into a separate post process with outlier pruning: Closed