[MAHOUT-940] Clusterdumper - Get rid of map based implementation

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: 0.6
• Fix Version/s: 0.8
• Component/s: classic
• Labels: clustering
• Assignee: Paritosh Ranjan
• Reporter: Paritosh Ranjan
• Created: 04/Jan/12 17:13
• Updated: 31/Jan/24 22:14
• Resolved: 22/Jun/12 08:22

Description

Current implementation of ClusterDumper puts clusters and related vectors in map. This generally results in OOM.

Since ClusterOutputProcessor is availabale now. The ClusterDumper will at first process the clusteredPoints, and then write down the clusters to a local file.

The inability to properly read the clustering output due to ClusterDumper facing OOM is seen too often in the mailing list. This improvement will fix that problem.