[MAHOUT-1218] Streamimg k-means fails when the number of clusters specified is <= estimated map clusters

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Invalid
• Affects Version/s: 0.8
• Fix Version/s: 0.8
• Component/s: classic
• Assignee: Suneel Marthi
• Reporter: Suneel Marthi
• Created: 16/May/13 18:41
• Updated: 31/Jan/24 22:14
• Resolved: 16/May/13 22:49

Description

Running Streaming k-means with CosineDistanceMeasure, Fast Projection Search, number of clusters k= 60, number of estimated map clsuters -km = 60.

Exception in thread "main" java.lang.IllegalArgumentException: Invalid number of estimated map clusters; There must be more than the final number of clusters (k log n vs k)
	at com.google.common.base.Preconditions.checkArgument(Preconditions.java:92)
	at org.apache.mahout.clustering.streaming.mapreduce.StreamingKMeansDriver.configureOptionsForWorkers(StreamingKMeansDriver.java:327)
	at org.apache.mahout.clustering.streaming.mapreduce.StreamingKMeansDriver.configureOptionsForWorkers(StreamingKMeansDriver.java:280)
	at org.apache.mahout.clustering.streaming.mapreduce.StreamingKMeansDriver.run(StreamingKMeansDriver.java:227)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
	at org.apache.mahout.clustering.streaming.mapreduce.StreamingKMeansDriver.main(StreamingKMeansDriver.java:472)