[MAHOUT-588] Benchmark Mahout's clustering performance on EC2 and publish the results

• Type: Task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.5
• Fix Version/s: 0.5
• Assignee: Grant Ingersoll
• Reporter: Grant Ingersoll
• Created: 22/Jan/11 12:32
• Updated: 05/Jan/12 23:45
• Resolved: 22/May/11 16:02

Description

For Taming Text, I've commissioned some benchmarking work on Mahout's clustering algorithms. I've asked the two doing the project to do all the work in the open here. The goal is to use a publicly reusable dataset (for now, the ASF mail archives, assuming it is big enough) and run on EC2 and make all resources available so others can reproduce/improve.

I'd like to add the setup code to utils (although it could possibly be done as a Vectorizer) and the publication of the results will be put up on the Wiki as well as in the book. This issue is to track the patches, etc.

Issue Links

• is blocked by: MAHOUT-598 Downstream steps in the seq2sparse job flow looking in wrong location for output from previous steps when running in Elastic MapReduce (EMR) cluster
• is related to: MAHOUT-500 Make it easy to run Mahout on Amazon's Elastic Map Reduce
• is related to: MAHOUT-670 Provide a performance measurement framework for Mahout