[MAHOUT-614] org.apache.mahout.classifier.baytes.MultipleOutputFormat not working as intended with Hadoop 0.20?

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.4
• Fix Version/s: 0.5
• Labels: hadoop multiple output
• Assignee: Robin Anil
• Reporter: Sean R. Owen
• Due: 04/Mar/11
• Created: 21/Feb/11 11:00
• Updated: 31/Jan/24 22:12
• Resolved: 22/Feb/11 21:17

Description

I believe there might be an error in org.apache.mahout.classifier.baytes.MultipleOutputFormat. It overrides the Hadoop class FileOutputFormat, and most of its work is done in getRecordWriter(FileSystem, Configuration, String, Progressable). However this is not the method that one must override to control how FileOutputFormat writes records; that's getRecordWriter(TaskAttemptContext). My hunch is that this used to work, but against the Hadoop 0.19.x APIs. (@Override is our friend!)

I've attached a patch that I believe addresses this and along the way is able to clean things up slightly. Am I on track here?