[MAHOUT-641] DistributedRowMatrix hadoop jobs ignore Configuration set via setConf()

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.4, 0.5
• Fix Version/s: 0.5
• Component/s: classic
• Labels: configuration hadoop

Environment

Mahout 0.4 and 0.5-SNAPSHOT run with Hadoop 0.20.2 on Mac OS 10.6 and Linux x86_64 2.6.18

• Assignee: Unassigned
• Reporter: Jonathan Traupman
• Created: 29/Mar/11 18:36
• Updated: 31/Jan/24 22:16
• Resolved: 31/Mar/11 10:39

Description

I am using the Distributed Lanczos solver which uses the DistributedRowMatrix class for it's internal calculation. In our environment, I need to set some Configuration properties (specifically hadoop.job.ugi & hadoop.queue.name), which are when set via the setConf() method on DistributedLanczosSolver. These are correctly passed to DistributedRowMatrix via its setConf() method, but are not passed into the Hadoop JobConfs created by the various static routines in MatrixMultiplicationJob, TimesSquaredJob, and TransposeJob.