[MAHOUT-197] LDADriver: No job jar file set leads to ClassNotFoundException: org.apache.mahout.clustering.lda.LDAMapper

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 0.2
• Fix Version/s: 0.3
• Component/s: classic

Environment

ubuntu 9.04, sun jdk 1.6.0_07, hadoop cluster running 0.20.1, build from r834311 of http://svn.apache.org/repos/asf/lucene/mahout/trunk

• Assignee: David Leo Wright Hall
• Reporter: Drew Farris
• Created: 10/Nov/09 04:02
• Updated: 31/Jan/24 22:14
• Resolved: 07/Dec/09 06:04

Description

hadoop jar core/target/mahout-core-0.2-SNAPSHOT.joborg.apache.mahout.clustering.lda.LDADriver -i mahout/foo/foo-vectors -o mahout/foo/lda-cluster -w -k 1000 -v 82342 --maxIter 2

[...]
09/11/09 22:02:00 WARN mapred.JobClient: No job jar file set. User
classes may not be found. See JobConf(Class) or
JobConf#setJar(String).
[...]
09/11/09 22:02:00 INFO input.FileInputFormat: Total input paths to process : 1
09/11/09 22:02:01 INFO mapred.JobClient: Running job: job_200911091316_0005
09/11/09 22:02:02 INFO mapred.JobClient: map 0% reduce 0%
09/11/09 22:02:12 INFO mapred.JobClient: Task Id :
attempt_200911091316_0005_m_000000_0, Status : FAILED
java.lang.RuntimeException: java.lang.ClassNotFoundException:
org.apache.mahout.clustering.lda.LDAMapper
at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:808)
at org.apache.hadoop.mapreduce.JobContext.getMapperClass(JobContext.java:157)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:532)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.lang.ClassNotFoundException:
org.apache.mahout.clustering.lda.LDAMapper
at java.net.URLClassLoader$1.run(URLClassLoader.java:200)

Can be fixed by adding the following line to LDADriver after line 299 in r831743:

job.setJarByClass(LDADriver.class);

(will attach trivial patch)