Details
-
Bug
-
Status: Closed
-
Minor
-
Resolution: Fixed
-
0.5.0
-
None
-
None
Description
Standalone works fine in 0.4.0 but if I use TRUNK, 'Last Changed Date: 2006-06-28 14:27:33 -0700 (Wed, 28 Jun 2006)', and pass it my fat job jar, I get following exception.
06/07/06 13:18:02 INFO conf.Configuration: parsing file:/tmp/hadoop-unjar29923/nutch-site.xml
06/07/06 13:18:02 INFO conf.Configuration: parsing file:/home/stack/workspace/hadoop-local-conf/hadoop-site.xml
Exception in thread "main" java.lang.Error: Unresolved compilation problems:
The import org.apache.commons.cli cannot be resolved
The import org.apache.commons.cli cannot be resolved
The import org.apache.commons.cli cannot be resolved
The import org.apache.commons.cli cannot be resolved
The import org.apache.commons.cli cannot be resolved
The import org.apache.commons.cli cannot be resolved
The import org.apache.commons.cli cannot be resolved
The import org.apache.commons.cli cannot be resolved
The import org.apache.commons.cli cannot be resolved
Options cannot be resolved to a type
Option cannot be resolved to a type
OptionBuilder cannot be resolved
Option cannot be resolved to a type
OptionBuilder cannot be resolved
Option cannot be resolved to a type
OptionBuilder cannot be resolved
Option cannot be resolved to a type
OptionBuilder cannot be resolved
Options cannot be resolved to a type
Options cannot be resolved to a type
CommandLine cannot be resolved to a type
Options cannot be resolved to a type
The method buildGeneralOptions() is undefined for the type ToolBase
CommandLineParser cannot be resolved to a type
GnuParser cannot be resolved to a type
CommandLine cannot be resolved to a type
ParseException cannot be resolved to a type
e cannot be resolved
HelpFormatter cannot be resolved to a type
HelpFormatter cannot be resolved to a type
at org.apache.hadoop.util.ToolBase.<init>(ToolBase.java:21)
at org.apache.hadoop.mapred.JobClient.<init>(JobClient.java:178)
at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:320)
at org.archive.access.nutch.ImportArcs.importArcs(ImportArcs.java:576)
at org.archive.access.nutch.Nutchwax.doImport(Nutchwax.java:159)
at org.archive.access.nutch.Nutchwax.doAll(Nutchwax.java:144)
at org.archive.access.nutch.Nutchwax.doJob(Nutchwax.java:368)
at org.archive.access.nutch.Nutchwax.main(Nutchwax.java:621)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:585)
at org.apache.hadoop.util.RunJar.main(RunJar.java:128)
I took a bit of a look. Odd is that command-cli.jar is in hadoop/lib dir so should be found no problem (and we seem to be loading other stuff out of the uncompressed job jar fine – see mention of nutch-site.xml above). I tried adding the command-cli to my job jar. I printed out all that RunJar – see below – was adding to its CLASSPATH and saw mention of command-cli but still no workee.
file:/tmp/hadoop-unjar29923/lib/archive-commons-1.8.0.jar
file:/tmp/hadoop-unjar29923/lib/commons-codec-1.3.jar
file:/tmp/hadoop-unjar29923/lib/commons-httpclient-3.0-rc3.jar
file:/tmp/hadoop-unjar29923/lib/commons-logging-1.0.4.jar
file:/tmp/hadoop-unjar29923/lib/dsi.unimi.it-1.2.0.jar
file:/tmp/hadoop-unjar29923/lib/commons-lang-2.1.jar
file:/tmp/hadoop-unjar29923/lib/commons-cli-2.0-SNAPSHOT.jar
file:/tmp/hadoop-unjar29923/lib/lucene-core-1.9.1.jar
file:/tmp/hadoop-unjar29923/lib/lucene-misc-1.9.1.jar
file:/tmp/hadoop-unjar29923/lib/jakarta-oro-2.0.7.jar
file:/tmp/hadoop-unjar29923/lib/xerces-2_6_2-apis.jar
file:/tmp/hadoop-unjar29923/lib/xerces-2_6_2.jar
file:/tmp/hadoop-unjar29923/lib/concurrent-1.3.4.jar
06/07/06 13:18:01 INFO conf.Configuration: parsing file:/home/stack/workspace/hadoop-local-conf/hadoop-default.xml
Any ideas?
Thanks.