Details
-
Bug
-
Status: Closed
-
Major
-
Resolution: Fixed
-
1.1.0
Description
I created fat-jar and ran PigCSVCleaner following bigpetstore-mapreduce/README.md and bigpetstore-mapreduce/arch.dot, but it failed as follows:
[sekikn@mobile bigpetstore-mapreduce]$ hadoop jar build/libs/BigPetStore-1.1.0-SNAPSHOT-all.jar org.apache.bigtop.bigpetstore.etl.PigCSVCleaner bps/generated bps/cleaned Starting pig etl 2 (snip) Exception in thread "main" java.lang.NoClassDefFoundError: dk/brics/automaton/Automaton at org.apache.pig.impl.util.JarManager$DefaultPigPackages.<clinit>(JarManager.java:108) at org.apache.pig.impl.util.JarManager.createJar(JarManager.java:148) at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.getJob(JobControlCompiler.java:517) at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.compile(JobControlCompiler.java:296) at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:190) at org.apache.pig.PigServer.launchPlan(PigServer.java:1322) at org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1307) at org.apache.pig.PigServer.storeEx(PigServer.java:978) at org.apache.pig.PigServer.store(PigServer.java:942) at org.apache.pig.PigServer.store(PigServer.java:910) at org.apache.bigtop.bigpetstore.etl.PigCSVCleaner.<init>(PigCSVCleaner.java:85) at org.apache.bigtop.bigpetstore.etl.PigCSVCleaner$1.run(PigCSVCleaner.java:146) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) at org.apache.bigtop.bigpetstore.etl.PigCSVCleaner.main(PigCSVCleaner.java:128) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) Caused by: java.lang.ClassNotFoundException: dk.brics.automaton.Automaton at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) ... 20 more [sekikn@mobile bigpetstore-mapreduce]$