Details
-
Sub-task
-
Status: Resolved
-
Minor
-
Resolution: Fixed
-
None
-
None
Description
abec mentioned that a Kite job will fail due to some missing jars on class path for a CSV job. Suggests to add these jars (parquet, avro) to getJars at initialization stage.
java.lang.NoClassDefFoundError: au/com/bytecode/opencsv/CSVWriter at org.kitesdk.data.spi.filesystem.CSVUtil.newWriter(CSVUtil.java:47) at org.kitesdk.data.spi.filesystem.CSVAppender.open(CSVAppender.java:56) at org.kitesdk.data.spi.filesystem.FileSystemWriter.initialize(FileSystemWriter.java:99) at org.kitesdk.data.spi.filesystem.FileSystemView.newWriter(FileSystemView.java:96) at org.kitesdk.data.spi.AbstractDataset.newWriter(AbstractDataset.java:58) at org.apache.sqoop.connector.kite.KiteDatasetExecutor.getOrNewWriter(KiteDatasetExecutor.java:84) at org.apache.sqoop.connector.kite.KiteDatasetExecutor.writeRecord(KiteDatasetExecutor.java:79) at org.apache.sqoop.connector.kite.KiteLoader.load(KiteLoader.java:64) at org.apache.sqoop.connector.kite.KiteLoader.load(KiteLoader.java:33) at org.apache.sqoop.job.mr.SqoopOutputFormatLoadExecutor$ConsumerThread.run(SqoopOutputFormatLoadExecutor.java:249) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: java.lang.ClassNotFoundException: au.com.bytecode.opencsv.CSVWriter at java.net.URLClassLoader$1.run(URLClassLoader.java:366) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:425) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) at java.lang.ClassLoader.loadClass(ClassLoader.java:358) ... 15 more