[SQOOP-2238] Sqoop2: Parquet jars missing

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.99.6
• Component/s: sqoop2-kite-connector
• Assignee: Abraham Elmahrek
• Reporter: Abraham Elmahrek
• Created: 19/Mar/15 18:27
• Updated: 29/Mar/15 20:48
• Resolved: 29/Mar/15 20:21

Description

2015-03-25 23:49:10,831 WARN [main] org.apache.hadoop.mapred.YarnChild: Exception running child : org.apache.sqoop.common.SqoopException: MAPRED_EXEC_0018:Error occurs during loader run
	at org.apache.sqoop.job.mr.SqoopOutputFormatLoadExecutor$ConsumerThread.run(SqoopOutputFormatLoadExecutor.java:261)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
	at java.util.concurrent.FutureTask.run(FutureTask.java:166)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:724)
Caused by: java.lang.NoClassDefFoundError: parquet/hadoop/metadata/CompressionCodecName
	at org.kitesdk.data.spi.filesystem.ParquetAppender.open(ParquetAppender.java:62)
	at org.kitesdk.data.spi.filesystem.FileSystemWriter.initialize(FileSystemWriter.java:135)
	at org.kitesdk.data.spi.filesystem.FileSystemView.newWriter(FileSystemView.java:101)
	at org.kitesdk.data.spi.AbstractDataset.newWriter(AbstractDataset.java:58)
	at org.apache.sqoop.connector.kite.KiteDatasetExecutor.getOrNewWriter(KiteDatasetExecutor.java:91)
	at org.apache.sqoop.connector.kite.KiteDatasetExecutor.writeRecord(KiteDatasetExecutor.java:86)
	at org.apache.sqoop.connector.kite.KiteLoader.load(KiteLoader.java:72)
	at org.apache.sqoop.connector.kite.KiteLoader.load(KiteLoader.java:36)
	at org.apache.sqoop.job.mr.SqoopOutputFormatLoadExecutor$ConsumerThread.run(SqoopOutputFormatLoadExecutor.java:250)
	... 6 more
Caused by: java.lang.ClassNotFoundException: parquet.hadoop.metadata.CompressionCodecName
	at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
	at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
	at java.security.AccessController.doPrivileged(Native Method)
	at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
	... 15 more

Issue Links

• is depended upon by: SQOOP-2269 Sqoop2: Parquet integration tests
• links to: RB