[SQOOP-1334] Sqoop Hcatalog export failed with exception of Failed to load foster storage handler during map reduce

• Type: Bug
• Status: Open
• Priority: Blocker
• Resolution: Unresolved
• Affects Version/s: 1.4.3
• Component/s: hive-integration
• Labels: hcatalog sqoop storage-handler

Environment

CDH4.4.0 with cloudera manager.

• Assignee: Unassigned
• Reporter: Souvik Bose
• Created: 04/Jun/14 13:36
• Updated: 11/Jun/14 15:08

Description

I tried to export a hive external table to mysql using sqoop hcatalog export command.

sqoop export --connect jdbc:mysql://example.com:3306/demo1 --username demo-password demo1234 bd_sqoop1 --hcatalog-table test_data

I have set the HCAT_HOME, HADOOP_CLASSPATH, HIVE_HOME and paths of Jars. Now the job is progressing upto the map reduce stage, but stops at map 0% reduce 0% with an exception as below:

14/06/04 13:27:21 INFO mapred.JobClient: Task Id : attempt_201406021302_0043_m_000002_1, Status : FAILED
java.io.IOException: Error initializing HCat record reader
at org.apache.sqoop.mapreduce.hcat.SqoopHCatRecordReader.initNextRecordReader(SqoopHCatRecordReader.java:146)
at org.apache.sqoop.mapreduce.hcat.SqoopHCatRecordReader.<init>(SqoopHCatRecordReader.java:57)
at org.apache.sqoop.mapreduce.hcat.SqoopHCatExportFormat.createRecordReader(SqoopHCatExportFormat.java:128)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:644)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
at org.apache.hadoop.mapred.Child.main(Child.java:262)
Caused by: java.io.IOException: Failed to load foster storage handler
at org.apache.hcatalog.common.HCatUtil.getStorageHandler(HCatUtil.java:416)
at org.apache.hcatalog.common.HCatUtil.getStorageHandl

Issue Links

• is duplicated by: SQOOP-1335 Sqoop Hcatalog export failed with exception of Failed to load foster storage handler during map reduce