Uploaded image for project: 'Sqoop'
  1. Sqoop
  2. SQOOP-1334

Sqoop Hcatalog export failed with exception of Failed to load foster storage handler during map reduce

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Blocker
    • Resolution: Unresolved
    • Affects Version/s: 1.4.3
    • Fix Version/s: None
    • Component/s: hive-integration
    • Environment:

      CDH4.4.0 with cloudera manager.

      Description

      I tried to export a hive external table to mysql using sqoop hcatalog export command.

      sqoop export --connect jdbc:mysql://example.com:3306/demo1 --username demo-password demo1234 bd_sqoop1 --hcatalog-table test_data

      I have set the HCAT_HOME, HADOOP_CLASSPATH, HIVE_HOME and paths of Jars. Now the job is progressing upto the map reduce stage, but stops at map 0% reduce 0% with an exception as below:

      14/06/04 13:27:21 INFO mapred.JobClient: Task Id : attempt_201406021302_0043_m_000002_1, Status : FAILED
      java.io.IOException: Error initializing HCat record reader
      at org.apache.sqoop.mapreduce.hcat.SqoopHCatRecordReader.initNextRecordReader(SqoopHCatRecordReader.java:146)
      at org.apache.sqoop.mapreduce.hcat.SqoopHCatRecordReader.<init>(SqoopHCatRecordReader.java:57)
      at org.apache.sqoop.mapreduce.hcat.SqoopHCatExportFormat.createRecordReader(SqoopHCatExportFormat.java:128)
      at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:644)
      at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
      at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
      at java.security.AccessController.doPrivileged(Native Method)
      at javax.security.auth.Subject.doAs(Subject.java:396)
      at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
      at org.apache.hadoop.mapred.Child.main(Child.java:262)
      Caused by: java.io.IOException: Failed to load foster storage handler
      at org.apache.hcatalog.common.HCatUtil.getStorageHandler(HCatUtil.java:416)
      at org.apache.hcatalog.common.HCatUtil.getStorageHandl

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                souvik2008 Souvik Bose
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated: