Uploaded image for project: 'Sqoop (Retired)'
  1. Sqoop (Retired)
  2. SQOOP-2260

Kite dataset URI is unknown

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.4.5
    • 1.4.6
    • None
    • None

    Description

      Upon doing the following import:

      sqoop import-all-tables -m 12 --connect jdbc:mysql://`hostname`:3306/retail_db --username=... --password=... --compression-codec=snappy --as-parquetfile --warehouse-dir=/user/hive/warehouse --hive-import
      

      I get the following error:

      ERROR sqoop.Sqoop: Got exception running Sqoop: org.kitesdk.data.DatasetNotFoundException: Unknown dataset URI: hive?dataset=null
      org.kitesdk.data.DatasetNotFoundException: Unknown dataset URI: hive?dataset=null
              at org.kitesdk.data.spi.Registration.lookupDatasetUri(Registration.java:109)
              at org.kitesdk.data.Datasets.create(Datasets.java:189)
              at org.kitesdk.data.Datasets.create(Datasets.java:240)
              at org.apache.sqoop.mapreduce.ParquetJob.createDataset(ParquetJob.java:81)
              at org.apache.sqoop.mapreduce.ParquetJob.configureImportJob(ParquetJob.java:70)
              at org.apache.sqoop.mapreduce.DataDrivenImportJob.configureMapper(DataDrivenImportJob.java:112)
              at org.apache.sqoop.mapreduce.ImportJobBase.runImport(ImportJobBase.java:262)
              at org.apache.sqoop.manager.SqlManager.importTable(SqlManager.java:665)
              at org.apache.sqoop.manager.MySQLManager.importTable(MySQLManager.java:102)
              at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:497)
              at org.apache.sqoop.tool.ImportAllTablesTool.run(ImportAllTablesTool.java:105)
              at org.apache.sqoop.Sqoop.run(Sqoop.java:143)
              at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
              at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:179)
              at org.apache.sqoop.Sqoop.runTool(Sqoop.java:218)
              at org.apache.sqoop.Sqoop.runTool(Sqoop.java:227)
              at org.apache.sqoop.Sqoop.main(Sqoop.java:236)
      

      This only occurs when attempting hive-import. I can import parquet files and avro files just fine - but when I try a hive-import with either it fails.

      Attachments

        Issue Links

          Activity

            People

              stanleyxu2005 Qian Xu
              mackrorysd Sean Mackrory
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: