Uploaded image for project: 'Sqoop (Retired)'
  1. Sqoop (Retired)
  2. SQOOP-3215

Sqoop create hive table to support other formats(avro,parquet)

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • 1.4.6
    • None
    • None

    Description

      Hi Team,

      Sqoop doesn't support any other format apart from text format when we make use of "create-hive-table".

      It would be great if sqoop could create avro,parquet etc format table(schema only).

      I tried below command to create avro format table in hive.

      [root@host-10-17-81-13 ~]# sqoop create-hive-table --connect $MYCONN --username $MYUSER --password $MYPSWD --table test_table --hive-table test_table_avro --as-avrodatafile
      Warning: /opt/cloudera/parcels/CDH-5.8.3-1.cdh5.8.3.p0.2/bin/../lib/sqoop/../accumulo does not exist! Accumulo imports will fail.
      Please set $ACCUMULO_HOME to the root of your Accumulo installation.
      17/07/26 21:23:38 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6-cdh5.8.3
      17/07/26 21:23:38 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.
      17/07/26 21:23:38 ERROR tool.BaseSqoopTool: Error parsing arguments for create-hive-table:
      17/07/26 21:23:38 ERROR tool.BaseSqoopTool: Unrecognized argument: --as-avrodatafile

      Please correct me if i missed anything.

      Regards
      Nitish Khanna

      Attachments

        Activity

          People

            sanysandish@gmail.com Sandish Kumar HN
            nitish.khanna@cloudera.com Nitish Khanna
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: