Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-185

When I run CREATE TABLE new_table LIKE avro_table, the schema does not get mapped properly from an avro schema to a hive schema

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • Impala 0.7
    • Impala 1.4
    • None
    • None

    Description

      I have an Avro-backed table called vcf_flat. I run the following commands from the latest impala-shell:

      CREATE TABLE vcf_flat_whitelisted LIKE vcf_flat;
      ALTER TABLE vcf_flat_whitelisted SET FILEFORMAT SEQUENCEFILE;

      No errors.

      This is the output for `DESCRIBE vcf_flat_whitelisted`:

      Query: describe vcf_flat_whitelisted
      Query finished, fetching results ...

      Returned 0 row(s) in 0.09s

      If I then go to Hive, and run `DESCRIBE vcf_flat_whitelisted;` I get:
      FAILED: SemanticException [Error 10001]: Table not found vcf_flat_whitelisted

      even though `SHOW TABLES;` gives me

      OK
      cosmic
      dbsnp
      sample_07
      sample_08
      vcf_flat
      vcf_flat_text
      vcf_flat_whitelisted
      Time taken: 0.073 seconds

      I get the exact same errors when I do the same series of steps through Hive. I have posted a Jira there too...will reference here shortly.

      Attachments

        1. 1kg.avsc
          7 kB
          Uri Laserson

        Activity

          People

            lskuff Lenni Kuff
            laserson Uri Laserson
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: