Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-185

When I run CREATE TABLE new_table LIKE avro_table, the schema does not get mapped properly from an avro schema to a hive schema

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: Impala 0.7
    • Fix Version/s: Impala 1.4
    • Component/s: None
    • Labels:
      None

      Description

      I have an Avro-backed table called vcf_flat. I run the following commands from the latest impala-shell:

      CREATE TABLE vcf_flat_whitelisted LIKE vcf_flat;
      ALTER TABLE vcf_flat_whitelisted SET FILEFORMAT SEQUENCEFILE;

      No errors.

      This is the output for `DESCRIBE vcf_flat_whitelisted`:

      Query: describe vcf_flat_whitelisted
      Query finished, fetching results ...

      Returned 0 row(s) in 0.09s

      If I then go to Hive, and run `DESCRIBE vcf_flat_whitelisted;` I get:
      FAILED: SemanticException [Error 10001]: Table not found vcf_flat_whitelisted

      even though `SHOW TABLES;` gives me

      OK
      cosmic
      dbsnp
      sample_07
      sample_08
      vcf_flat
      vcf_flat_text
      vcf_flat_whitelisted
      Time taken: 0.073 seconds

      I get the exact same errors when I do the same series of steps through Hive. I have posted a Jira there too...will reference here shortly.

        Attachments

        1. 1kg.avsc
          7 kB
          Uri Laserson

          Activity

            People

            • Assignee:
              lskuff Lenni Kuff
              Reporter:
              laserson Uri Laserson
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: