Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-6056

The AvroSerDe gives out BadSchemaException if a partition is added to the table

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Patch Available
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 0.11.0
    • Fix Version/s: None
    • Component/s: Database/Schema
    • Labels:
      None
    • Environment:

      amazon EMR (hadoop Amazon 1.0.3), avro-1.7.5

    • Tags:
      avro, hive

      Description

      While creating an external table if I do not add a partition, I am able to read files using following format:

      CREATE external TABLE event
      ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.avro.AvroSerDe'
      STORED AS INPUTFORMAT 'org.apache.hadoop.hive.ql.io.avro.AvroContainerInputFormat'
      OUTPUTFORMAT 'org.apache.hadoop.hive.ql.io.avro.AvroContainerOutputFormat'
      LOCATION 's3n://test-event/input/2013/14/10'
      TBLPROPERTIES ('avro.schema.literal' = '..some schema..');
      

      but if I add a partition based on date

      CREATE external TABLE event
      PARTITIONED BY (ds STRING)
      ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.avro.AvroSerDe'
      STORED AS INPUTFORMAT 'org.apache.hadoop.hive.ql.io.avro.AvroContainerInputFormat'
      OUTPUTFORMAT 'org.apache.hadoop.hive.ql.io.avro.AvroContainerOutputFormat'
      LOCATION 's3n://test-event/input/'
      TBLPROPERTIES ('avro.schema.literal' = '..some schema..');
      
      ALTER TABLE event ADD IF NOT EXISTS PARTITION (ds = '2013_12_16') LOCATION '2013/12/16/';
      

      I get the following exception:

      java.io.IOException:org.apache.hadoop.hive.serde2.avro.BadSchemaException
      

        Attachments

        1. HIVE-6056.patch
          14 kB
          Ashish Singh

          Issue Links

            Activity

              People

              • Assignee:
                singhashish Ashish Singh
                Reporter:
                rushilgupta Rushil Gupta
              • Votes:
                2 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated: