[HIVE-9056] Describe Avro Table Partition Fails

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Cannot Reproduce
• Affects Version/s: 0.12.0, 0.13.0
• Component/s: CLI

Environment

CDH5.2

• Assignee: Chaoyu Tang
• Reporter: Johndee Burks
• Created: 09/Dec/14 21:37
• Updated: 11/Dec/14 19:43
• Resolved: 11/Dec/14 19:43

Description

If you describe a partition of a table that is avro then you get the schema error.

DROP TABLE IF EXISTS episodes_partitioned;
CREATE TABLE episodes_partitioned
PARTITIONED BY (doctor_pt INT)
ROW FORMAT
SERDE 'org.apache.hadoop.hive.serde2.avro.AvroSerDe'
STORED AS
INPUTFORMAT 'org.apache.hadoop.hive.ql.io.avro.AvroContainerInputFormat'
OUTPUTFORMAT 'org.apache.hadoop.hive.ql.io.avro.AvroContainerOutputFormat'
TBLPROPERTIES ('avro.schema.literal'='{
  "namespace": "testing.hive.avro.serde",
  "name": "episodes",
  "type": "record",
  "fields": [
    {
      "name":"title",
      "type":"string",
      "doc":"episode title"
    },
    {
      "name":"air_date",
      "type":"string",
      "doc":"initial date"
    },
    {
      "name":"doctor",
      "type":"int",
      "doc":"main actor playing the Doctor in episode"
    }
  ]
}');

ALTER TABLE episodes_partitioned ADD PARTITION (doctor_pt=4);
DESC episodes_partitioned  PARTITION (doctor_pt=4);

You will get the error:

error_error_error_error_error_error_error	string              	from deserializer
cannot_determine_schema	string              	from deserializer
check               	string              	from deserializer
schema              	string              	from deserializer
url                 	string              	from deserializer
and                 	string              	from deserializer
literal             	string              	from deserializer
doctor_pt           	int

Issue Links

• relates to: HIVE-5302 PartitionPruner logs warning on Avro non-partitioned data
• relates to: HIVE-5456 Queries fail on avro backed table with empty partition