[HIVE-10324] Hive metatool should take table_param_key to allow for changes to avro serde's schema url key

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.1.0
• Fix Version/s: 1.2.0
• Component/s: Metastore
• Assignee: Ferdinand Xu
• Reporter: Szehon Ho
• Created: 13/Apr/15 22:18
• Updated: 18/May/15 19:56
• Resolved: 17/Apr/15 18:43

Description

HIVE-3443 added support to change the serdeParams from 'metatool updateLocation' command.

However, in avro it is possible to specify the schema via the tableParams:

CREATE  TABLE `testavro`(
  `test` string COMMENT 'from deserializer')
ROW FORMAT SERDE 
  'org.apache.hadoop.hive.serde2.avro.AvroSerDe' 
STORED AS INPUTFORMAT 
  'org.apache.hadoop.hive.ql.io.avro.AvroContainerInputFormat' 
OUTPUTFORMAT 
  'org.apache.hadoop.hive.ql.io.avro.AvroContainerOutputFormat'
TBLPROPERTIES (
  'avro.schema.url'='hdfs://namenode:8020/tmp/test.avsc', 
  'kite.compression.type'='snappy', 
  'transient_lastDdlTime'='1427996456')

Hence for those tables the 'metatool updateLocation' will not help.

This is necessary in case like upgrade the namenode to HA where the absolute paths have changed.

Issue Links

• relates to: HIVE-3443 Hive Metatool should take serde_param_key from the user to allow for changes to avro serde's schema url key