[HIVE-20721] Describe table sometimes shows "from deserializer" for column comments

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.1.0
• Component/s: Serializers/Deserializers
• Assignee: Unassigned
• Reporter: Pedro
• Created: 10/Oct/18 11:41
• Updated: 11/Oct/18 07:26

Description

When we want to see the comments made in the hive tables, it only shows "from deserializer"

 

For example:

> desc table_name
  

col_name	data_type	comment
some_column1	bigint	from deserializer
some_column2	string	from deserializer
some_column3	string	from deserializer
...	...	...

 

It happens with show create table too

> show create table table_name

CREATE EXTERNAL TABLE `table_name`(
`some_column1` bigint COMMENT 'from deserializer',
`some_column2` string COMMENT 'from deserializer',
`some_column3` string COMMENT 'from deserializer',

[...]

PARTITIONED BY (
`dt` string)
ROW FORMAT SERDE
'org.apache.hive.hcatalog.data.JsonSerDe'
STORED AS INPUTFORMAT
'org.apache.hadoop.mapred.TextInputFormat'
OUTPUTFORMAT
'org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat'
LOCATION
'hdfs://location/table_name'
TBLPROPERTIES (
'json.schema.url'='/location/json/table_name.json',
'transient_lastDdlTime'='1525858710')

 

If I use desc extended table_name, in "Detailed Table Information" I see the json with the correct comments, but the comments in the rows with the table columns name only show "from deserializer", as it does with desc table_name.

 

I saw it was resolved in HIVE-6681 but the fixed version was 0.13.0. I'm on 1.1.0 and apparently I have the same issue.