[HIVE-4618] show create table creating unusable DDL when field delimiter is \001

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 0.10.0
• Fix Version/s: 0.12.0
• Component/s: CLI

Environment

CDH4.2
Hive 0.10

• Assignee: Navis Ryu
• Reporter: Johndee Burks
• Created: 27/May/13 14:43
• Updated: 15/Oct/13 23:29
• Resolved: 30/Jun/13 17:44

Description

When including a "fields terminated by" in the create statement. If the delimiter is preceded by a \001, hive turns this into \u0001 which is correct. However it then gives you a ddl that does not work because the parser changes the \u0001 into u0001.

Example:

hive> create table j1 (a string) row format delimited fields terminated by '\001';

hive> show create table j1;
CREATE TABLE j1(
a string)
ROW FORMAT DELIMITED
FIELDS TERMINATED BY '\u0001'
STORED AS INPUTFORMAT
'org.apache.hadoop.mapred.TextInputFormat'
OUTPUTFORMAT
'org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat'
LOCATION
'hdfs://forza-1.cloud.rtp.cloudera.com:8020/user/hive/warehouse/j1'
TBLPROPERTIES (
'transient_lastDdlTime'='1369664999')

hive> desc formatted j1;
…shortened to save space
Storage Desc Params:
field.delim \u0001
serialization.format \u0001

hive> drop table j1;

hive> CREATE TABLE j1(
> a string)
> ROW FORMAT DELIMITED
> FIELDS TERMINATED BY '\u0001'
> STORED AS INPUTFORMAT
> 'org.apache.hadoop.mapred.TextInputFormat'
> OUTPUTFORMAT
> 'org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat'
> LOCATION
> 'hdfs://forza-1.cloud.rtp.cloudera.com:8020/user/hive/warehouse/j1'
> TBLPROPERTIES (
> 'transient_lastDdlTime'='1369664999');

hive> desc formatted j1;
…shortened to save space
Storage Desc Params:
field.delim u0001
serialization.format u0001