[HIVE-1762] Multi-character delimiter strings do not work correctly

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Not A Bug
• Affects Version/s: 0.5.0
• Fix Version/s: 0.14.0
• Component/s: Serializers/Deserializers
• Assignee: Kirby Linvill
• Reporter: Todd Lipcon
• Created: 02/Nov/10 05:23
• Updated: 18/Mar/16 04:09
• Resolved: 18/Mar/16 04:09

Description

I was trying to give a demo using the movielens data set, which uses '::' as a delimiter (multiple characters). Using "FIELDS TERMINATED BY '::'" did not give an error, but it seems to just split on ':' rather than '::'.

hive> create table ml_ratings (userid int, movieid int, rating int, unixtime string) row format delimited  fields terminated by '::' stored as textfile;
...
hive> select * from ml_ratings limit 5;                                         OK                                                    
1       NULL    122
1       NULL    185

Issue Links

• is superceded by: HIVE-5871 Use multiple-characters as field delimiter