[HIVE-15475] JsonSerDe cannot handle json file with empty lines

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.2.1
• Component/s: HCatalog
• Assignee: Unassigned
• Reporter: pin_zhang
• Created: 20/Dec/16 15:04
• Updated: 01/Mar/19 19:08
• Resolved: 24/Feb/19 15:44

Description

1. start HiveServer2 in apache-hive-1.2.1
2 start a beeline connect to hive server2
ADD JAR ADD JAR /home/apache-hive-1.2.1-bin/hcatalog/share/hcatalog/hive-hcatalog-core-1.2.1.jar ;

CREATE external TABLE my_table(a string, b bigint)
ROW FORMAT SERDE 'org.apache.hive.hcatalog.data.JsonSerDe'
STORED AS TEXTFILE
location 'file:///home/hive/json';

3 put a file with more than one new lines at the end of the file

{"a":"a_1", "b" : 1}

4 run sql
select * from my_table ;
------------------------

my_table.a

my_table.b

------------------------

a_1	1
a_1	1
a_1	1
a_1	1
a_1	1

------------------------

Issue Links

• is related to: HIVE-18785 Make JSON SerDe First-Class SerDe
• is superceded by: HIVE-18545 Add UDF to parse complex types from json
• relates to: HIVE-21370 JsonSerDe cannot handle json file with empty lines - Branch 3