[HIVE-14291] count(*) on a table written by hcatstorer returns incorrect result

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.0.0, 2.1.0
• Fix Version/s: 2.1.1, 2.2.0
• Assignee: Pengcheng Xiong
• Reporter: Pengcheng Xiong
• Created: 19/Jul/16 23:33
• Updated: 08/Dec/16 14:15
• Resolved: 22/Jul/16 18:27

Description

count(*) on a table written by hcatstorer returns wrong result. 

steps to repro the issue:
1) create hive table

create  table ${DEST_TABLE}(name string, age int, gpa float)
                            row format delimited
                            fields terminated by '\t'
                            stored as textfile;

2) load data into table using hcatstorer

A = LOAD '$DATA_1' USING PigStorage() AS (name:chararray, age:int, gpa:float);
B = LOAD '$DATA_2' USING PigStorage() AS (name:chararray, age:int, gpa:float);
C = UNION A, B;
STORE C INTO '$HIVE_TABLE'  USING org.apache.hive.hcatalog.pig.HCatStorer();