[CARBONDATA-4031] Query result is incorrect after Delete and Insert overwrite

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 2.0.0
• Fix Version/s: 2.1.1
• Component/s: data-query
• Assignee: Unassigned
• Reporter: Kejian Li
• Created: 13/Oct/20 06:27
• Updated: 15/Dec/20 13:39
• Resolved: 15/Dec/20 13:39

Description

There is a table with two partitions. User deletes some records on one of partitions and then inserts overwrite the other partition. Deleted records on the previous partition comes back.

1.  CREATE TABLE s_x034_carbon (guid STRING, sales_guid STRING) PARTITIONED BY (dt STRING) STORED AS carbondata;

2. load data local inpath '/home/lizi/Workspace/carbondata_test_workspace/data/s_x034_carbon-07.csv' into table s_x034_carbon;
load data local inpath '/home/lizi/Workspace/carbondata_test_workspace/data/s_x034_carbon-08.csv' into table s_x034_carbon;

3. select count(1), dt from s_x034_carbon group by dt;

4. select * from s_x034_carbon where dt=20200907 limit 5;

5. delete from s_x034_carbon where dt= 20200907 and guid='595E1862D81A09D0E1008000AC1E0124';

delete from s_x034_carbon where dt= 20200907 and guid='005056AF06441EDA89ABF853E435A6BD';

6. select count(1), dt from s_x034_carbon group by dt;

7. insert overwrite table s_x034_carbon partition (dt=20200908)
select a.guid as guid, a.sales_guid as sales_guid from s_x034_carbon a
where dt = 20200907;

8. select count(1), dt from s_x034_carbon group by dt;