[HIVE-20183] Inserting from bucketed table can cause data loss, if the source table contains empty buckets

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.0.0-alpha-1
• Component/s: Operators
• Assignee: Peter Vary
• Reporter: Peter Vary
• Created: 16/Jul/18 12:33
• Updated: 17/Nov/22 08:55
• Resolved: 19/Jul/18 09:06

Description

Could be reproduced by the following:

set hive.enforce.bucketing=true;
set hive.enforce.sorting=true;
set hive.optimize.bucketingsorting=true;

create table bucket1 (id int, val string) clustered by (id) sorted by (id ASC) INTO 4 BUCKETS;
insert into bucket1 values (1, 'abc'), (3, 'abc');
select * from bucket1;

+-------------+--------------+
| bucket1.id  | bucket1.val  |
+-------------+--------------+
| 3           | abc          |
| 1           | abc          |
+-------------+--------------+

create table bucket2 like bucket1;

insert overwrite table bucket2 select * from bucket1;
select * from bucket2;

+-------------+--------------+
| bucket2.id  | bucket2.val  |
+-------------+--------------+
| 1           | abc          |
+-------------+--------------+

Issue Links

• causes: HIVE-20217 bucket7.q test results should be sorted