[HIVE-10685] Alter table concatenate oparetor will cause duplicate data

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 0.14.0, 1.0.0, 1.1.0, 1.2.0, 1.2.1, 1.3.0
• Fix Version/s: 1.2.1
• Assignee: guoliming
• Reporter: guoliming
• Created: 12/May/15 10:21
• Updated: 31/Jul/19 03:18
• Resolved: 15/Jun/15 22:30

Description

"Orders" table has 1500000000 rows and stored as ORC.

hive> select count(*) from orders;
OK
1500000000
Time taken: 37.692 seconds, Fetched: 1 row(s)

The table contain 14 files,the size of each file is about 2.1 ~ 3.2 GB.

After executing command : ALTER TABLE orders CONCATENATE;
The table is already 1530115000 rows.

My hive version is 1.1.0.

Issue Links

• is related to: HIVE-12715 Unit test for HIVE-10685 fix