[HIVE-28366] Iceberg: Concurrent Insert and IOW produce incorrect result

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.0.0
• Fix Version/s: 4.1.0
• Component/s: Iceberg integration
• Labels: pull-request-available
• Assignee: Denys Kuzmenko
• Reporter: Denys Kuzmenko
• Created: 10/Jul/24 16:47
• Updated: 17/Sep/24 07:25
• Resolved: 17/Sep/24 07:24

Description

1. create a table and insert some data:

create table ice_t (i int, p int) partitioned by spec (truncate(10, i)) stored by iceberg;

insert into ice_t values (1, 1), (2, 2);
insert into ice_t values (10, 10), (20, 20);
insert into ice_t values (40, 40), (30, 30);

Then concurrently execute the following jobs:
Job 1:

insert into ice_t select i*100, p*100 from ice_t;

Job 2:

insert overwrite ice_t select i+1, p+1 from ice_t;

If Job 1 finishes first, Job 2 still succeeds for me, and after that the table content will be the following:

2      2
3      3
11     11
21     21
31     31
41     41
100    100
200    200
1000   1000
2000   2000
3000   3000
4000   4000

Issue Links

• links to: GitHub Pull Request #5386