[HIVE-18154] IOW Acid Load Data/Insert with Overwrite in multi statement transactions

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.0.0
• Component/s: Transactions
• Target Version/s: 3.0.0
• Assignee: Unassigned
• Reporter: Eugene Koifman
• Created: 28/Nov/17 01:16
• Updated: 28/Jul/21 14:13

Description

Consider:

START TRANSACTION
insert into T values(1,2),(3,4)
load data local inpath '" + getWarehouseDir() + "/1/data' overwrite into table T
update T set a = 0 where a = 6
COMMIT

So what we should have on disk is

├── base_0000028
│   ├── 000000_0
│   └── _metadata_acid
├── delete_delta_0000028_0000028_0002
│   └── bucket_00000
├── delta_0000028_0000028_0000
│   └── bucket_00000
└── delta_0000028_0000028_0002
    └── bucket_00000

where base_28 is from overwrite, delta_0000028_0000028_0000 from 1st insert nad delta_0000028_0000028_0002/delete_delta_0000028_0000028_0002 is from update.

AcidUtils.getAcidState() only returns base_28 thinking that all other deltas are included in it - not what we want here.
Same applies for Insert Overwrite.

The simple way to get correct behavior is to disallow commands with Overwrite clause in multi-statement txns.

Issue Links

• is related to: HIVE-14988 Support INSERT OVERWRITE into a partition on transactional tables
• is related to: HIVE-17457 IOW Acid Insert Overwrite when the transaction fails
• is related to: HIVE-17361 Support LOAD DATA for transactional tables
• relates to: HIVE-18126 IOW Mechanics of multiple commands with OVERWRITE in a singe transactions