[HIVE-19955] ACID: Pre-filter the delete event registry using insert delta ranges

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Won't Fix
• Fix Version/s: 4.0.0-alpha-2
• Component/s: Transactions
• Release Note: n/a
• Assignee: Eugene Koifman
• Reporter: Gopal Vijayaraghavan
• Created: 21/Jun/18 07:18
• Updated: 16/Nov/22 13:50
• Resolved: 09/Jan/19 23:33

Description

Since the delete deltas that will be used for the ACID impl is limited to the txn range encoded within the insert deltas, it is not useful to load any delete events for any row outside of the current file's range.

If the insert delta has "delta_3_3_0", then the "writeid=3" can be applied to the delete delta list while loading it into memory - if the file has "base_3", then the filter becomes "writeid <= 3".

Issue Links

• is superceded by: HIVE-20738 Enable Delete Event filtering in VectorizedOrcAcidRowBatchReader