[HIVE-23799] Fix AcidUtils.parseBaseOrDeltaBucketFilename handling of data loaded by LOAD DATA

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.0.0-alpha-1
• Component/s: Transactions
• Labels: pull-request-available
• Assignee: Peter Vary
• Reporter: Peter Vary
• Created: 03/Jul/20 12:26
• Updated: 17/Nov/22 08:48
• Resolved: 06/Jul/20 17:47

Description

Currently the AcidUtils.parseBaseOrDeltaBucketFilename considers files loaded to the table as original base files. We should fix that.
Also by checking the code for AcidUtils.parseBaseOrDeltaBucketFilename, I have found 2 things:

• The attribute copyNumber is not used anymore, so we should remove it
• The version of the parsedDelta we use here tries to check if the files are in raw format, or not. We do not need this information here, so we can use a different implementation of parseDelta, and avoid a remote call and file read.

Issue Links

• links to: GitHub Pull Request #1204