[HIVE-18907] Create utility to fix acid key index issue from HIVE-18817

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.0.0
• Component/s: ORC, Transactions
• Assignee: Jason Dere
• Reporter: Jason Dere
• Created: 08/Mar/18 09:14
• Updated: 03/Dec/20 08:49
• Resolved: 12/Mar/18 22:30

Description

While HIVE-18817 will create new ORC Acid files from hitting the ArrayIndexOutOfBounds issue, existing files created before HIVE-18817 will still cause this issue. If there are delta directories then one way to generate new files is to perform a major compaction. But this does not work if there are no delta directories for the table/partition.

Add a tool to fix the Acid ORC files directly in the case that a compaction cannot be performed.

Issue Links

• is related to: HIVE-18817 ArrayIndexOutOfBounds exception during read of ACID table.
• is related to: HIVE-24475 Generalize fixacidkeyindex utility
• links to: https://reviews.apache.org/r/65988/