[HIVE-17705] HIVE-17562 is returning incorrect results

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 2.4.0
• Fix Version/s: 2.2.1, 2.3.1, 2.4.0
• Component/s: Transactions
• Target Version/s: 2.4.0
• Assignee: Prasanth Jayachandran
• Reporter: Prasanth Jayachandran
• Created: 05/Oct/17 06:52
• Updated: 24/Oct/17 21:57
• Resolved: 05/Oct/17 17:53

Description

HIVE-17562 is generating incorrect results intermittently. Also derived tables with default file format set to ORC is resulting in AIOB exception.

1) Intermittent issue happens based on the order of selection of bucket file for ETL split strategy. Flipping the covered boolean flag looks error prone. The test case always passed when bucket_00000 is analyzed first. When bucket_00001 is analyzed first duplicate rows were generated.
2) Some internal test revealed a test failure with ArrayIndexOutOfBounds exception which happens for non-bucketed table.

Issue Links

• supercedes: HIVE-17562 ACID 1.0 + ETL strategy should treat empty compacted files as uncovered deltas