[HIVE-12202] NPE thrown when reading legacy ACID delta files

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.3.0
• Fix Version/s: 1.3.0, 2.0.0
• Component/s: Transactions
• Labels: transactions
• Release Note: Reading legacy ACID formats (prior to 1.3.0) no longer results in an NPE.
• Assignee: Elliot West
• Reporter: Elliot West
• Created: 16/Oct/15 10:58
• Updated: 14/Nov/16 18:59
• Resolved: 03/Nov/15 18:59

Description

When reading legacy ACID deltas of the form delta_$startTxnId_$endTxnId a NullPointerException is thrown on:

org.apache.hadoop.hive.ql.io.AcidUtils.deserializeDeltas#371

if(dmd.getStmtIds().isEmpty()) {

The older ACID data format (pre-Hive 1.3.0) which does not include the statement ID, and code written for that format should still be supported. Therefore the above condition should also include a null check or alternatively AcidInputFormat.DeltaMetaData should never return null, and return an empty list in this specific scenario.

Issue Links

• is broken by: HIVE-11030 Enhance storage layer to create one delta file per write
• is duplicated by: HIVE-12030 Hive throws NPE with ACID enabled tables