[HIVE-18751] ACID table scan through get_splits UDF doesn't receive ValidWriteIdList configuration.

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0
• Fix Version/s: 3.0.0
• Component/s: Transactions
• Labels: ACID UDF pull-request-available
• Assignee: Sankar Hariappan
• Reporter: Sankar Hariappan
• Created: 20/Feb/18 08:58
• Updated: 22/May/18 23:14
• Resolved: 12/Mar/18 04:59

Description

Per table write ID (HIVE-18192) have replaced global transaction ID with write ID to version data files in ACID/MM tables,

To ensure snapshot isolation, need to generate ValidWriteIdList for the given txn/table and use it when scan the ACID/MM tables.

In case of get_splits UDF which runs on ACID table scan query won't receive it properly through configuration (hive.txn.tables.valid.writeids) and hence throws exception. 

TestAcidOnTez.testGetSplitsLocks is the test failing for the same. Need to fix it.

 

Issue Links

• blocks: HIVE-18860 fix TestAcidOnTez#testGetSplitsLocks
• is related to: HIVE-18192 Introduce WriteID per table rather than using global transaction ID
• links to: GitHub Pull Request #317