[HIVE-12439] CompactionTxnHandler.markCleaned() and TxnHandler.openTxns() misc improvements

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.0.0
• Fix Version/s: 1.3.0, 2.1.0
• Component/s: Metastore, Transactions
• Target Version/s: 1.3.0
• Assignee: Wei Zheng
• Reporter: Eugene Koifman
• Created: 17/Nov/15 19:37
• Updated: 21/Jun/16 15:52
• Resolved: 21/Mar/16 21:52

Description

1. add a safeguard to make sure IN clause is not too large; break up by txn id to delete from TXN_COMPONENTS where tc_txnid in ...
2. TxnHandler. openTxns() - use 1 insert with many rows in values() clause, rather than 1 DB roundtrip per row

Issue Links

• is related to: HIVE-11948 Investigate TxnHandler and CompactionTxnHandler to see where we improve concurrency
• is required by: HIVE-13335 tune TxnHandler.performTimeOuts() batch size