[HIVE-20852] Compaction Initiator ignores datas inserted by Stream Data Ingest

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.1.0
• Component/s: API, Transactions
• Assignee: Unassigned
• Reporter: Kei Miyauchi
• Created: 01/Nov/18 08:38
• Updated: 18/Jun/21 06:45

Description

HI,

Before compaction, Initiator decides whether a table/partition is potentialCompaction by querying COMPLETE_TXN_COMPONENT.
But I found the transactions which committed by Stream Data Ingest is not stored on COMPLETE_TXN_COMPONENT. This is because the statement "insert into COMPLETED_TXN_COMPONENTS (ctc_txnid, ctc_database, ctc_table, ctc_partition, ctc_writeid, ctc_update_delete) select tc_txnid, tc_database, tc_table, tc_partition, tc_writeid, 'N' from TXN_COMPONENTS where tc_txnid = (id)"  fails.
I found INSERT statement to TXN_COMPONENTS isn't fired. select subquery above returns 0 row.