[ASTERIXDB-3426] Error during recovery for atomic statements

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Component/s: TX - Transactions
• Labels: triaged
• Assignee: Unassigned
• Reporter: Peeyush Gupta
• Created: 11/Jun/24 15:41
• Updated: 14/Jun/24 17:08
• Resolved: 11/Jun/24 21:03

Description

Incorrect secondary indices checkpoint files were getting removed during recovery for atomic statements. Causing the following errors

04:11:24.224 [Executor-27:asterix_nc2] WARN  org.apache.hyracks.storage.am.lsm.common.impls.LSMHarness - Failure exiting components
java.lang.IllegalStateException: found non-decreasing component ids ([23,23] -> [23,23]) on index {"class" : "LSMBTree", "dir" : "/home/jenkins/workspace/asterix-gerrit-asterix-app-openjdk17/asterixdb/asterix-app/target/io/dir/asterix_nc2/asterix_nc2/iodevice1/storage/partition_2/Default/ds_4/0/ds_4_sidx", "memory" : [{"class":"LSMBTreeMemoryComponent", "state":"UNREADABLE_UNWRITABLE", "writers":0, "readers":0, "pendingFlushes":0, "id":"[23,23]", "index":{"class":"BTree","file":"storage/partition_2/Default/ds_4/0/ds_4_sidx_virtual_0"}}, {"class":"LSMBTreeMemoryComponent", "state":"INACTIVE", "writers":0, "readers":0, "pendingFlushes":0, "id":"null", "index":{"class":"BTree","file":"storage/partition_2/Default/ds_4/0/ds_4_sidx_virtual_1"}}], "disk" : 24, "num-scheduled-flushes":1, "current-memory-component":1}
    at org.apache.hyracks.storage.am.lsm.common.impls.AbstractLSMIndex.validateComponentIds(AbstractLSMIndex.java:667) ~[hyracks-storage-am-lsm-common-0.3.10-SNAPSHOT.jar:0.3.10-SNAPSHOT]
    at org.apache.hyracks.storage.am.lsm.common.impls.AbstractLSMIndex.addDiskComponent(AbstractLSMIndex.java:624) ~[hyracks-storage-am-lsm-common-0.3.10-SNAPSHOT.jar:0.3.10-SNAPSHOT]
    at org.apache.hyracks.storage.am.lsm.common.impls.LSMHarness.exitOperation(LSMHarness.java:308) ~[hyracks-storage-am-lsm-common-0.3.10-SNAPSHOT.jar:0.3.10-SNAPSHOT]
    at org.apache.hyracks.storage.am.lsm.common.impls.LSMHarness.doExitComponents(LSMHarness.java:214) [hyracks-storage-am-lsm-common-0.3.10-SNAPSHOT.jar:0.3.10-SNAPSHOT]
    at org.apache.hyracks.storage.am.lsm.common.impls.LSMHarness.exitComponents(LSMHarness.java:372) [hyracks-storage-am-lsm-common-0.3.10-SNAPSHOT.jar:0.3.10-SNAPSHOT]
    at org.apache.hyracks.storage.am.lsm.common.impls.LSMHarness.flush(LSMHarness.java:552) [hyracks-storage-am-lsm-common-0.3.10-SNAPSHOT.jar:0.3.10-SNAPSHOT]
    at org.apache.hyracks.storage.am.lsm.common.impls.LSMTreeIndexAccessor.flush(LSMTreeIndexAccessor.java:123) [hyracks-storage-am-lsm-common-0.3.10-SNAPSHOT.jar:0.3.10-SNAPSHOT]
    at org.apache.hyracks.storage.am.lsm.common.impls.FlushOperation.call(FlushOperation.java:38) [hyracks-storage-am-lsm-common-0.3.10-SNAPSHOT.jar:0.3.10-SNAPSHOT]