[CASSANDRA-18253] Test Failures: dtest repair_tests.repair_test.TestRepair.test_simple_sequential_repair

• Type: Bug
• Status: Resolved
• Priority: Normal
• Resolution: Duplicate
• Component/s: Test/dtest/java
• Bug Category: Correctness - Test Failure
• Platform: All
• Assignee: Unassigned
• Reporter: German Eichberger
• Created: 09/Feb/23 17:06
• Updated: 12/Sep/23 19:18
• Resolved: 12/Sep/23 19:18

Description

Regression

dtest-offheap.repair_tests.repair_test.TestRepair.test_simple_sequential_repair (from Cassandra dtests)
Failing for the past 1 build (Since #540 )
Took 3 min 45 sec.
 
Failed 1 times in the last 30 runs. Flakiness: 3%, Stability: 96%

Error Message

failed on teardown with "Unexpected error found in node logs (see stdout for full details). Errors: [[node2] 'ERROR [MemtableReclaimMemory:2] 2023-02-08 06:05:59,669 CassandraDaemon.java:581 - Exception in thread Thread[MemtableReclaimMemory:2,5,main]\njava.lang.AssertionError: null\n\tat org.apache.cassandra.utils.memory.MemtablePool$SubPool.released(MemtablePool.java:193)\n\tat org.apache.cassandra.utils.memory.MemtableAllocator$SubAllocator.releaseAll(MemtableAllocator.java:151)\n\tat org.apache.cassandra.utils.memory.MemtableAllocator$SubAllocator.setDiscarded(MemtableAllocator.java:142)\n\tat org.apache.cassandra.utils.memory.MemtableAllocator.setDiscarded(MemtableAllocator.java:93)\n\tat org.apache.cassandra.utils.memory.NativeAllocator.setDiscarded(NativeAllocator.java:203)\n\tat org.apache.cassandra.db.Memtable.setDiscarded(Memtable.java:212)\n\tat org.apache.cassandra.db.ColumnFamilyStore$Flush$1.runMayThrow(ColumnFamilyStore.java:1216)\n\tat org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28)\n\tat java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)\n\tat java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)\n\tat io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)\n\tat java.lang.Thread.run(Thread.java:750)']"

Stacktrace

Unexpected error found in node logs (see stdout for full details). Errors: [[node2] 'ERROR [MemtableReclaimMemory:2] 2023-02-08 06:05:59,669 CassandraDaemon.java:581 - Exception in thread Thread[MemtableReclaimMemory:2,5,main]\njava.lang.AssertionError: null\n\tat org.apache.cassandra.utils.memory.MemtablePool$SubPool.released(MemtablePool.java:193)\n\tat org.apache.cassandra.utils.memory.MemtableAllocator$SubAllocator.releaseAll(MemtableAllocator.java:151)\n\tat org.apache.cassandra.utils.memory.MemtableAllocator$SubAllocator.setDiscarded(MemtableAllocator.java:142)\n\tat org.apache.cassandra.utils.memory.MemtableAllocator.setDiscarded(MemtableAllocator.java:93)\n\tat org.apache.cassandra.utils.memory.NativeAllocator.setDiscarded(NativeAllocator.java:203)\n\tat org.apache.cassandra.db.Memtable.setDiscarded(Memtable.java:212)\n\tat org.apache.cassandra.db.ColumnFamilyStore$Flush$1.runMayThrow(ColumnFamilyStore.java:1216)\n\tat org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28)\n\tat java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)\n\tat java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)\n\tat io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)\n\tat java.lang.Thread.run(Thread.java:750)']

Issue Links

• is fixed by: CASSANDRA-18125 Improve memtable allocator accounting when updating AtomicBTreePartition
• is related to: CASSANDRA-18159 Test Failure: repair_tests.repair_test.TestRepair.test_*dc_repair
• is related to: CASSANDRA-18125 Improve memtable allocator accounting when updating AtomicBTreePartition