[CASSANDRA-17702] Fix flaky dtest - repair_tests.repair_test.TestRepair.test_dead_sync_initiator

• Type: Bug
• Status: Open
• Priority: Normal
• Resolution: Unresolved
• Fix Version/s: 3.0.x, 3.11.x
• Component/s: Consistency/Repair
• Bug Category: Correctness - Test Failure
• Severity: Normal
• Complexity: Normal
• Discovered By: DTest
• Platform: All
• Assignee: Unassigned
• Reporter: Brandon Williams
• Created: 21/Jun/22 14:27
• Updated: 03/Oct/22 22:35

Description

https://ci-cassandra.apache.org/job/Cassandra-3.11/371/testReport/dtest-novnode.repair_tests.repair_test/TestRepair/test_dead_sync_initiator/

Unexpected error found in node logs (see stdout for full details). Errors: [[node1] "ERROR [RepairJobTask:4] 2022-06-19 17:51:47,864 SystemDistributedKeyspace.java:324 - Error executing query UPDATE system_distributed.repair_history SET status = 'FAILED', finished_at = toTimestamp(now()), exception_message=?, exception_stacktrace=? WHERE keyspace_name = 'keyspace1' AND columnfamily_name = 'standard1' AND id = 75f1ee00-eff8-11ec-ad59-710cf5e63782\njava.lang.AssertionError: java.lang.InterruptedException\n\tat org.apache.cassandra.net.OutboundTcpConnection.enqueue(OutboundTcpConnection.java:187)\n\tat org.apache.cassandra.net.MessagingService.sendOneWay(MessagingService.java:956)\n\tat org.apache.cassandra.net.MessagingService.sendRR(MessagingService.java:918)\n\tat org.apache.cassandra.service.StorageProxy.sendToHintedEndpoints(StorageProxy.java:1425)\n\tat org.apache.cassandra.service.StorageProxy$2.apply(StorageProxy.java:142)\n\tat org.apache.cassandra.service.StorageProxy.performWrite(StorageProxy.java:1203)\n\tat org.apache.cassandra.service.StorageProxy.mutate(StorageProxy.java:740)\n\tat org.apache.cassandra.service.StorageProxy.mutateWithTriggers(StorageProxy.java:972)\n\tat org.apache.cassandra.cql3.statements.ModificationStatement.executeWithoutCondition(ModificationStatement.java:435)\n\tat org.apache.cassandra.cql3.statements.ModificationStatement.execute(ModificationStatement.java:421)\n\tat org.apache.cassandra.cql3.QueryProcessor.processStatement(QueryProcessor.java:243)\n\tat org.apache.cassandra.cql3.QueryProcessor.process(QueryProcessor.java:274)\n\tat org.apache.cassandra.cql3.QueryProcessor.process(QueryProcessor.java:289)\n\tat org.apache.cassandra.repair.SystemDistributedKeyspace.processSilent(SystemDistributedKeyspace.java:320)\n\tat org.apache.cassandra.repair.SystemDistributedKeyspace.failedRepairJob(SystemDistributedKeyspace.java:254)\n\tat org.apache.cassandra.repair.RepairJob$3.onFailure(RepairJob.java:132)\n\tat com.google.common.util.concurrent.Futures$6.run(Futures.java:1313)\n\tat java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)\n\tat java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)\n\tat org.apache.cassandra.concurrent.NamedThreadFactory.lambda$threadLocalDeallocator$0(NamedThreadFactory.java:84)\n\tat java.lang.Thread.run(Thread.java:748)\nCaused by: java.lang.InterruptedException: null\n\tat java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireInterruptibly(AbstractQueuedSynchronizer.java:1220)\n\tat java.util.concurrent.locks.ReentrantLock.lockInterruptibly(ReentrantLock.java:335)\n\tat java.util.concurrent.LinkedBlockingQueue.put(LinkedBlockingQueue.java:339)\n\tat org.apache.cassandra.net.OutboundTcpConnection.enqueue(OutboundTcpConnection.java:183)\n\t... 20 common frames omitted"]