[CASSANDRA-19514] When jvm-dtest is shutting down an instance TCM retries block the shutdown causing the test to fail

• Type: Bug
• Status: Resolved
• Priority: Normal
• Resolution: Fixed
• Fix Version/s: 5.1
• Component/s: Cluster/Membership, Test/dtest/java
• Bug Category: Correctness - Test Failure
• Severity: Normal
• Complexity: Low Hanging Fruit
• Discovered By: Unit Test
• Platform: All
• Since Version: NA

Source Control Link

https://github.com/apache/cassandra/commit/cbf4dcb3345c7e2f42f6a897c66b6460b7acc2ca

Test and Documentation Plan

existing tests

• Assignee: Sam Tunnicliffe
• Reporter: David Capwell

Authors

Sam Tunnicliffe

Reviewers

Alex Petrov, Blake Eggleston, Marcus Eriksson, Sam Tunnicliffe

• Created: 02/Apr/24 20:20
• Updated: 18/Apr/24 14:06
• Resolved: 18/Apr/24 14:06

Description

org.apache.cassandra.distributed.test.log.RequestCurrentEpochTest#testRequestingPeerWatermarks

java.lang.RuntimeException: java.util.concurrent.TimeoutException
	 org.apache.cassandra.utils.Throwables.maybeFail(Throwables.java:79)
	 org.apache.cassandra.utils.FBUtilities.waitOnFutures(FBUtilities.java:540)
	 org.apache.cassandra.distributed.impl.AbstractCluster.close(AbstractCluster.java:1098)
	 org.apache.cassandra.distributed.test.log.RequestCurrentEpochTest.testRequestingPeerWatermarks(RequestCurrentEpochTest.java:77)
	 java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	 java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	 java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) Caused by: java.util.concurrent.TimeoutException
	 org.apache.cassandra.utils.concurrent.AbstractFuture.get(AbstractFuture.java:253)
	 org.apache.cassandra.utils.FBUtilities.waitOnFutures(FBUtilities.java:532) Suppressed: java.util.concurrent.TimeoutException

In debugger I found the blocked future and it was src/java/org/apache/cassandra/tcm/EpochAwareDebounce.java waiting on src/java/org/apache/cassandra/tcm/RemoteProcessor.java retries

Issue Links

• links to: GH: cep-15-accord
• links to: GitHub Pull Request #3227
• links to: Trunk PR