[CASSANDRA-19543] Test Failure: testConcurrentReadWriteWorkload

• Type: Bug
• Status: Open
• Priority: Normal
• Resolution: Unresolved
• Fix Version/s: 5.x
• Component/s: CI, Test/dtest/java
• Bug Category: Correctness - Test Failure
• Severity: Normal
• Complexity: Normal
• Discovered By: User Report
• Platform: All
• Assignee: Unassigned
• Reporter: Ekaterina Dimitrova
• Created: 08/Apr/24 16:47
• Updated: 08/Apr/24 16:48

Description

Flaky on trunk, seen in Butler and here:
https://app.circleci.com/pipelines/github/ekaterinadimitrova2/cassandra/2680/workflows/8b1c0d0a-7458-4b43-9bba-ac96b9bfe64f/jobs/58940/tests#failed-test-0

java.lang.RuntimeException: Interrupting run because of an exception
	at org.apache.cassandra.harry.runner.Runner.mergeAndThrow(Runner.java:395)
	at org.apache.cassandra.harry.runner.Runner$ConcurrentRunner.runInternal(Runner.java:305)
	at org.apache.cassandra.harry.runner.Runner.run(Runner.java:77)
	at org.apache.cassandra.fuzz.harry.integration.model.ConcurrentQuiescentCheckerIntegrationTest.testConcurrentReadWriteWorkload(ConcurrentQuiescentCheckerIntegrationTest.java:62)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
Caused by: org.apache.cassandra.exceptions.ReadFailureException: Operation failed - received 0 responses and 1 failures: UNKNOWN from /127.0.0.1:7012
	at org.apache.cassandra.service.reads.ReadCallback.awaitResults(ReadCallback.java:161)
	at org.apache.cassandra.service.reads.AbstractReadExecutor.awaitResponses(AbstractReadExecutor.java:396)
	at org.apache.cassandra.service.StorageProxy.fetchRows(StorageProxy.java:2071)
	at org.apache.cassandra.service.StorageProxy.readRegular(StorageProxy.java:1941)
	at org.apache.cassandra.service.StorageProxy.read(StorageProxy.java:1818)
	at org.apache.cassandra.db.SinglePartitionReadCommand.execute(SinglePartitionReadCommand.java:479)
	at org.apache.cassandra.service.pager.AbstractQueryPager.fetchPage(AbstractQueryPager.java:75)
	at org.apache.cassandra.service.pager.SinglePartitionPager.fetchPage(SinglePartitionPager.java:32)
	at org.apache.cassandra.cql3.statements.SelectStatement$Pager$NormalPager.fetchPage(SelectStatement.java:483)
	at org.apache.cassandra.cql3.statements.SelectStatement.execute(SelectStatement.java:540)
	at org.apache.cassandra.cql3.statements.SelectStatement.execute(SelectStatement.java:347)
	at org.apache.cassandra.distributed.impl.Coordinator$1.hasNext(Coordinator.java:220)
	at org.apache.cassandra.distributed.api.QueryResults$1.hasNext(QueryResults.java:55)
	at org.apache.cassandra.distributed.api.QueryResults$IteratorQueryResult.hasNext(QueryResults.java:166)
	at org.apache.cassandra.distributed.api.QueryResult$1.hasNext(QueryResult.java:76)
	at com.google.common.collect.Iterators.addAll(Iterators.java:365)
	at com.google.common.collect.Lists.newArrayList(Lists.java:146)
	at com.google.common.collect.Iterators.toArray(Iterators.java:349)
	at org.apache.cassandra.harry.sut.injvm.InJvmSutBase.execute(InJvmSutBase.java:156)
	at org.apache.cassandra.harry.sut.injvm.InJvmSutBase.execute(InJvmSutBase.java:139)
	at org.apache.cassandra.harry.sut.SystemUnderTest.executeIdempotent(SystemUnderTest.java:54)
	at org.apache.cassandra.harry.model.SelectHelper.execute(SelectHelper.java:328)
	at org.apache.cassandra.harry.model.SelectHelper.execute(SelectHelper.java:322)
	at org.apache.cassandra.harry.model.QuiescentChecker.lambda$validate$0(QuiescentChecker.java:72)
	at org.apache.cassandra.harry.model.QuiescentChecker.validate(QuiescentChecker.java:78)
	at org.apache.cassandra.harry.model.QuiescentChecker.validate(QuiescentChecker.java:72)
	at org.apache.cassandra.harry.visitors.RandomPartitionValidator.visit(RandomPartitionValidator.java:56)
	at org.apache.cassandra.harry.runner.Runner$ConcurrentRunner.lambda$runInternal$0(Runner.java:296)
	at org.apache.cassandra.harry.runner.Runner.lambda$wrapInterrupt$3(Runner.java:368)
	at org.apache.cassandra.concurrent.InfiniteLoopExecutor.loop(InfiniteLoopExecutor.java:121)
	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
	at java.base/java.lang.Thread.run(Thread.java:829)

Issue Links

• Discovered while testing: CASSANDRA-19428 Clean up KeyRangeIterator classes