[IGNITE-18822] ItIgniteInMemoryNodeRestartTest#inMemoryNodeFullPartitionRestart is flaky

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Labels: ignite-3
• Assignee: Alexander Lapin
• Reporter: Sergey Uttsel
• Created: 16/Feb/23 11:38
• Updated: 31/Mar/23 15:22
• Resolved: 31/Mar/23 15:22

Description

May be the reason is https://issues.apache.org/jira/browse/IGNITE-18088

TC build https://ci.ignite.apache.org/viewLog.html?buildId=7075285

Caused by: org.apache.ignite.tx.TransactionException: IGN-REP-3 TraceId:30ca0d21-b53a-4282-b8f5-2eee19fb6958 Replication is timed out [replicaGrpId=e0f3e99a-6166-4dca-bb1a-bd80450c113c_part_0]
at app//org.apache.ignite.internal.util.ExceptionUtils.lambda$withCause$0(ExceptionUtils.java:346)
at app//org.apache.ignite.internal.util.ExceptionUtils.withCauseInternal(ExceptionUtils.java:429)
at app//org.apache.ignite.internal.util.ExceptionUtils.withCause(ExceptionUtils.java:346)
at app//org.apache.ignite.internal.table.distributed.storage.InternalTableImpl.wrapReplicationException(InternalTableImpl.java:1479)
at app//org.apache.ignite.internal.table.distributed.storage.InternalTableImpl.lambda$postEnlist$9(InternalTableImpl.java:471)
at java.base@11.0.16.1/java.util.concurrent.CompletableFuture.uniHandle(CompletableFuture.java:930)
at java.base@11.0.16.1/java.util.concurrent.CompletableFuture$UniHandle.tryFire(CompletableFuture.java:907)
at java.base@11.0.16.1/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:506)
at java.base@11.0.16.1/java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:2088)
at app//org.apache.ignite.internal.table.distributed.storage.InternalTableImpl.lambda$enlistWithRetry$5(InternalTableImpl.java:450)
at java.base@11.0.16.1/java.util.concurrent.CompletableFuture.uniHandle(CompletableFuture.java:930)
at java.base@11.0.16.1/java.util.concurrent.CompletableFuture$UniHandle.tryFire(CompletableFuture.java:907)
at java.base@11.0.16.1/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:506)
at java.base@11.0.16.1/java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:2088)
at app//org.apache.ignite.internal.replicator.ReplicaService.lambda$sendToReplica$4(ReplicaService.java:98)
at java.base@11.0.16.1/java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:859)
at java.base@11.0.16.1/java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:837)
at java.base@11.0.16.1/java.util.concurrent.CompletableFuture$Completion.exec(CompletableFuture.java:479)
at java.base@11.0.16.1/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:290)
at java.base@11.0.16.1/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1020)
at java.base@11.0.16.1/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1656)
at java.base@11.0.16.1/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1594)
at java.base@11.0.16.1/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:183)
Suppressed: java.util.concurrent.CompletionException: org.apache.ignite.internal.replicator.exception.ReplicationTimeoutException: IGN-REP-3 TraceId:37925cca-df1e-4eb2-b533-f7a410fb841e Replication is timed out [replicaGrpId=e0f3e99a-6166-4dca-bb1a-bd80450c113c_part_0]
at java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:331)
at java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:346)
at java.base/java.util.concurrent.CompletableFuture$UniRun.tryFire(CompletableFuture.java:777)
... 11 more
Caused by: org.apache.ignite.internal.replicator.exception.ReplicationTimeoutException: IGN-REP-3 TraceId:37925cca-df1e-4eb2-b533-f7a410fb841e Replication is timed out [replicaGrpId=e0f3e99a-6166-4dca-bb1a-bd80450c113c_part_0]
... 9 more
Caused by: org.apache.ignite.internal.replicator.exception.ReplicationTimeoutException: IGN-REP-3 TraceId:30ca0d21-b53a-4282-b8f5-2eee19fb6958 Replication is timed out [replicaGrpId=e0f3e99a-6166-4dca-bb1a-bd80450c113c_part_0]
... 9 more

Implementation Notes

"Replication is timed out" issue was probably fixed wihtin https://issues.apache.org/jira/browse/IGNITE-19059 and https://issues.apache.org/jira/browse/IGNITE-19022

I've enabled corresponding test in https://issues.apache.org/jira/browse/IGNITE-19044

Issue Links

• Is contained by: IGNITE-19044 ItIgniteInMemoryNodeRestartTest#inMemoryNodeRestartNotLeader fails
• links to: GitHub Pull Request #1684