[HDDS-3799] Fix intermittent failure in Test2WayCommitInRatis

• Type: Sub-task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: Ozone Client
• Target Version/s: 2.0.0
• Assignee: Unassigned Assign to me
• Reporter: Lokesh Jain
• Created: 15/Jun/20 07:01
• Updated: 16/Dec/23 23:43

Description

Test2WayCommitInRatis fails intermittently. 

[ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 284.068 s <<< FAILURE! - in org.apache.hadoop.ozone.client.rpc.Test2WayCommitInRatis
2934[ERROR] test2WayCommitForRetryfailure(org.apache.hadoop.ozone.client.rpc.Test2WayCommitInRatis)  Time elapsed: 283.949 s  <<< ERROR!
2935java.util.concurrent.ExecutionException: org.apache.ratis.protocol.GroupMismatchException: da24fc5a-21da-4590-a368-d3e61c80cf19: group-B58D6F5329F8 not found.
2936	at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357)
2937	at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908)
2938	at org.apache.hadoop.ozone.client.rpc.Test2WayCommitInRatis.test2WayCommitForRetryfailure(Test2WayCommitInRatis.java:180)
2939	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
2940	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
2941	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2942	at java.lang.reflect.Method.invoke(Method.java:498)
2943	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
2944	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
2945	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
2946	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
2947	at org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74)
2948Caused by: org.apache.ratis.protocol.GroupMismatchException: da24fc5a-21da-4590-a368-d3e61c80cf19: group-B58D6F5329F8 not found.
2949	at org.apache.ratis.server.impl.RaftServerProxy$ImplMap.get(RaftServerProxy.java:127)
2950	at org.apache.ratis.server.impl.RaftServerProxy.getImplFuture(RaftServerProxy.java:274)
2951	at org.apache.ratis.server.impl.RaftServerProxy.submitRequest(RaftServerProxy.java:332)
2952	at org.apache.ratis.server.impl.RaftServerProxy.submitClientRequestAsync(RaftServerProxy.java:338)
2953	at org.apache.ratis.grpc.client.GrpcClientProtocolService$RequestStreamObserver.processClientRequest(GrpcClientProtocolService.java:225)
2954	at org.apache.ratis.grpc.client.GrpcClientProtocolService$OrderedRequestStreamObserver.processClientRequest(GrpcClientProtocolService.java:331)
2955	at org.apache.ratis.util.SlidingWindow$Server.processRequestsFromHead(SlidingWindow.java:429)
2956	at org.apache.ratis.util.SlidingWindow$Server.receivedRequest(SlidingWindow.java:421)
2957	at org.apache.ratis.grpc.client.GrpcClientProtocolService$OrderedRequestStreamObserver.processClientRequest(GrpcClientProtocolService.java:355)
2958	at org.apache.ratis.grpc.client.GrpcClientProtocolService$RequestStreamObserver.onNext(GrpcClientProtocolService.java:245)
2959	at org.apache.ratis.grpc.client.GrpcClientProtocolService$RequestStreamObserver.onNext(GrpcClientProtocolService.java:168)
2960	at org.apache.ratis.thirdparty.io.grpc.stub.ServerCalls$StreamingServerCallHandler$StreamingServerCallListener.onMessage(ServerCalls.java:251)
2961	at org.apache.ratis.thirdparty.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailableInternal(ServerCallImpl.java:309)
2962	at org.apache.ratis.thirdparty.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailable(ServerCallImpl.java:292)
2963	at org.apache.ratis.thirdparty.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1MessagesAvailable.runInContext(ServerImpl.java:782)
2964	at org.apache.ratis.thirdparty.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
2965	at org.apache.ratis.thirdparty.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
2966	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
2967	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
2968	at java.lang.Thread.run(Thread.java:748)
2969