[RATIS-722] logAppend fails with Timeout exception while reading the stateMachine log entry

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Not A Problem
• Component/s: server
• Assignee: Unassigned
• Reporter: Shashikant Banerjee
• Created: 17/Oct/19 19:19
• Updated: 01/Dec/23 06:39
• Resolved: 02/Nov/23 04:34

Description

2019-10-16 23:28:21,517 WARN org.apache.ratis.server.impl.LogAppender: 7cd8590b-b724-4d53-8888-a565ab6706c7@group-398C6C673F7A->5949f017-d0b5-47ad-90c9-26b0b1981551: Failed to get (t:59, i:1569), STATEMACHINELOGENTRY, client-17EF628BF6BC, cid=191 in 2499999948ns: {}
java.util.concurrent.TimeoutException
        at java.util.concurrent.CompletableFuture.timedGet(CompletableFuture.java:1771)
        at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1915)
        at org.apache.ratis.server.raftlog.RaftLog$EntryWithData.getEntry(RaftLog.java:472)
        at org.apache.ratis.util.DataQueue.pollList(DataQueue.java:134)
        at org.apache.ratis.server.impl.LogAppender.createRequest(LogAppender.java:220)
        at org.apache.ratis.grpc.server.GrpcLogAppender.appendLog(GrpcLogAppender.java:175)
        at org.apache.ratis.grpc.server.GrpcLogAppender.runAppenderImpl(GrpcLogAppender.java:119)
        at org.apache.ratis.server.impl.LogAppender$AppenderDaemon.run(LogAppender.java:76)
        at java.lang.Thread.run(Thread.java:748)
2019-10-16 23:28:21,542 INFO org.apache.ratis.grpc.client.GrpcClientProtocolService: Failed RaftClientRequest:client-DBF59FE01BBD->7cd8590b-b724-4d53-8888-a565ab6706c7@group-398C6C673F7A, cid=219, seq=0, Watch-ALL_COMMITTED(1262), Message:<EMPTY>, reply=RaftClientReply:client-DBF59FE01BBD->7cd8590b-b724-4d53-8888-a565ab6706c7@group-398C6C673F7A, cid=219, FAILED org.apache.ratis.protocol.NotReplicatedException: Request with call Id 219 and log index 1262 is not yet replicated to ALL_COMMITTED, logIndex=1262, commits[7cd8590b-b724-4d53-8888-a565ab6706c7:c1702, 3b9b7dee-f9c7-48e0-af14-5c043e050b84:c1641, 5949f017-d0b5-47ad-90c9-26b0b1981551:c269]

Issue Links

• is related to: RATIS-1947 TimeoutIOException in WriteLog might not release Pending Requests