2023-05-08 19:12:51:241 +0300 [INFO][main][ItDmlTest] >>> Starting test: ItDmlTest#test, displayName: test(), workDir: /Users/korlov/projects/work/gridgain/ignite-3/modules/runner/build/work/ItDmlTest/static_555993353560259 2023-05-08 19:12:51:324 +0300 [INFO][%idt_n_2%JRaft-FSMCaller-Disruptor-_stripe_2-0][LogicalTopologyImpl] Node added to logical topology [node=ClusterNode [id=8b623543-a133-44fc-88f3-865d6dae3abd, name=idt_n_2, address=192.168.8.104:3346, nodeMetadata=null], topology=LogicalTopologySnapshot [version=2, nodes=Set12 [ClusterNode [id=fb41a46d-8475-485d-94d0-68f88db20eb0, name=idt_n_0, address=192.168.8.104:3344, nodeMetadata=null], ClusterNode [id=8b623543-a133-44fc-88f3-865d6dae3abd, name=idt_n_2, address=192.168.8.104:3346, nodeMetadata=null]]]] 2023-05-08 19:12:51:366 +0300 [INFO][%idt_n_1%JRaft-AppendEntries-Processor-1][LocalRaftMetaStorage] Save raft meta, path=build/work/ItDmlTest/static_555993353560259/idt_n_1/cmg_group_idt_n_1_0/meta, term=1, votedFor=, cost time=173 ms 2023-05-08 19:12:51:367 +0300 [INFO][%idt_n_1%JRaft-AppendEntries-Processor-1][NodeImpl] Node is a learner, election timer is not started. 2023-05-08 19:12:51:367 +0300 [WARNING][%idt_n_1%JRaft-AppendEntries-Processor-1][NodeImpl] Node reject term_unmatched AppendEntriesRequest from idt_n_0, term=1, prevLogIndex=10, prevLogTerm=1, localPrevLogTerm=0, lastLogIndex=0, entriesSize=0. 2023-05-08 19:12:51:367 +0300 [INFO][%idt_n_1%JRaft-FSMCaller-Disruptor-_stripe_1-0][StateMachineAdapter] onStartFollowing: LeaderChangeContext [leaderId=idt_n_0, term=1, status=Status[ENEWLEADER<10011>: Raft node receives message from new leader with higher term.]]. 2023-05-08 19:12:51:388 +0300 [WARNING][%idt_n_1%JRaft-AppendEntries-Processor-1][NodeImpl] Node reject term_unmatched AppendEntriesRequest from idt_n_0, term=1, prevLogIndex=10, prevLogTerm=1, localPrevLogTerm=0, lastLogIndex=0, entriesSize=0. 2023-05-08 19:12:51:388 +0300 [INFO][%idt_n_2%JRaft-FSMCaller-Disruptor-_stripe_2-0][LogicalTopologyImpl] Node added to logical topology [node=ClusterNode [id=33afbb71-4f92-47c8-b5ab-4a397884aa8c, name=idt_n_1, address=192.168.8.104:3345, nodeMetadata=null], topology=LogicalTopologySnapshot [version=3, nodes=SetN [ClusterNode [id=fb41a46d-8475-485d-94d0-68f88db20eb0, name=idt_n_0, address=192.168.8.104:3344, nodeMetadata=null], ClusterNode [id=33afbb71-4f92-47c8-b5ab-4a397884aa8c, name=idt_n_1, address=192.168.8.104:3345, nodeMetadata=null], ClusterNode [id=8b623543-a133-44fc-88f3-865d6dae3abd, name=idt_n_2, address=192.168.8.104:3346, nodeMetadata=null]]]] 2023-05-08 19:12:51:535 +0300 [INFO][%idt_n_1%JRaft-FSMCaller-Disruptor-_stripe_1-0][LogicalTopologyImpl] Node added to logical topology [node=ClusterNode [id=fb41a46d-8475-485d-94d0-68f88db20eb0, name=idt_n_0, address=192.168.8.104:3344, nodeMetadata=null], topology=LogicalTopologySnapshot [version=1, nodes=Set12 [ClusterNode [id=fb41a46d-8475-485d-94d0-68f88db20eb0, name=idt_n_0, address=192.168.8.104:3344, nodeMetadata=null]]]] 2023-05-08 19:12:51:537 +0300 [INFO][%idt_n_1%JRaft-FSMCaller-Disruptor-_stripe_1-0][LogicalTopologyImpl] Node added to logical topology [node=ClusterNode [id=8b623543-a133-44fc-88f3-865d6dae3abd, name=idt_n_2, address=192.168.8.104:3346, nodeMetadata=null], topology=LogicalTopologySnapshot [version=2, nodes=Set12 [ClusterNode [id=fb41a46d-8475-485d-94d0-68f88db20eb0, name=idt_n_0, address=192.168.8.104:3344, nodeMetadata=null], ClusterNode [id=8b623543-a133-44fc-88f3-865d6dae3abd, name=idt_n_2, address=192.168.8.104:3346, nodeMetadata=null]]]] 2023-05-08 19:12:51:538 +0300 [INFO][%idt_n_1%JRaft-FSMCaller-Disruptor-_stripe_1-0][LogicalTopologyImpl] Node added to logical topology [node=ClusterNode [id=33afbb71-4f92-47c8-b5ab-4a397884aa8c, name=idt_n_1, address=192.168.8.104:3345, nodeMetadata=null], topology=LogicalTopologySnapshot [version=3, nodes=SetN [ClusterNode [id=fb41a46d-8475-485d-94d0-68f88db20eb0, name=idt_n_0, address=192.168.8.104:3344, nodeMetadata=null], ClusterNode [id=33afbb71-4f92-47c8-b5ab-4a397884aa8c, name=idt_n_1, address=192.168.8.104:3345, nodeMetadata=null], ClusterNode [id=8b623543-a133-44fc-88f3-865d6dae3abd, name=idt_n_2, address=192.168.8.104:3346, nodeMetadata=null]]]] 2023-05-08 19:12:53:206 +0300 [INFO][%idt_n_0%tableManager-io-3][Loza] Start new raft node=RaftNodeId [groupId=f6b9512f-b735-446e-85a3-d6b8636c847c_part_0, peer=Peer [consistentId=idt_n_0, idx=0]] with initial configuration=PeersAndLearners [peers=Set12 [Peer [consistentId=idt_n_0, idx=0]], learners=SetN []] 2023-05-08 19:12:53:221 +0300 [INFO][%idt_n_0%tableManager-io-3][FSMCallerImpl] Starts FSMCaller successfully. 2023-05-08 19:12:53:225 +0300 [INFO][%idt_n_0%tableManager-io-3][NodeImpl] Node init, term=0, lastLogId=LogId [index=0, term=0], conf=idt_n_0, oldConf=. 2023-05-08 19:12:53:243 +0300 [INFO][%idt_n_0%tableManager-io-3][NodeImpl] Node start vote and grant vote self, term=0. 2023-05-08 19:12:53:245 +0300 [INFO][%idt_n_0%tableManager-io-6][Loza] Start new raft node=RaftNodeId [groupId=f6b9512f-b735-446e-85a3-d6b8636c847c_part_1, peer=Peer [consistentId=idt_n_0, idx=0]] with initial configuration=PeersAndLearners [peers=Set12 [Peer [consistentId=idt_n_0, idx=0]], learners=SetN []] 2023-05-08 19:12:53:269 +0300 [INFO][%idt_n_0%tableManager-io-6][FSMCallerImpl] Starts FSMCaller successfully. 2023-05-08 19:12:53:290 +0300 [INFO][%idt_n_0%tableManager-io-3][LocalRaftMetaStorage] Save raft meta, path=build/work/ItDmlTest/static_555993353560259/idt_n_0/f6b9512f-b735-446e-85a3-d6b8636c847c_part_0_idt_n_0_0/meta, term=1, votedFor=idt_n_0, cost time=47 ms 2023-05-08 19:12:53:291 +0300 [INFO][%idt_n_0%tableManager-io-6][NodeImpl] Node init, term=0, lastLogId=LogId [index=0, term=0], conf=idt_n_0, oldConf=. 2023-05-08 19:12:53:291 +0300 [INFO][%idt_n_0%tableManager-io-3][NodeImpl] Node become leader of group, term=1, conf=idt_n_0, oldConf=. 2023-05-08 19:12:53:312 +0300 [INFO][%idt_n_0%tableManager-io-3][RaftGroupService] Start the RaftGroupService successfully 2023-05-08 19:12:53:312 +0300 [INFO][%idt_n_0%tableManager-io-6][NodeImpl] Node start vote and grant vote self, term=0. 2023-05-08 19:12:53:314 +0300 [INFO][%idt_n_0%tableManager-io-10][Loza] Start new raft node=RaftNodeId [groupId=f6b9512f-b735-446e-85a3-d6b8636c847c_part_2, peer=Peer [consistentId=idt_n_0, idx=0]] with initial configuration=PeersAndLearners [peers=Set12 [Peer [consistentId=idt_n_0, idx=0]], learners=SetN []] 2023-05-08 19:12:53:334 +0300 [INFO][%idt_n_0%tableManager-io-10][FSMCallerImpl] Starts FSMCaller successfully. 2023-05-08 19:12:53:340 +0300 [INFO][%idt_n_0%JRaft-FSMCaller-Disruptor-_stripe_0-0][StateMachineAdapter] onLeaderStart: term=1. 2023-05-08 19:12:53:355 +0300 [INFO][%idt_n_0%tableManager-io-10][NodeImpl] Node init, term=0, lastLogId=LogId [index=0, term=0], conf=idt_n_0, oldConf=. 2023-05-08 19:12:53:356 +0300 [INFO][%idt_n_0%tableManager-io-10][NodeImpl] Node start vote and grant vote self, term=0. 2023-05-08 19:12:53:379 +0300 [INFO][%idt_n_0%tableManager-io-14][Loza] Start new raft node=RaftNodeId [groupId=f6b9512f-b735-446e-85a3-d6b8636c847c_part_3, peer=Peer [consistentId=idt_n_0, idx=0]] with initial configuration=PeersAndLearners [peers=Set12 [Peer [consistentId=idt_n_0, idx=0]], learners=SetN []] 2023-05-08 19:12:53:399 +0300 [INFO][%idt_n_0%tableManager-io-6][LocalRaftMetaStorage] Save raft meta, path=build/work/ItDmlTest/static_555993353560259/idt_n_0/f6b9512f-b735-446e-85a3-d6b8636c847c_part_1_idt_n_0_0/meta, term=1, votedFor=idt_n_0, cost time=87 ms 2023-05-08 19:12:53:400 +0300 [INFO][%idt_n_0%tableManager-io-6][NodeImpl] Node become leader of group, term=1, conf=idt_n_0, oldConf=. 2023-05-08 19:12:53:421 +0300 [INFO][%idt_n_0%tableManager-io-6][RaftGroupService] Start the RaftGroupService successfully 2023-05-08 19:12:53:443 +0300 [INFO][%idt_n_0%tableManager-io-10][LocalRaftMetaStorage] Save raft meta, path=build/work/ItDmlTest/static_555993353560259/idt_n_0/f6b9512f-b735-446e-85a3-d6b8636c847c_part_2_idt_n_0_0/meta, term=1, votedFor=idt_n_0, cost time=66 ms 2023-05-08 19:12:53:444 +0300 [INFO][%idt_n_0%tableManager-io-10][NodeImpl] Node become leader of group, term=1, conf=idt_n_0, oldConf=. 2023-05-08 19:12:53:444 +0300 [INFO][%idt_n_0%tableManager-io-14][FSMCallerImpl] Starts FSMCaller successfully. 2023-05-08 19:12:53:466 +0300 [INFO][%idt_n_0%tableManager-io-10][RaftGroupService] Start the RaftGroupService successfully 2023-05-08 19:12:53:466 +0300 [INFO][%idt_n_0%tableManager-io-14][NodeImpl] Node init, term=0, lastLogId=LogId [index=0, term=0], conf=idt_n_0, oldConf=. 2023-05-08 19:12:53:466 +0300 [INFO][%idt_n_0%JRaft-FSMCaller-Disruptor-_stripe_3-0][StateMachineAdapter] onLeaderStart: term=1. 2023-05-08 19:12:53:489 +0300 [INFO][%idt_n_0%tableManager-io-14][NodeImpl] Node start vote and grant vote self, term=0. 2023-05-08 19:12:53:490 +0300 [INFO][%idt_n_0%tableManager-io-21][Loza] Start new raft node=RaftNodeId [groupId=f6b9512f-b735-446e-85a3-d6b8636c847c_part_4, peer=Peer [consistentId=idt_n_0, idx=0]] with initial configuration=PeersAndLearners [peers=Set12 [Peer [consistentId=idt_n_0, idx=0]], learners=SetN []] 2023-05-08 19:12:53:511 +0300 [INFO][%idt_n_0%JRaft-FSMCaller-Disruptor-_stripe_2-0][StateMachineAdapter] onLeaderStart: term=1. 2023-05-08 19:12:53:512 +0300 [INFO][%idt_n_0%tableManager-io-21][FSMCallerImpl] Starts FSMCaller successfully. 2023-05-08 19:12:53:533 +0300 [INFO][%idt_n_0%tableManager-io-21][NodeImpl] Node init, term=0, lastLogId=LogId [index=0, term=0], conf=idt_n_0, oldConf=. 2023-05-08 19:12:53:534 +0300 [INFO][%idt_n_0%tableManager-io-21][NodeImpl] Node start vote and grant vote self, term=0. 2023-05-08 19:12:53:555 +0300 [INFO][%idt_n_0%tableManager-io-14][LocalRaftMetaStorage] Save raft meta, path=build/work/ItDmlTest/static_555993353560259/idt_n_0/f6b9512f-b735-446e-85a3-d6b8636c847c_part_3_idt_n_0_0/meta, term=1, votedFor=idt_n_0, cost time=44 ms 2023-05-08 19:12:53:556 +0300 [INFO][%idt_n_0%tableManager-io-14][NodeImpl] Node become leader of group, term=1, conf=idt_n_0, oldConf=. 2023-05-08 19:12:53:556 +0300 [INFO][%idt_n_0%tableManager-io-14][RaftGroupService] Start the RaftGroupService successfully 2023-05-08 19:12:53:622 +0300 [INFO][%idt_n_0%JRaft-FSMCaller-Disruptor-_stripe_1-0][StateMachineAdapter] onLeaderStart: term=1. 2023-05-08 19:12:53:643 +0300 [INFO][%idt_n_0%tableManager-io-21][LocalRaftMetaStorage] Save raft meta, path=build/work/ItDmlTest/static_555993353560259/idt_n_0/f6b9512f-b735-446e-85a3-d6b8636c847c_part_4_idt_n_0_0/meta, term=1, votedFor=idt_n_0, cost time=109 ms 2023-05-08 19:12:53:644 +0300 [INFO][%idt_n_0%tableManager-io-21][NodeImpl] Node become leader of group, term=1, conf=idt_n_0, oldConf=. 2023-05-08 19:12:53:644 +0300 [INFO][%idt_n_0%tableManager-io-21][RaftGroupService] Start the RaftGroupService successfully 2023-05-08 19:12:53:667 +0300 [INFO][%idt_n_0%JRaft-FSMCaller-Disruptor-_stripe_0-0][StateMachineAdapter] onLeaderStart: term=1. 2023-05-08 19:12:53:848 +0300 [INFO][%idt_n_0%tableManager-io-1][Loza] Start new raft node=RaftNodeId [groupId=f6b9512f-b735-446e-85a3-d6b8636c847c_part_14, peer=Peer [consistentId=idt_n_0, idx=0]] with initial configuration=PeersAndLearners [peers=Set12 [Peer [consistentId=idt_n_0, idx=0]], learners=SetN []] 2023-05-08 19:12:53:849 +0300 [INFO][%idt_n_0%tableManager-io-1][FSMCallerImpl] Starts FSMCaller successfully. 2023-05-08 19:12:53:850 +0300 [INFO][%idt_n_0%tableManager-io-1][NodeImpl] Node init, term=0, lastLogId=LogId [index=0, term=0], conf=idt_n_0, oldConf=. 2023-05-08 19:12:53:850 +0300 [INFO][%idt_n_0%tableManager-io-1][NodeImpl] Node start vote and grant vote self, term=0. 2023-05-08 19:12:53:915 +0300 [INFO][%idt_n_0%tableManager-io-1][LocalRaftMetaStorage] Save raft meta, path=build/work/ItDmlTest/static_555993353560259/idt_n_0/f6b9512f-b735-446e-85a3-d6b8636c847c_part_14_idt_n_0_0/meta, term=1, votedFor=idt_n_0, cost time=65 ms 2023-05-08 19:12:53:916 +0300 [INFO][%idt_n_0%tableManager-io-1][NodeImpl] Node become leader of group, term=1, conf=idt_n_0, oldConf=. 2023-05-08 19:12:53:937 +0300 [INFO][%idt_n_0%tableManager-io-1][RaftGroupService] Start the RaftGroupService successfully 2023-05-08 19:12:53:962 +0300 [INFO][%idt_n_0%JRaft-FSMCaller-Disruptor-_stripe_3-0][StateMachineAdapter] onLeaderStart: term=1. 2023-05-08 19:12:53:985 +0300 [INFO][%idt_n_0%tableManager-io-12][Loza] Start new raft node=RaftNodeId [groupId=f6b9512f-b735-446e-85a3-d6b8636c847c_part_17, peer=Peer [consistentId=idt_n_0, idx=0]] with initial configuration=PeersAndLearners [peers=Set12 [Peer [consistentId=idt_n_0, idx=0]], learners=SetN []] 2023-05-08 19:12:53:987 +0300 [INFO][%idt_n_0%tableManager-io-12][FSMCallerImpl] Starts FSMCaller successfully. 2023-05-08 19:12:53:987 +0300 [INFO][%idt_n_0%tableManager-io-12][NodeImpl] Node init, term=0, lastLogId=LogId [index=0, term=0], conf=idt_n_0, oldConf=. 2023-05-08 19:12:53:987 +0300 [INFO][%idt_n_0%tableManager-io-12][NodeImpl] Node start vote and grant vote self, term=0. 2023-05-08 19:12:54:053 +0300 [INFO][%idt_n_0%tableManager-io-12][LocalRaftMetaStorage] Save raft meta, path=build/work/ItDmlTest/static_555993353560259/idt_n_0/f6b9512f-b735-446e-85a3-d6b8636c847c_part_17_idt_n_0_0/meta, term=1, votedFor=idt_n_0, cost time=66 ms 2023-05-08 19:12:54:054 +0300 [INFO][%idt_n_0%tableManager-io-12][NodeImpl] Node become leader of group, term=1, conf=idt_n_0, oldConf=. 2023-05-08 19:12:54:074 +0300 [INFO][%idt_n_0%tableManager-io-12][RaftGroupService] Start the RaftGroupService successfully 2023-05-08 19:12:54:075 +0300 [INFO][%idt_n_0%tableManager-io-19][Loza] Start new raft node=RaftNodeId [groupId=f6b9512f-b735-446e-85a3-d6b8636c847c_part_19, peer=Peer [consistentId=idt_n_0, idx=0]] with initial configuration=PeersAndLearners [peers=Set12 [Peer [consistentId=idt_n_0, idx=0]], learners=SetN []] 2023-05-08 19:12:54:096 +0300 [INFO][%idt_n_0%JRaft-FSMCaller-Disruptor-_stripe_0-0][StateMachineAdapter] onLeaderStart: term=1. 2023-05-08 19:12:54:096 +0300 [INFO][%idt_n_0%tableManager-io-19][FSMCallerImpl] Starts FSMCaller successfully. 2023-05-08 19:12:54:097 +0300 [INFO][%idt_n_0%tableManager-io-19][NodeImpl] Node init, term=0, lastLogId=LogId [index=0, term=0], conf=idt_n_0, oldConf=. 2023-05-08 19:12:54:117 +0300 [INFO][%idt_n_0%tableManager-io-19][NodeImpl] Node start vote and grant vote self, term=0. 2023-05-08 19:12:54:118 +0300 [INFO][%idt_n_0%tableManager-io-14][Loza] Start new raft node=RaftNodeId [groupId=f6b9512f-b735-446e-85a3-d6b8636c847c_part_20, peer=Peer [consistentId=idt_n_0, idx=0]] with initial configuration=PeersAndLearners [peers=Set12 [Peer [consistentId=idt_n_0, idx=0]], learners=SetN []] 2023-05-08 19:12:54:141 +0300 [INFO][%idt_n_0%tableManager-io-14][FSMCallerImpl] Starts FSMCaller successfully. 2023-05-08 19:12:54:162 +0300 [INFO][%idt_n_0%tableManager-io-19][LocalRaftMetaStorage] Save raft meta, path=build/work/ItDmlTest/static_555993353560259/idt_n_0/f6b9512f-b735-446e-85a3-d6b8636c847c_part_19_idt_n_0_0/meta, term=1, votedFor=idt_n_0, cost time=45 ms 2023-05-08 19:12:54:163 +0300 [INFO][%idt_n_0%tableManager-io-19][NodeImpl] Node become leader of group, term=1, conf=idt_n_0, oldConf=. 2023-05-08 19:12:54:163 +0300 [INFO][%idt_n_0%tableManager-io-14][NodeImpl] Node init, term=0, lastLogId=LogId [index=0, term=0], conf=idt_n_0, oldConf=. 2023-05-08 19:12:54:184 +0300 [INFO][%idt_n_0%tableManager-io-19][RaftGroupService] Start the RaftGroupService successfully 2023-05-08 19:12:54:184 +0300 [INFO][%idt_n_0%tableManager-io-14][NodeImpl] Node start vote and grant vote self, term=0. 2023-05-08 19:12:54:207 +0300 [INFO][%idt_n_0%JRaft-FSMCaller-Disruptor-_stripe_2-0][StateMachineAdapter] onLeaderStart: term=1. 2023-05-08 19:12:54:251 +0300 [INFO][%idt_n_0%tableManager-io-8][Loza] Start new raft node=RaftNodeId [groupId=f6b9512f-b735-446e-85a3-d6b8636c847c_part_22, peer=Peer [consistentId=idt_n_0, idx=0]] with initial configuration=PeersAndLearners [peers=Set12 [Peer [consistentId=idt_n_0, idx=0]], learners=SetN []] 2023-05-08 19:12:54:271 +0300 [INFO][%idt_n_0%tableManager-io-14][LocalRaftMetaStorage] Save raft meta, path=build/work/ItDmlTest/static_555993353560259/idt_n_0/f6b9512f-b735-446e-85a3-d6b8636c847c_part_20_idt_n_0_0/meta, term=1, votedFor=idt_n_0, cost time=87 ms 2023-05-08 19:12:54:271 +0300 [INFO][%idt_n_0%tableManager-io-14][NodeImpl] Node become leader of group, term=1, conf=idt_n_0, oldConf=. 2023-05-08 19:12:54:272 +0300 [INFO][%idt_n_0%tableManager-io-14][RaftGroupService] Start the RaftGroupService successfully 2023-05-08 19:12:54:272 +0300 [INFO][%idt_n_0%tableManager-io-8][FSMCallerImpl] Starts FSMCaller successfully. 2023-05-08 19:12:54:273 +0300 [INFO][%idt_n_0%tableManager-io-8][NodeImpl] Node init, term=0, lastLogId=LogId [index=0, term=0], conf=idt_n_0, oldConf=. 2023-05-08 19:12:54:273 +0300 [INFO][%idt_n_0%tableManager-io-8][NodeImpl] Node start vote and grant vote self, term=0. 2023-05-08 19:12:54:295 +0300 [INFO][%idt_n_0%JRaft-FSMCaller-Disruptor-_stripe_0-0][StateMachineAdapter] onLeaderStart: term=1. 2023-05-08 19:12:54:295 +0300 [INFO][%idt_n_0%tableManager-io-15][Loza] Start new raft node=RaftNodeId [groupId=f6b9512f-b735-446e-85a3-d6b8636c847c_part_23, peer=Peer [consistentId=idt_n_0, idx=0]] with initial configuration=PeersAndLearners [peers=Set12 [Peer [consistentId=idt_n_0, idx=0]], learners=SetN []] 2023-05-08 19:12:54:317 +0300 [INFO][%idt_n_0%tableManager-io-15][FSMCallerImpl] Starts FSMCaller successfully. 2023-05-08 19:12:54:338 +0300 [INFO][%idt_n_0%tableManager-io-8][LocalRaftMetaStorage] Save raft meta, path=build/work/ItDmlTest/static_555993353560259/idt_n_0/f6b9512f-b735-446e-85a3-d6b8636c847c_part_22_idt_n_0_0/meta, term=1, votedFor=idt_n_0, cost time=65 ms 2023-05-08 19:12:54:338 +0300 [INFO][%idt_n_0%tableManager-io-15][NodeImpl] Node init, term=0, lastLogId=LogId [index=0, term=0], conf=idt_n_0, oldConf=. 2023-05-08 19:12:54:339 +0300 [INFO][%idt_n_0%tableManager-io-8][NodeImpl] Node become leader of group, term=1, conf=idt_n_0, oldConf=. 2023-05-08 19:12:54:339 +0300 [INFO][%idt_n_0%tableManager-io-15][NodeImpl] Node start vote and grant vote self, term=0. 2023-05-08 19:12:54:339 +0300 [INFO][%idt_n_0%tableManager-io-8][RaftGroupService] Start the RaftGroupService successfully 2023-05-08 19:12:54:384 +0300 [INFO][%idt_n_0%JRaft-FSMCaller-Disruptor-_stripe_2-0][StateMachineAdapter] onLeaderStart: term=1. 2023-05-08 19:12:54:425 +0300 [INFO][%idt_n_0%tableManager-io-15][LocalRaftMetaStorage] Save raft meta, path=build/work/ItDmlTest/static_555993353560259/idt_n_0/f6b9512f-b735-446e-85a3-d6b8636c847c_part_23_idt_n_0_0/meta, term=1, votedFor=idt_n_0, cost time=65 ms 2023-05-08 19:12:54:447 +0300 [INFO][%idt_n_0%tableManager-io-15][NodeImpl] Node become leader of group, term=1, conf=idt_n_0, oldConf=. 2023-05-08 19:12:54:468 +0300 [INFO][%idt_n_0%tableManager-io-15][RaftGroupService] Start the RaftGroupService successfully 2023-05-08 19:12:54:492 +0300 [INFO][%idt_n_0%JRaft-FSMCaller-Disruptor-_stripe_1-0][StateMachineAdapter] onLeaderStart: term=1. 2023-05-08 19:12:54:690 +0300 [INFO][%idt_n_1%tableManager-io-12][Loza] Start new raft node=RaftNodeId [groupId=f6b9512f-b735-446e-85a3-d6b8636c847c_part_5, peer=Peer [consistentId=idt_n_1, idx=0]] with initial configuration=PeersAndLearners [peers=Set12 [Peer [consistentId=idt_n_1, idx=0]], learners=SetN []] 2023-05-08 19:12:54:711 +0300 [INFO][%idt_n_1%tableManager-io-12][FSMCallerImpl] Starts FSMCaller successfully. 2023-05-08 19:12:54:711 +0300 [INFO][%idt_n_1%tableManager-io-12][NodeImpl] Node init, term=0, lastLogId=LogId [index=0, term=0], conf=idt_n_1, oldConf=. 2023-05-08 19:12:54:712 +0300 [INFO][%idt_n_1%tableManager-io-12][NodeImpl] Node start vote and grant vote self, term=0. 2023-05-08 19:12:54:736 +0300 [INFO][%idt_n_1%tableManager-io-15][Loza] Start new raft node=RaftNodeId [groupId=f6b9512f-b735-446e-85a3-d6b8636c847c_part_6, peer=Peer [consistentId=idt_n_1, idx=0]] with initial configuration=PeersAndLearners [peers=Set12 [Peer [consistentId=idt_n_1, idx=0]], learners=SetN []] 2023-05-08 19:12:54:800 +0300 [INFO][%idt_n_1%tableManager-io-12][LocalRaftMetaStorage] Save raft meta, path=build/work/ItDmlTest/static_555993353560259/idt_n_1/f6b9512f-b735-446e-85a3-d6b8636c847c_part_5_idt_n_1_0/meta, term=1, votedFor=idt_n_1, cost time=66 ms 2023-05-08 19:12:54:801 +0300 [INFO][%idt_n_1%tableManager-io-12][NodeImpl] Node become leader of group, term=1, conf=idt_n_1, oldConf=. 2023-05-08 19:12:54:801 +0300 [INFO][%idt_n_1%tableManager-io-15][FSMCallerImpl] Starts FSMCaller successfully. 2023-05-08 19:12:54:802 +0300 [INFO][%idt_n_1%tableManager-io-12][RaftGroupService] Start the RaftGroupService successfully 2023-05-08 19:12:54:822 +0300 [INFO][%idt_n_1%tableManager-io-15][NodeImpl] Node init, term=0, lastLogId=LogId [index=0, term=0], conf=idt_n_1, oldConf=. 2023-05-08 19:12:54:824 +0300 [INFO][%idt_n_1%tableManager-io-15][NodeImpl] Node start vote and grant vote self, term=0. 2023-05-08 19:12:54:825 +0300 [INFO][%idt_n_1%tableManager-io-20][Loza] Start new raft node=RaftNodeId [groupId=f6b9512f-b735-446e-85a3-d6b8636c847c_part_7, peer=Peer [consistentId=idt_n_1, idx=0]] with initial configuration=PeersAndLearners [peers=Set12 [Peer [consistentId=idt_n_1, idx=0]], learners=SetN []] 2023-05-08 19:12:54:861 +0300 [INFO][%idt_n_1%JRaft-FSMCaller-Disruptor-_stripe_2-0][StateMachineAdapter] onLeaderStart: term=1. 2023-05-08 19:12:54:884 +0300 [INFO][%idt_n_1%tableManager-io-20][FSMCallerImpl] Starts FSMCaller successfully. 2023-05-08 19:12:54:884 +0300 [INFO][%idt_n_1%tableManager-io-20][NodeImpl] Node init, term=0, lastLogId=LogId [index=0, term=0], conf=idt_n_1, oldConf=. 2023-05-08 19:12:54:906 +0300 [INFO][%idt_n_1%tableManager-io-20][NodeImpl] Node start vote and grant vote self, term=0. 2023-05-08 19:12:54:927 +0300 [INFO][%idt_n_1%tableManager-io-15][LocalRaftMetaStorage] Save raft meta, path=build/work/ItDmlTest/static_555993353560259/idt_n_1/f6b9512f-b735-446e-85a3-d6b8636c847c_part_6_idt_n_1_0/meta, term=1, votedFor=idt_n_1, cost time=66 ms 2023-05-08 19:12:54:928 +0300 [INFO][%idt_n_1%tableManager-io-15][NodeImpl] Node become leader of group, term=1, conf=idt_n_1, oldConf=. 2023-05-08 19:12:54:949 +0300 [INFO][%idt_n_1%tableManager-io-15][RaftGroupService] Start the RaftGroupService successfully 2023-05-08 19:12:54:951 +0300 [INFO][%idt_n_2%tableManager-io-18][Loza] Start new raft node=RaftNodeId [groupId=f6b9512f-b735-446e-85a3-d6b8636c847c_part_8, peer=Peer [consistentId=idt_n_2, idx=0]] with initial configuration=PeersAndLearners [peers=Set12 [Peer [consistentId=idt_n_2, idx=0]], learners=SetN []] 2023-05-08 19:12:54:992 +0300 [INFO][%idt_n_1%JRaft-FSMCaller-Disruptor-_stripe_1-0][StateMachineAdapter] onLeaderStart: term=1. 2023-05-08 19:12:55:033 +0300 [INFO][%idt_n_1%tableManager-io-20][LocalRaftMetaStorage] Save raft meta, path=build/work/ItDmlTest/static_555993353560259/idt_n_1/f6b9512f-b735-446e-85a3-d6b8636c847c_part_7_idt_n_1_0/meta, term=1, votedFor=idt_n_1, cost time=127 ms 2023-05-08 19:12:55:034 +0300 [INFO][%idt_n_1%tableManager-io-20][NodeImpl] Node become leader of group, term=1, conf=idt_n_1, oldConf=. 2023-05-08 19:12:55:055 +0300 [INFO][%idt_n_2%tableManager-io-18][FSMCallerImpl] Starts FSMCaller successfully. 2023-05-08 19:12:55:056 +0300 [INFO][%idt_n_1%tableManager-io-20][RaftGroupService] Start the RaftGroupService successfully 2023-05-08 19:12:55:056 +0300 [INFO][%idt_n_2%tableManager-io-18][NodeImpl] Node init, term=0, lastLogId=LogId [index=0, term=0], conf=idt_n_2, oldConf=. 2023-05-08 19:12:55:079 +0300 [INFO][%idt_n_2%tableManager-io-21][Loza] Start new raft node=RaftNodeId [groupId=f6b9512f-b735-446e-85a3-d6b8636c847c_part_9, peer=Peer [consistentId=idt_n_2, idx=0]] with initial configuration=PeersAndLearners [peers=Set12 [Peer [consistentId=idt_n_2, idx=0]], learners=SetN []] 2023-05-08 19:12:55:101 +0300 [INFO][%idt_n_2%tableManager-io-18][NodeImpl] Node start vote and grant vote self, term=0. 2023-05-08 19:12:55:122 +0300 [INFO][%idt_n_1%JRaft-FSMCaller-Disruptor-_stripe_0-0][StateMachineAdapter] onLeaderStart: term=1. 2023-05-08 19:12:55:165 +0300 [INFO][%idt_n_2%tableManager-io-21][FSMCallerImpl] Starts FSMCaller successfully. 2023-05-08 19:12:55:165 +0300 [INFO][%idt_n_1%tableManager-io-5][Loza] Start new raft node=RaftNodeId [groupId=f6b9512f-b735-446e-85a3-d6b8636c847c_part_10, peer=Peer [consistentId=idt_n_1, idx=0]] with initial configuration=PeersAndLearners [peers=Set12 [Peer [consistentId=idt_n_1, idx=0]], learners=SetN []] 2023-05-08 19:12:55:186 +0300 [INFO][%idt_n_2%tableManager-io-21][NodeImpl] Node init, term=0, lastLogId=LogId [index=0, term=0], conf=idt_n_2, oldConf=. 2023-05-08 19:12:55:228 +0300 [INFO][%idt_n_2%tableManager-io-21][NodeImpl] Node start vote and grant vote self, term=0. 2023-05-08 19:12:55:270 +0300 [INFO][%idt_n_2%tableManager-io-18][LocalRaftMetaStorage] Save raft meta, path=build/work/ItDmlTest/static_555993353560259/idt_n_2/f6b9512f-b735-446e-85a3-d6b8636c847c_part_8_idt_n_2_0/meta, term=1, votedFor=idt_n_2, cost time=148 ms 2023-05-08 19:12:55:271 +0300 [INFO][%idt_n_2%tableManager-io-18][NodeImpl] Node become leader of group, term=1, conf=idt_n_2, oldConf=. 2023-05-08 19:12:55:292 +0300 [INFO][%idt_n_1%tableManager-io-5][FSMCallerImpl] Starts FSMCaller successfully. 2023-05-08 19:12:55:292 +0300 [INFO][%idt_n_2%tableManager-io-18][RaftGroupService] Start the RaftGroupService successfully 2023-05-08 19:12:55:293 +0300 [INFO][%idt_n_1%tableManager-io-5][NodeImpl] Node init, term=0, lastLogId=LogId [index=0, term=0], conf=idt_n_1, oldConf=. 2023-05-08 19:12:55:315 +0300 [INFO][%idt_n_1%tableManager-io-5][NodeImpl] Node start vote and grant vote self, term=0. 2023-05-08 19:12:55:358 +0300 [INFO][%idt_n_2%JRaft-FSMCaller-Disruptor-_stripe_2-0][StateMachineAdapter] onLeaderStart: term=1. 2023-05-08 19:12:55:381 +0300 [INFO][%idt_n_2%tableManager-io-1][Loza] Start new raft node=RaftNodeId [groupId=f6b9512f-b735-446e-85a3-d6b8636c847c_part_11, peer=Peer [consistentId=idt_n_2, idx=0]] with initial configuration=PeersAndLearners [peers=Set12 [Peer [consistentId=idt_n_2, idx=0]], learners=SetN []] 2023-05-08 19:12:55:401 +0300 [INFO][%idt_n_2%tableManager-io-21][LocalRaftMetaStorage] Save raft meta, path=build/work/ItDmlTest/static_555993353560259/idt_n_2/f6b9512f-b735-446e-85a3-d6b8636c847c_part_9_idt_n_2_0/meta, term=1, votedFor=idt_n_2, cost time=151 ms 2023-05-08 19:12:55:402 +0300 [INFO][%idt_n_2%tableManager-io-21][NodeImpl] Node become leader of group, term=1, conf=idt_n_2, oldConf=. 2023-05-08 19:12:55:402 +0300 [INFO][%idt_n_2%tableManager-io-21][RaftGroupService] Start the RaftGroupService successfully 2023-05-08 19:12:55:423 +0300 [INFO][%idt_n_2%tableManager-io-1][FSMCallerImpl] Starts FSMCaller successfully. 2023-05-08 19:12:55:423 +0300 [INFO][%idt_n_1%tableManager-io-9][Loza] Start new raft node=RaftNodeId [groupId=f6b9512f-b735-446e-85a3-d6b8636c847c_part_12, peer=Peer [consistentId=idt_n_1, idx=0]] with initial configuration=PeersAndLearners [peers=Set12 [Peer [consistentId=idt_n_1, idx=0]], learners=SetN []] 2023-05-08 19:12:55:445 +0300 [INFO][%idt_n_2%tableManager-io-1][NodeImpl] Node init, term=0, lastLogId=LogId [index=0, term=0], conf=idt_n_2, oldConf=. 2023-05-08 19:12:55:446 +0300 [INFO][%idt_n_2%JRaft-FSMCaller-Disruptor-_stripe_1-0][StateMachineAdapter] onLeaderStart: term=1. 2023-05-08 19:12:55:465 +0300 [INFO][%idt_n_1%tableManager-io-5][LocalRaftMetaStorage] Save raft meta, path=build/work/ItDmlTest/static_555993353560259/idt_n_1/f6b9512f-b735-446e-85a3-d6b8636c847c_part_10_idt_n_1_0/meta, term=1, votedFor=idt_n_1, cost time=128 ms 2023-05-08 19:12:55:466 +0300 [INFO][%idt_n_1%tableManager-io-5][NodeImpl] Node become leader of group, term=1, conf=idt_n_1, oldConf=. 2023-05-08 19:12:55:488 +0300 [INFO][%idt_n_1%tableManager-io-5][RaftGroupService] Start the RaftGroupService successfully 2023-05-08 19:12:55:488 +0300 [INFO][%idt_n_2%tableManager-io-1][NodeImpl] Node start vote and grant vote self, term=0. 2023-05-08 19:12:55:510 +0300 [INFO][%idt_n_1%tableManager-io-12][Loza] Start new raft node=RaftNodeId [groupId=f6b9512f-b735-446e-85a3-d6b8636c847c_part_13, peer=Peer [consistentId=idt_n_1, idx=0]] with initial configuration=PeersAndLearners [peers=Set12 [Peer [consistentId=idt_n_1, idx=0]], learners=SetN []] 2023-05-08 19:12:55:532 +0300 [INFO][%idt_n_1%tableManager-io-9][FSMCallerImpl] Starts FSMCaller successfully. 2023-05-08 19:12:55:533 +0300 [INFO][%idt_n_1%tableManager-io-9][NodeImpl] Node init, term=0, lastLogId=LogId [index=0, term=0], conf=idt_n_1, oldConf=. 2023-05-08 19:12:55:533 +0300 [INFO][%idt_n_1%JRaft-FSMCaller-Disruptor-_stripe_2-0][StateMachineAdapter] onLeaderStart: term=1. 2023-05-08 19:12:55:533 +0300 [INFO][%idt_n_1%tableManager-io-12][FSMCallerImpl] Starts FSMCaller successfully. 2023-05-08 19:12:55:533 +0300 [INFO][%idt_n_1%tableManager-io-9][NodeImpl] Node start vote and grant vote self, term=0. 2023-05-08 19:12:55:599 +0300 [INFO][%idt_n_1%tableManager-io-12][NodeImpl] Node init, term=0, lastLogId=LogId [index=0, term=0], conf=idt_n_1, oldConf=. 2023-05-08 19:12:55:619 +0300 [INFO][%idt_n_2%tableManager-io-1][LocalRaftMetaStorage] Save raft meta, path=build/work/ItDmlTest/static_555993353560259/idt_n_2/f6b9512f-b735-446e-85a3-d6b8636c847c_part_11_idt_n_2_0/meta, term=1, votedFor=idt_n_2, cost time=131 ms 2023-05-08 19:12:55:619 +0300 [INFO][%idt_n_2%tableManager-io-1][NodeImpl] Node become leader of group, term=1, conf=idt_n_2, oldConf=. 2023-05-08 19:12:55:619 +0300 [INFO][%idt_n_1%tableManager-io-12][NodeImpl] Node start vote and grant vote self, term=0. 2023-05-08 19:12:55:620 +0300 [INFO][%idt_n_2%tableManager-io-1][RaftGroupService] Start the RaftGroupService successfully 2023-05-08 19:12:55:678 +0300 [INFO][%idt_n_2%JRaft-FSMCaller-Disruptor-_stripe_0-0][StateMachineAdapter] onLeaderStart: term=1. 2023-05-08 19:12:55:719 +0300 [INFO][%idt_n_1%tableManager-io-9][LocalRaftMetaStorage] Save raft meta, path=build/work/ItDmlTest/static_555993353560259/idt_n_1/f6b9512f-b735-446e-85a3-d6b8636c847c_part_12_idt_n_1_0/meta, term=1, votedFor=idt_n_1, cost time=141 ms 2023-05-08 19:12:55:720 +0300 [INFO][%idt_n_1%tableManager-io-9][NodeImpl] Node become leader of group, term=1, conf=idt_n_1, oldConf=. 2023-05-08 19:12:55:720 +0300 [INFO][%idt_n_1%tableManager-io-9][RaftGroupService] Start the RaftGroupService successfully 2023-05-08 19:12:55:764 +0300 [INFO][%idt_n_1%JRaft-FSMCaller-Disruptor-_stripe_0-0][StateMachineAdapter] onLeaderStart: term=1. 2023-05-08 19:12:55:785 +0300 [INFO][%idt_n_2%tableManager-io-15][Loza] Start new raft node=RaftNodeId [groupId=f6b9512f-b735-446e-85a3-d6b8636c847c_part_15, peer=Peer [consistentId=idt_n_2, idx=0]] with initial configuration=PeersAndLearners [peers=Set12 [Peer [consistentId=idt_n_2, idx=0]], learners=SetN []] 2023-05-08 19:12:55:805 +0300 [INFO][%idt_n_1%tableManager-io-12][LocalRaftMetaStorage] Save raft meta, path=build/work/ItDmlTest/static_555993353560259/idt_n_1/f6b9512f-b735-446e-85a3-d6b8636c847c_part_13_idt_n_1_0/meta, term=1, votedFor=idt_n_1, cost time=185 ms 2023-05-08 19:12:55:806 +0300 [INFO][%idt_n_1%tableManager-io-12][NodeImpl] Node become leader of group, term=1, conf=idt_n_1, oldConf=. 2023-05-08 19:12:55:806 +0300 [INFO][%idt_n_1%tableManager-io-12][RaftGroupService] Start the RaftGroupService successfully 2023-05-08 19:12:55:827 +0300 [INFO][%idt_n_2%tableManager-io-15][FSMCallerImpl] Starts FSMCaller successfully. 2023-05-08 19:12:55:827 +0300 [INFO][%idt_n_1%tableManager-io-4][Loza] Start new raft node=RaftNodeId [groupId=f6b9512f-b735-446e-85a3-d6b8636c847c_part_16, peer=Peer [consistentId=idt_n_1, idx=0]] with initial configuration=PeersAndLearners [peers=Set12 [Peer [consistentId=idt_n_1, idx=0]], learners=SetN []] 2023-05-08 19:12:55:848 +0300 [INFO][%idt_n_2%tableManager-io-15][NodeImpl] Node init, term=0, lastLogId=LogId [index=0, term=0], conf=idt_n_2, oldConf=. 2023-05-08 19:12:55:848 +0300 [INFO][%idt_n_1%JRaft-FSMCaller-Disruptor-_stripe_3-0][StateMachineAdapter] onLeaderStart: term=1. 2023-05-08 19:12:55:869 +0300 [INFO][%idt_n_2%tableManager-io-15][NodeImpl] Node start vote and grant vote self, term=0. 2023-05-08 19:12:55:869 +0300 [INFO][%idt_n_1%tableManager-io-4][FSMCallerImpl] Starts FSMCaller successfully. 2023-05-08 19:12:55:870 +0300 [INFO][%idt_n_1%tableManager-io-4][NodeImpl] Node init, term=0, lastLogId=LogId [index=0, term=0], conf=idt_n_1, oldConf=. 2023-05-08 19:12:55:892 +0300 [INFO][%idt_n_1%tableManager-io-4][NodeImpl] Node start vote and grant vote self, term=0. 2023-05-08 19:12:55:956 +0300 [INFO][%idt_n_2%tableManager-io-15][LocalRaftMetaStorage] Save raft meta, path=build/work/ItDmlTest/static_555993353560259/idt_n_2/f6b9512f-b735-446e-85a3-d6b8636c847c_part_15_idt_n_2_0/meta, term=1, votedFor=idt_n_2, cost time=87 ms 2023-05-08 19:12:55:957 +0300 [INFO][%idt_n_2%tableManager-io-15][NodeImpl] Node become leader of group, term=1, conf=idt_n_2, oldConf=. 2023-05-08 19:12:55:978 +0300 [INFO][%idt_n_1%tableManager-io-4][LocalRaftMetaStorage] Save raft meta, path=build/work/ItDmlTest/static_555993353560259/idt_n_1/f6b9512f-b735-446e-85a3-d6b8636c847c_part_16_idt_n_1_0/meta, term=1, votedFor=idt_n_1, cost time=86 ms 2023-05-08 19:12:55:980 +0300 [INFO][%idt_n_2%tableManager-io-15][RaftGroupService] Start the RaftGroupService successfully 2023-05-08 19:12:56:000 +0300 [INFO][%idt_n_1%tableManager-io-4][NodeImpl] Node become leader of group, term=1, conf=idt_n_1, oldConf=. 2023-05-08 19:12:56:023 +0300 [INFO][%idt_n_1%tableManager-io-4][RaftGroupService] Start the RaftGroupService successfully 2023-05-08 19:12:56:023 +0300 [INFO][%idt_n_2%tableManager-io-2][Loza] Start new raft node=RaftNodeId [groupId=f6b9512f-b735-446e-85a3-d6b8636c847c_part_18, peer=Peer [consistentId=idt_n_2, idx=0]] with initial configuration=PeersAndLearners [peers=Set12 [Peer [consistentId=idt_n_2, idx=0]], learners=SetN []] 2023-05-08 19:12:56:065 +0300 [INFO][%idt_n_2%JRaft-FSMCaller-Disruptor-_stripe_0-0][StateMachineAdapter] onLeaderStart: term=1. 2023-05-08 19:12:56:086 +0300 [INFO][%idt_n_1%JRaft-FSMCaller-Disruptor-_stripe_0-0][StateMachineAdapter] onLeaderStart: term=1. 2023-05-08 19:12:56:129 +0300 [INFO][%idt_n_2%tableManager-io-2][FSMCallerImpl] Starts FSMCaller successfully. 2023-05-08 19:12:56:151 +0300 [INFO][%idt_n_2%tableManager-io-2][NodeImpl] Node init, term=0, lastLogId=LogId [index=0, term=0], conf=idt_n_2, oldConf=. 2023-05-08 19:12:56:173 +0300 [INFO][%idt_n_2%tableManager-io-2][NodeImpl] Node start vote and grant vote self, term=0. 2023-05-08 19:12:56:325 +0300 [INFO][%idt_n_2%tableManager-io-2][LocalRaftMetaStorage] Save raft meta, path=build/work/ItDmlTest/static_555993353560259/idt_n_2/f6b9512f-b735-446e-85a3-d6b8636c847c_part_18_idt_n_2_0/meta, term=1, votedFor=idt_n_2, cost time=152 ms 2023-05-08 19:12:56:326 +0300 [INFO][%idt_n_2%tableManager-io-2][NodeImpl] Node become leader of group, term=1, conf=idt_n_2, oldConf=. 2023-05-08 19:12:56:347 +0300 [INFO][%idt_n_2%tableManager-io-2][RaftGroupService] Start the RaftGroupService successfully 2023-05-08 19:12:56:391 +0300 [INFO][%idt_n_1%tableManager-io-23][Loza] Start new raft node=RaftNodeId [groupId=f6b9512f-b735-446e-85a3-d6b8636c847c_part_21, peer=Peer [consistentId=idt_n_1, idx=0]] with initial configuration=PeersAndLearners [peers=Set12 [Peer [consistentId=idt_n_1, idx=0]], learners=SetN []] 2023-05-08 19:12:56:429 +0300 [INFO][%idt_n_2%JRaft-FSMCaller-Disruptor-_stripe_1-0][StateMachineAdapter] onLeaderStart: term=1. 2023-05-08 19:12:56:430 +0300 [INFO][%idt_n_1%tableManager-io-23][FSMCallerImpl] Starts FSMCaller successfully. 2023-05-08 19:12:56:451 +0300 [INFO][%idt_n_1%tableManager-io-23][NodeImpl] Node init, term=0, lastLogId=LogId [index=0, term=0], conf=idt_n_1, oldConf=. 2023-05-08 19:12:56:452 +0300 [INFO][%idt_n_1%tableManager-io-23][NodeImpl] Node start vote and grant vote self, term=0. 2023-05-08 19:12:56:538 +0300 [INFO][%idt_n_1%tableManager-io-23][LocalRaftMetaStorage] Save raft meta, path=build/work/ItDmlTest/static_555993353560259/idt_n_1/f6b9512f-b735-446e-85a3-d6b8636c847c_part_21_idt_n_1_0/meta, term=1, votedFor=idt_n_1, cost time=87 ms 2023-05-08 19:12:56:539 +0300 [INFO][%idt_n_1%tableManager-io-23][NodeImpl] Node become leader of group, term=1, conf=idt_n_1, oldConf=. 2023-05-08 19:12:56:539 +0300 [INFO][%idt_n_1%tableManager-io-23][RaftGroupService] Start the RaftGroupService successfully 2023-05-08 19:12:56:582 +0300 [INFO][%idt_n_1%JRaft-FSMCaller-Disruptor-_stripe_2-0][StateMachineAdapter] onLeaderStart: term=1. 2023-05-08 19:12:56:604 +0300 [INFO][%idt_n_1%tableManager-io-11][Loza] Start new raft node=RaftNodeId [groupId=f6b9512f-b735-446e-85a3-d6b8636c847c_part_24, peer=Peer [consistentId=idt_n_1, idx=0]] with initial configuration=PeersAndLearners [peers=Set12 [Peer [consistentId=idt_n_1, idx=0]], learners=SetN []] 2023-05-08 19:12:56:605 +0300 [INFO][%idt_n_1%tableManager-io-11][FSMCallerImpl] Starts FSMCaller successfully. 2023-05-08 19:12:56:611 +0300 [INFO][%idt_n_1%tableManager-io-11][NodeImpl] Node init, term=0, lastLogId=LogId [index=0, term=0], conf=idt_n_1, oldConf=. 2023-05-08 19:12:56:611 +0300 [INFO][%idt_n_1%tableManager-io-11][NodeImpl] Node start vote and grant vote self, term=0. 2023-05-08 19:12:56:655 +0300 [INFO][%idt_n_1%tableManager-io-11][LocalRaftMetaStorage] Save raft meta, path=build/work/ItDmlTest/static_555993353560259/idt_n_1/f6b9512f-b735-446e-85a3-d6b8636c847c_part_24_idt_n_1_0/meta, term=1, votedFor=idt_n_1, cost time=44 ms 2023-05-08 19:12:56:655 +0300 [INFO][%idt_n_1%tableManager-io-11][NodeImpl] Node become leader of group, term=1, conf=idt_n_1, oldConf=. 2023-05-08 19:12:56:656 +0300 [INFO][%idt_n_1%tableManager-io-11][RaftGroupService] Start the RaftGroupService successfully 2023-05-08 19:12:56:678 +0300 [INFO][%idt_n_1%JRaft-FSMCaller-Disruptor-_stripe_3-0][StateMachineAdapter] onLeaderStart: term=1. 2023-05-08 19:12:56:831 +0300 [INFO][%idt_n_1%build-index-11][IndexBuilder] Start building the index: [table=T, tableId=f6b9512f-b735-446e-85a3-d6b8636c847c, partitionId=5, index=T_PK, indexId=b32970d1-42dd-426e-b965-13a0f1a9bb04] 2023-05-08 19:12:56:831 +0300 [INFO][%idt_n_1%build-index-10][IndexBuilder] Start building the index: [table=T, tableId=f6b9512f-b735-446e-85a3-d6b8636c847c, partitionId=16, index=T_PK, indexId=b32970d1-42dd-426e-b965-13a0f1a9bb04] 2023-05-08 19:12:56:832 +0300 [INFO][%idt_n_1%build-index-2][IndexBuilder] Start building the index: [table=T, tableId=f6b9512f-b735-446e-85a3-d6b8636c847c, partitionId=12, index=T_PK, indexId=b32970d1-42dd-426e-b965-13a0f1a9bb04] 2023-05-08 19:12:56:832 +0300 [INFO][%idt_n_1%build-index-8][IndexBuilder] Start building the index: [table=T, tableId=f6b9512f-b735-446e-85a3-d6b8636c847c, partitionId=21, index=T_PK, indexId=b32970d1-42dd-426e-b965-13a0f1a9bb04] 2023-05-08 19:12:56:831 +0300 [INFO][%idt_n_1%build-index-6][IndexBuilder] Start building the index: [table=T, tableId=f6b9512f-b735-446e-85a3-d6b8636c847c, partitionId=13, index=T_PK, indexId=b32970d1-42dd-426e-b965-13a0f1a9bb04] 2023-05-08 19:12:56:832 +0300 [INFO][%idt_n_1%build-index-7][IndexBuilder] Start building the index: [table=T, tableId=f6b9512f-b735-446e-85a3-d6b8636c847c, partitionId=10, index=T_PK, indexId=b32970d1-42dd-426e-b965-13a0f1a9bb04] 2023-05-08 19:12:56:832 +0300 [INFO][%idt_n_1%build-index-3][IndexBuilder] Start building the index: [table=T, tableId=f6b9512f-b735-446e-85a3-d6b8636c847c, partitionId=7, index=T_PK, indexId=b32970d1-42dd-426e-b965-13a0f1a9bb04] 2023-05-08 19:12:56:832 +0300 [INFO][%idt_n_1%build-index-9][IndexBuilder] Start building the index: [table=T, tableId=f6b9512f-b735-446e-85a3-d6b8636c847c, partitionId=24, index=T_PK, indexId=b32970d1-42dd-426e-b965-13a0f1a9bb04] 2023-05-08 19:12:56:832 +0300 [INFO][%idt_n_1%build-index-1][IndexBuilder] Start building the index: [table=T, tableId=f6b9512f-b735-446e-85a3-d6b8636c847c, partitionId=6, index=T_PK, indexId=b32970d1-42dd-426e-b965-13a0f1a9bb04] 2023-05-08 19:12:56:834 +0300 [INFO][%idt_n_0%build-index-1][IndexBuilder] Start building the index: [table=T, tableId=f6b9512f-b735-446e-85a3-d6b8636c847c, partitionId=0, index=T_PK, indexId=b32970d1-42dd-426e-b965-13a0f1a9bb04] 2023-05-08 19:12:56:834 +0300 [INFO][%idt_n_1%vault-2][IndexManager] Index created [schema=PUBLIC, table=T, index=T_PK, indexId=b32970d1-42dd-426e-b965-13a0f1a9bb04] 2023-05-08 19:12:56:835 +0300 [INFO][%idt_n_0%build-index-4][IndexBuilder] Start building the index: [table=T, tableId=f6b9512f-b735-446e-85a3-d6b8636c847c, partitionId=1, index=T_PK, indexId=b32970d1-42dd-426e-b965-13a0f1a9bb04] 2023-05-08 19:12:56:836 +0300 [INFO][%idt_n_0%build-index-6][IndexBuilder] Start building the index: [table=T, tableId=f6b9512f-b735-446e-85a3-d6b8636c847c, partitionId=2, index=T_PK, indexId=b32970d1-42dd-426e-b965-13a0f1a9bb04] 2023-05-08 19:12:56:836 +0300 [INFO][%idt_n_0%build-index-7][IndexBuilder] Start building the index: [table=T, tableId=f6b9512f-b735-446e-85a3-d6b8636c847c, partitionId=3, index=T_PK, indexId=b32970d1-42dd-426e-b965-13a0f1a9bb04] 2023-05-08 19:12:56:837 +0300 [INFO][%idt_n_0%build-index-9][IndexBuilder] Start building the index: [table=T, tableId=f6b9512f-b735-446e-85a3-d6b8636c847c, partitionId=4, index=T_PK, indexId=b32970d1-42dd-426e-b965-13a0f1a9bb04] 2023-05-08 19:12:56:839 +0300 [INFO][%idt_n_2%build-index-2][IndexBuilder] Start building the index: [table=T, tableId=f6b9512f-b735-446e-85a3-d6b8636c847c, partitionId=8, index=T_PK, indexId=b32970d1-42dd-426e-b965-13a0f1a9bb04] 2023-05-08 19:12:56:839 +0300 [INFO][%idt_n_2%build-index-3][IndexBuilder] Start building the index: [table=T, tableId=f6b9512f-b735-446e-85a3-d6b8636c847c, partitionId=9, index=T_PK, indexId=b32970d1-42dd-426e-b965-13a0f1a9bb04] 2023-05-08 19:12:56:840 +0300 [INFO][%idt_n_2%build-index-6][IndexBuilder] Start building the index: [table=T, tableId=f6b9512f-b735-446e-85a3-d6b8636c847c, partitionId=11, index=T_PK, indexId=b32970d1-42dd-426e-b965-13a0f1a9bb04] 2023-05-08 19:12:56:842 +0300 [INFO][%idt_n_0%build-index-2][IndexBuilder] Start building the index: [table=T, tableId=f6b9512f-b735-446e-85a3-d6b8636c847c, partitionId=14, index=T_PK, indexId=b32970d1-42dd-426e-b965-13a0f1a9bb04] 2023-05-08 19:12:56:843 +0300 [INFO][%idt_n_2%build-index-3][IndexBuilder] Start building the index: [table=T, tableId=f6b9512f-b735-446e-85a3-d6b8636c847c, partitionId=15, index=T_PK, indexId=b32970d1-42dd-426e-b965-13a0f1a9bb04] 2023-05-08 19:12:56:843 +0300 [INFO][%idt_n_0%build-index-0][IndexBuilder] Start building the index: [table=T, tableId=f6b9512f-b735-446e-85a3-d6b8636c847c, partitionId=17, index=T_PK, indexId=b32970d1-42dd-426e-b965-13a0f1a9bb04] 2023-05-08 19:12:56:843 +0300 [INFO][%idt_n_2%build-index-5][IndexBuilder] Start building the index: [table=T, tableId=f6b9512f-b735-446e-85a3-d6b8636c847c, partitionId=18, index=T_PK, indexId=b32970d1-42dd-426e-b965-13a0f1a9bb04] 2023-05-08 19:12:56:844 +0300 [INFO][%idt_n_0%build-index-0][IndexBuilder] Start building the index: [table=T, tableId=f6b9512f-b735-446e-85a3-d6b8636c847c, partitionId=19, index=T_PK, indexId=b32970d1-42dd-426e-b965-13a0f1a9bb04] 2023-05-08 19:12:56:844 +0300 [INFO][%idt_n_0%build-index-0][IndexBuilder] Start building the index: [table=T, tableId=f6b9512f-b735-446e-85a3-d6b8636c847c, partitionId=22, index=T_PK, indexId=b32970d1-42dd-426e-b965-13a0f1a9bb04] 2023-05-08 19:12:56:844 +0300 [INFO][%idt_n_0%build-index-4][IndexBuilder] Start building the index: [table=T, tableId=f6b9512f-b735-446e-85a3-d6b8636c847c, partitionId=20, index=T_PK, indexId=b32970d1-42dd-426e-b965-13a0f1a9bb04] 2023-05-08 19:12:56:844 +0300 [INFO][%idt_n_0%build-index-0][IndexBuilder] Start building the index: [table=T, tableId=f6b9512f-b735-446e-85a3-d6b8636c847c, partitionId=23, index=T_PK, indexId=b32970d1-42dd-426e-b965-13a0f1a9bb04] Iteration 1 started 2023-05-08 19:12:56:870 +0300 [INFO][%idt_n_1%JRaft-FSMCaller-Disruptor-_stripe_2-0][PartitionListener] Finish building the index: [tableId=f6b9512f-b735-446e-85a3-d6b8636c847c, partitionId=5, indexId=b32970d1-42dd-426e-b965-13a0f1a9bb04] 2023-05-08 19:12:56:888 +0300 [INFO][%idt_n_0%JRaft-FSMCaller-Disruptor-_stripe_3-0][PartitionListener] Finish building the index: [tableId=f6b9512f-b735-446e-85a3-d6b8636c847c, partitionId=1, indexId=b32970d1-42dd-426e-b965-13a0f1a9bb04] 2023-05-08 19:12:56:888 +0300 [INFO][%idt_n_2%JRaft-FSMCaller-Disruptor-_stripe_2-0][PartitionListener] Finish building the index: [tableId=f6b9512f-b735-446e-85a3-d6b8636c847c, partitionId=8, indexId=b32970d1-42dd-426e-b965-13a0f1a9bb04] 2023-05-08 19:12:56:909 +0300 [INFO][%idt_n_1%JRaft-FSMCaller-Disruptor-_stripe_0-0][PartitionListener] Finish building the index: [tableId=f6b9512f-b735-446e-85a3-d6b8636c847c, partitionId=16, indexId=b32970d1-42dd-426e-b965-13a0f1a9bb04] 2023-05-08 19:12:56:909 +0300 [INFO][%idt_n_1%JRaft-FSMCaller-Disruptor-_stripe_1-0][PartitionListener] Finish building the index: [tableId=f6b9512f-b735-446e-85a3-d6b8636c847c, partitionId=6, indexId=b32970d1-42dd-426e-b965-13a0f1a9bb04] 2023-05-08 19:12:56:909 +0300 [INFO][%idt_n_1%JRaft-FSMCaller-Disruptor-_stripe_3-0][PartitionListener] Finish building the index: [tableId=f6b9512f-b735-446e-85a3-d6b8636c847c, partitionId=13, indexId=b32970d1-42dd-426e-b965-13a0f1a9bb04] 2023-05-08 19:12:56:930 +0300 [INFO][%idt_n_2%JRaft-FSMCaller-Disruptor-_stripe_1-0][PartitionListener] Finish building the index: [tableId=f6b9512f-b735-446e-85a3-d6b8636c847c, partitionId=9, indexId=b32970d1-42dd-426e-b965-13a0f1a9bb04] 2023-05-08 19:12:56:930 +0300 [INFO][%idt_n_2%JRaft-FSMCaller-Disruptor-_stripe_0-0][PartitionListener] Finish building the index: [tableId=f6b9512f-b735-446e-85a3-d6b8636c847c, partitionId=11, indexId=b32970d1-42dd-426e-b965-13a0f1a9bb04] 2023-05-08 19:12:56:930 +0300 [INFO][%idt_n_0%JRaft-FSMCaller-Disruptor-_stripe_1-0][PartitionListener] Finish building the index: [tableId=f6b9512f-b735-446e-85a3-d6b8636c847c, partitionId=3, indexId=b32970d1-42dd-426e-b965-13a0f1a9bb04] 2023-05-08 19:12:56:930 +0300 [INFO][%idt_n_0%JRaft-FSMCaller-Disruptor-_stripe_2-0][PartitionListener] Finish building the index: [tableId=f6b9512f-b735-446e-85a3-d6b8636c847c, partitionId=2, indexId=b32970d1-42dd-426e-b965-13a0f1a9bb04] 2023-05-08 19:12:56:930 +0300 [INFO][%idt_n_0%JRaft-FSMCaller-Disruptor-_stripe_0-0][PartitionListener] Finish building the index: [tableId=f6b9512f-b735-446e-85a3-d6b8636c847c, partitionId=4, indexId=b32970d1-42dd-426e-b965-13a0f1a9bb04] 2023-05-08 19:12:56:951 +0300 [INFO][%idt_n_1%JRaft-FSMCaller-Disruptor-_stripe_2-0][PartitionListener] Finish building the index: [tableId=f6b9512f-b735-446e-85a3-d6b8636c847c, partitionId=21, indexId=b32970d1-42dd-426e-b965-13a0f1a9bb04] 2023-05-08 19:12:56:972 +0300 [INFO][%idt_n_0%JRaft-FSMCaller-Disruptor-_stripe_3-0][PartitionListener] Finish building the index: [tableId=f6b9512f-b735-446e-85a3-d6b8636c847c, partitionId=14, indexId=b32970d1-42dd-426e-b965-13a0f1a9bb04] 2023-05-08 19:12:56:972 +0300 [INFO][%idt_n_2%JRaft-FSMCaller-Disruptor-_stripe_1-0][PartitionListener] Finish building the index: [tableId=f6b9512f-b735-446e-85a3-d6b8636c847c, partitionId=18, indexId=b32970d1-42dd-426e-b965-13a0f1a9bb04] 2023-05-08 19:12:56:993 +0300 [INFO][%idt_n_1%JRaft-FSMCaller-Disruptor-_stripe_0-0][PartitionListener] Finish building the index: [tableId=f6b9512f-b735-446e-85a3-d6b8636c847c, partitionId=12, indexId=b32970d1-42dd-426e-b965-13a0f1a9bb04] 2023-05-08 19:12:56:993 +0300 [INFO][%idt_n_1%JRaft-FSMCaller-Disruptor-_stripe_3-0][PartitionListener] Finish building the index: [tableId=f6b9512f-b735-446e-85a3-d6b8636c847c, partitionId=24, indexId=b32970d1-42dd-426e-b965-13a0f1a9bb04] 2023-05-08 19:12:57:014 +0300 [INFO][%idt_n_2%JRaft-FSMCaller-Disruptor-_stripe_0-0][PartitionListener] Finish building the index: [tableId=f6b9512f-b735-446e-85a3-d6b8636c847c, partitionId=15, indexId=b32970d1-42dd-426e-b965-13a0f1a9bb04] 2023-05-08 19:12:57:035 +0300 [INFO][%idt_n_0%JRaft-FSMCaller-Disruptor-_stripe_1-0][PartitionListener] Finish building the index: [tableId=f6b9512f-b735-446e-85a3-d6b8636c847c, partitionId=23, indexId=b32970d1-42dd-426e-b965-13a0f1a9bb04] 2023-05-08 19:12:57:035 +0300 [INFO][%idt_n_0%JRaft-FSMCaller-Disruptor-_stripe_2-0][PartitionListener] Finish building the index: [tableId=f6b9512f-b735-446e-85a3-d6b8636c847c, partitionId=19, indexId=b32970d1-42dd-426e-b965-13a0f1a9bb04] 2023-05-08 19:12:57:035 +0300 [INFO][%idt_n_0%JRaft-FSMCaller-Disruptor-_stripe_0-0][PartitionListener] Finish building the index: [tableId=f6b9512f-b735-446e-85a3-d6b8636c847c, partitionId=0, indexId=b32970d1-42dd-426e-b965-13a0f1a9bb04] 2023-05-08 19:12:57:056 +0300 [INFO][%idt_n_1%JRaft-FSMCaller-Disruptor-_stripe_2-0][PartitionListener] Finish building the index: [tableId=f6b9512f-b735-446e-85a3-d6b8636c847c, partitionId=10, indexId=b32970d1-42dd-426e-b965-13a0f1a9bb04] 2023-05-08 19:12:57:098 +0300 [INFO][%idt_n_1%JRaft-FSMCaller-Disruptor-_stripe_0-0][PartitionListener] Finish building the index: [tableId=f6b9512f-b735-446e-85a3-d6b8636c847c, partitionId=7, indexId=b32970d1-42dd-426e-b965-13a0f1a9bb04] 2023-05-08 19:12:57:135 +0300 [INFO][%idt_n_0%JRaft-FSMCaller-Disruptor-_stripe_2-0][PartitionListener] Finish building the index: [tableId=f6b9512f-b735-446e-85a3-d6b8636c847c, partitionId=22, indexId=b32970d1-42dd-426e-b965-13a0f1a9bb04] 2023-05-08 19:12:57:135 +0300 [INFO][%idt_n_0%JRaft-FSMCaller-Disruptor-_stripe_0-0][PartitionListener] Finish building the index: [tableId=f6b9512f-b735-446e-85a3-d6b8636c847c, partitionId=17, indexId=b32970d1-42dd-426e-b965-13a0f1a9bb04] 2023-05-08 19:12:57:284 +0300 [INFO][%idt_n_0%JRaft-FSMCaller-Disruptor-_stripe_0-0][PartitionListener] Finish building the index: [tableId=f6b9512f-b735-446e-85a3-d6b8636c847c, partitionId=20, indexId=b32970d1-42dd-426e-b965-13a0f1a9bb04] IgniteProject(ROWCOUNT=[CAST($0):BIGINT NOT NULL]) IgniteColocatedHashAggregate(group=[{}], agg#0=[$SUM0($0)]) IgniteExchange(distribution=[single]) IgniteTableModify(table=[[PUBLIC, T]], operation=[INSERT], flattened=[false]) IgniteExchange(distribution=[affinity[tableId=f6b9512f-b735-446e-85a3-d6b8636c847c, zoneId=f6b9512f-b735-446e-85a3-d6b8636c847c][0]]) IgniteProject(ID=[?0], NAME=[?1], SURNAME=[?2], AGE=[?3]) IgniteValues(tuples=[[{ 0 }]]) 10 rows inserted. dT=PT3.531S 20 rows inserted. dT=PT1.01S 30 rows inserted. dT=PT1.086S 40 rows inserted. dT=PT1.101S 50 rows inserted. dT=PT0.985S 60 rows inserted. dT=PT1.066S 70 rows inserted. dT=PT1.068S 80 rows inserted. dT=PT1.113S 90 rows inserted. dT=PT1.015S 100 rows inserted. dT=PT0.984S 110 rows inserted. dT=PT1.503S 120 rows inserted. dT=PT1.14S 130 rows inserted. dT=PT0.959S 140 rows inserted. dT=PT1.007S 150 rows inserted. dT=PT1.033S 160 rows inserted. dT=PT1.03S 170 rows inserted. dT=PT1.049S 180 rows inserted. dT=PT1.076S 190 rows inserted. dT=PT1.062S 200 rows inserted. dT=PT1.061S 210 rows inserted. dT=PT1.049S 220 rows inserted. dT=PT1.09S 230 rows inserted. dT=PT1.062S 240 rows inserted. dT=PT1.053S 250 rows inserted. dT=PT1.095S 260 rows inserted. dT=PT1.135S 270 rows inserted. dT=PT1.105S 280 rows inserted. dT=PT1.02S 290 rows inserted. dT=PT1.14S 300 rows inserted. dT=PT0.995S 310 rows inserted. dT=PT1.013S 320 rows inserted. dT=PT1.008S 330 rows inserted. dT=PT1.032S 340 rows inserted. dT=PT1.015S 350 rows inserted. dT=PT1.055S 360 rows inserted. dT=PT1.013S 370 rows inserted. dT=PT0.977S 380 rows inserted. dT=PT1.073S 390 rows inserted. dT=PT1.144S 400 rows inserted. dT=PT1.053S 410 rows inserted. dT=PT1.094S 420 rows inserted. dT=PT0.959S 430 rows inserted. dT=PT0.951S 440 rows inserted. dT=PT1.101S 450 rows inserted. dT=PT1.04S 460 rows inserted. dT=PT1.146S 470 rows inserted. dT=PT1.094S 480 rows inserted. dT=PT1.091S 490 rows inserted. dT=PT1.072S 500 rows inserted. dT=PT1.021S 510 rows inserted. dT=PT0.993S 520 rows inserted. dT=PT1.095S 530 rows inserted. dT=PT1.078S 540 rows inserted. dT=PT0.998S 550 rows inserted. dT=PT0.985S 560 rows inserted. dT=PT0.98S 570 rows inserted. dT=PT1.024S 580 rows inserted. dT=PT1.043S 590 rows inserted. dT=PT1.052S 600 rows inserted. dT=PT0.982S 610 rows inserted. dT=PT1.056S 620 rows inserted. dT=PT1.036S 630 rows inserted. dT=PT1.001S 640 rows inserted. dT=PT1.007S 650 rows inserted. dT=PT1.043S 660 rows inserted. dT=PT1.083S 670 rows inserted. dT=PT1.021S 680 rows inserted. dT=PT1.392S 690 rows inserted. dT=PT1.134S 700 rows inserted. dT=PT1.093S 710 rows inserted. dT=PT1.076S 720 rows inserted. dT=PT1.006S 730 rows inserted. dT=PT0.924S 740 rows inserted. dT=PT1.035S 750 rows inserted. dT=PT0.976S 760 rows inserted. dT=PT0.96S 770 rows inserted. dT=PT1.04S 780 rows inserted. dT=PT1.005S 790 rows inserted. dT=PT0.956S 800 rows inserted. dT=PT0.935S 810 rows inserted. dT=PT1.028S 820 rows inserted. dT=PT0.988S 830 rows inserted. dT=PT0.927S 840 rows inserted. dT=PT1.033S 850 rows inserted. dT=PT1.058S 860 rows inserted. dT=PT1.019S 870 rows inserted. dT=PT1.027S 880 rows inserted. dT=PT1.055S 890 rows inserted. dT=PT0.976S 900 rows inserted. dT=PT0.942S 910 rows inserted. dT=PT1.041S 920 rows inserted. dT=PT1.072S 930 rows inserted. dT=PT1.032S 940 rows inserted. dT=PT0.912S 950 rows inserted. dT=PT1.053S 960 rows inserted. dT=PT0.99S 970 rows inserted. dT=PT1.105S 980 rows inserted. dT=PT0.973S 990 rows inserted. dT=PT1.037S 1000 rows inserted. dT=PT1.008S 1010 rows inserted. dT=PT0.983S 1020 rows inserted. dT=PT1.009S 1030 rows inserted. dT=PT1.043S 1040 rows inserted. dT=PT1.054S 1050 rows inserted. dT=PT1.011S 1060 rows inserted. dT=PT1.068S 1070 rows inserted. dT=PT0.975S 1080 rows inserted. dT=PT1.014S 1090 rows inserted. dT=PT0.993S 1100 rows inserted. dT=PT1.021S 1110 rows inserted. dT=PT1.038S 1120 rows inserted. dT=PT0.972S 1130 rows inserted. dT=PT0.936S 1140 rows inserted. dT=PT1.019S 1150 rows inserted. dT=PT1.004S 1160 rows inserted. dT=PT1.026S 1170 rows inserted. dT=PT1.052S 1180 rows inserted. dT=PT0.994S 1190 rows inserted. dT=PT0.975S 1200 rows inserted. dT=PT1.03S 1210 rows inserted. dT=PT0.927S 1220 rows inserted. dT=PT0.971S 1230 rows inserted. dT=PT0.973S 1240 rows inserted. dT=PT1.009S 1250 rows inserted. dT=PT0.926S 1260 rows inserted. dT=PT0.949S 1270 rows inserted. dT=PT1.143S 1280 rows inserted. dT=PT0.983S 1290 rows inserted. dT=PT0.906S 1300 rows inserted. dT=PT1.025S 1310 rows inserted. dT=PT0.942S 1320 rows inserted. dT=PT0.975S 1330 rows inserted. dT=PT0.991S 1340 rows inserted. dT=PT0.919S 1350 rows inserted. dT=PT1.032S 2023-05-08 19:15:19:417 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Checkpoint started [checkpointId=72e5123f-0d9d-499b-8277-ea0f58ca21f4, checkpointBeforeWriteLockTime=12ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=10ms, pages=265, reason='timeout'] 1360 rows inserted. dT=PT0.979S 2023-05-08 19:15:20:625 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Checkpoint finished [checkpointId=72e5123f-0d9d-499b-8277-ea0f58ca21f4, pages=265, pagesWriteTime=362ms, fsyncTime=826ms, totalTime=1232ms] 1370 rows inserted. dT=PT2.195S 1380 rows inserted. dT=PT1.166S 1390 rows inserted. dT=PT0.959S 1400 rows inserted. dT=PT1.051S 1410 rows inserted. dT=PT0.971S 1420 rows inserted. dT=PT0.97S 1430 rows inserted. dT=PT1.01S 1440 rows inserted. dT=PT1.031S 1450 rows inserted. dT=PT0.992S 1460 rows inserted. dT=PT1S 1470 rows inserted. dT=PT0.984S 1480 rows inserted. dT=PT0.966S 1490 rows inserted. dT=PT1.039S 1500 rows inserted. dT=PT0.935S 1510 rows inserted. dT=PT1.032S 1520 rows inserted. dT=PT1.041S 1530 rows inserted. dT=PT0.939S 1540 rows inserted. dT=PT1.014S 1550 rows inserted. dT=PT0.999S 1560 rows inserted. dT=PT1.507S 2023-05-08 19:15:41:497 +0300 [INFO][%idt_n_0%checkpoint-thread-1][Checkpointer] Checkpoint started [checkpointId=839c4b0f-1727-4e46-aedf-4fc2f1ccd1b8, checkpointBeforeWriteLockTime=11ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=283, reason='timeout'] 2023-05-08 19:15:42:511 +0300 [INFO][%idt_n_0%checkpoint-thread-1][Checkpointer] Checkpoint finished [checkpointId=839c4b0f-1727-4e46-aedf-4fc2f1ccd1b8, pages=283, pagesWriteTime=267ms, fsyncTime=738ms, totalTime=1016ms] 1570 rows inserted. dT=PT1.507S 1580 rows inserted. dT=PT1.737S 1590 rows inserted. dT=PT0.962S 1600 rows inserted. dT=PT0.935S 1610 rows inserted. dT=PT1.051S 1620 rows inserted. dT=PT1.028S 1630 rows inserted. dT=PT1.042S 1640 rows inserted. dT=PT0.934S 1650 rows inserted. dT=PT0.908S 1660 rows inserted. dT=PT0.983S 1670 rows inserted. dT=PT0.934S 1680 rows inserted. dT=PT1.02S 1690 rows inserted. dT=PT0.944S 1700 rows inserted. dT=PT0.782S 1710 rows inserted. dT=PT0.822S 1720 rows inserted. dT=PT0.92S 1730 rows inserted. dT=PT0.976S 1740 rows inserted. dT=PT0.943S 1750 rows inserted. dT=PT0.952S 2023-05-08 19:16:01:527 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Checkpoint started [checkpointId=af8f9e31-b995-46aa-a0d0-a53929104e5f, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=279, reason='timeout'] 1760 rows inserted. dT=PT0.968S 2023-05-08 19:16:02:663 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Checkpoint finished [checkpointId=af8f9e31-b995-46aa-a0d0-a53929104e5f, pages=279, pagesWriteTime=264ms, fsyncTime=854ms, totalTime=1130ms] 1770 rows inserted. dT=PT2.722S 1780 rows inserted. dT=PT0.961S 1790 rows inserted. dT=PT0.969S 1800 rows inserted. dT=PT0.752S 1810 rows inserted. dT=PT1.139S 1820 rows inserted. dT=PT0.823S 1830 rows inserted. dT=PT1.457S 1840 rows inserted. dT=PT0.937S 1850 rows inserted. dT=PT0.991S 1860 rows inserted. dT=PT1.053S 1870 rows inserted. dT=PT1.04S 1880 rows inserted. dT=PT1.021S 1890 rows inserted. dT=PT1.004S 1900 rows inserted. dT=PT1.009S 1910 rows inserted. dT=PT0.963S 1920 rows inserted. dT=PT1.021S 1930 rows inserted. dT=PT1.051S 1940 rows inserted. dT=PT1.019S 1950 rows inserted. dT=PT0.971S 1960 rows inserted. dT=PT1.048S 1970 rows inserted. dT=PT1.024S 1980 rows inserted. dT=PT1.003S 1990 rows inserted. dT=PT1.006S 2000 rows inserted. dT=PT1.032S 2010 rows inserted. dT=PT0.993S 2020 rows inserted. dT=PT1.039S 2030 rows inserted. dT=PT0.976S 2040 rows inserted. dT=PT0.995S 2050 rows inserted. dT=PT1.004S 2060 rows inserted. dT=PT0.975S 2070 rows inserted. dT=PT0.996S 2080 rows inserted. dT=PT1.049S 2090 rows inserted. dT=PT1.039S 2100 rows inserted. dT=PT0.983S 2110 rows inserted. dT=PT1.07S 2120 rows inserted. dT=PT0.976S 2130 rows inserted. dT=PT1.301S 2140 rows inserted. dT=PT1.214S 2150 rows inserted. dT=PT0.935S 2160 rows inserted. dT=PT0.959S 2170 rows inserted. dT=PT1.067S 2180 rows inserted. dT=PT0.987S 2190 rows inserted. dT=PT0.707S 2200 rows inserted. dT=PT1.109S 2210 rows inserted. dT=PT0.921S 2220 rows inserted. dT=PT1.049S 2230 rows inserted. dT=PT0.873S 2240 rows inserted. dT=PT1.016S 2250 rows inserted. dT=PT1.032S 2260 rows inserted. dT=PT0.985S 2270 rows inserted. dT=PT1.053S 2280 rows inserted. dT=PT1.071S 2290 rows inserted. dT=PT0.841S 2300 rows inserted. dT=PT0.994S 2310 rows inserted. dT=PT1.009S 2320 rows inserted. dT=PT0.989S 2330 rows inserted. dT=PT0.997S 2340 rows inserted. dT=PT0.97S 2350 rows inserted. dT=PT1.045S 2360 rows inserted. dT=PT1.021S 2370 rows inserted. dT=PT1.059S 2380 rows inserted. dT=PT1.062S 2390 rows inserted. dT=PT0.881S 2400 rows inserted. dT=PT0.964S 2410 rows inserted. dT=PT0.986S 2420 rows inserted. dT=PT1.375S 2430 rows inserted. dT=PT1.054S 2440 rows inserted. dT=PT1.063S 2450 rows inserted. dT=PT1S 2460 rows inserted. dT=PT1.016S 2470 rows inserted. dT=PT1.042S 2480 rows inserted. dT=PT1.052S 2490 rows inserted. dT=PT0.941S 2500 rows inserted. dT=PT0.965S 2510 rows inserted. dT=PT1.013S 2520 rows inserted. dT=PT1.051S 2530 rows inserted. dT=PT0.941S 2540 rows inserted. dT=PT0.961S 2550 rows inserted. dT=PT1S 2560 rows inserted. dT=PT1.06S 2570 rows inserted. dT=PT1.004S 2580 rows inserted. dT=PT1.026S 2590 rows inserted. dT=PT1.046S 2600 rows inserted. dT=PT0.984S 2610 rows inserted. dT=PT1.041S 2620 rows inserted. dT=PT1.08S 2630 rows inserted. dT=PT0.993S 2640 rows inserted. dT=PT1.066S 2650 rows inserted. dT=PT1.036S 2660 rows inserted. dT=PT0.913S 2670 rows inserted. dT=PT0.966S 2680 rows inserted. dT=PT0.954S 2690 rows inserted. dT=PT1.006S 2700 rows inserted. dT=PT0.945S 2710 rows inserted. dT=PT0.891S 2720 rows inserted. dT=PT1.147S 2730 rows inserted. dT=PT0.972S 2740 rows inserted. dT=PT1.057S 2750 rows inserted. dT=PT1.008S 2760 rows inserted. dT=PT1.033S 2770 rows inserted. dT=PT1.046S 2780 rows inserted. dT=PT1.002S 2790 rows inserted. dT=PT1.04S 2800 rows inserted. dT=PT1.018S 2810 rows inserted. dT=PT0.99S 2023-05-08 19:17:50:198 +0300 [INFO][%idt_n_0%vault-0][LowWatermark] Successful low watermark update: HybridTimestamp [time=110333786204405760] 2820 rows inserted. dT=PT0.935S 2023-05-08 19:17:50:792 +0300 [INFO][%idt_n_2%vault-1][LowWatermark] Successful low watermark update: HybridTimestamp [time=110333786245038080] 2023-05-08 19:17:50:958 +0300 [INFO][%idt_n_1%vault-1][LowWatermark] Successful low watermark update: HybridTimestamp [time=110333786255196160] 2830 rows inserted. dT=PT1.003S 2840 rows inserted. dT=PT0.973S 2850 rows inserted. dT=PT1.046S 2860 rows inserted. dT=PT1.012S 2870 rows inserted. dT=PT1.064S 2880 rows inserted. dT=PT1.022S 2890 rows inserted. dT=PT1.032S 2900 rows inserted. dT=PT1.032S 2910 rows inserted. dT=PT0.986S 2920 rows inserted. dT=PT1.003S 2930 rows inserted. dT=PT0.974S 2940 rows inserted. dT=PT0.982S 2950 rows inserted. dT=PT1.044S 2960 rows inserted. dT=PT0.975S 2970 rows inserted. dT=PT1.079S 2980 rows inserted. dT=PT1.03S 2990 rows inserted. dT=PT0.963S 3000 rows inserted. dT=PT1.027S 3010 rows inserted. dT=PT1.038S 3020 rows inserted. dT=PT1.416S 3030 rows inserted. dT=PT0.78S 3040 rows inserted. dT=PT1.316S 3050 rows inserted. dT=PT0.981S 3060 rows inserted. dT=PT1.024S 3070 rows inserted. dT=PT1.015S 3080 rows inserted. dT=PT0.993S 3090 rows inserted. dT=PT1.016S 3100 rows inserted. dT=PT0.991S 3110 rows inserted. dT=PT0.983S 3120 rows inserted. dT=PT1.031S 3130 rows inserted. dT=PT1.009S 3140 rows inserted. dT=PT0.969S 3150 rows inserted. dT=PT0.975S 3160 rows inserted. dT=PT1.011S 3170 rows inserted. dT=PT1.024S 3180 rows inserted. dT=PT1.056S 3190 rows inserted. dT=PT0.966S 3200 rows inserted. dT=PT0.981S 3210 rows inserted. dT=PT1.015S 3220 rows inserted. dT=PT1.028S 3230 rows inserted. dT=PT1.007S 2023-05-08 19:18:33:139 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Checkpoint started [checkpointId=ef84640a-ab57-45a7-bb23-98eb3259e6d7, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=40, reason='timeout'] 2023-05-08 19:18:33:579 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Checkpoint finished [checkpointId=ef84640a-ab57-45a7-bb23-98eb3259e6d7, pages=40, pagesWriteTime=308ms, fsyncTime=104ms, totalTime=436ms] 3240 rows inserted. dT=PT1.281S 3250 rows inserted. dT=PT0.966S 3260 rows inserted. dT=PT0.99S 3270 rows inserted. dT=PT1.001S 3280 rows inserted. dT=PT0.962S 3290 rows inserted. dT=PT1.027S 3300 rows inserted. dT=PT0.976S 3310 rows inserted. dT=PT1.135S 3320 rows inserted. dT=PT1.014S 3330 rows inserted. dT=PT1.057S 3340 rows inserted. dT=PT1.162S 3350 rows inserted. dT=PT0.921S 3360 rows inserted. dT=PT1.351S 3370 rows inserted. dT=PT0.805S 3380 rows inserted. dT=PT0.898S 3390 rows inserted. dT=PT1.3S 3400 rows inserted. dT=PT0.99S 3410 rows inserted. dT=PT1.075S 3420 rows inserted. dT=PT0.993S 3430 rows inserted. dT=PT1.055S 3440 rows inserted. dT=PT1.012S 3450 rows inserted. dT=PT1.01S 3460 rows inserted. dT=PT1.009S 3470 rows inserted. dT=PT1.054S 3480 rows inserted. dT=PT0.936S 3490 rows inserted. dT=PT1.039S 3500 rows inserted. dT=PT0.992S 3510 rows inserted. dT=PT0.988S 2023-05-08 19:19:01:764 +0300 [INFO][%idt_n_0%checkpoint-thread-1][Checkpointer] Checkpoint started [checkpointId=b2ed9a3a-b1dc-4351-840c-d45e4d1b6c44, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=90, reason='timeout'] 2023-05-08 19:19:02:172 +0300 [INFO][%idt_n_0%checkpoint-thread-1][Checkpointer] Checkpoint finished [checkpointId=b2ed9a3a-b1dc-4351-840c-d45e4d1b6c44, pages=90, pagesWriteTime=102ms, fsyncTime=311ms, totalTime=413ms] 3520 rows inserted. dT=PT1.442S 3530 rows inserted. dT=PT1.019S 3540 rows inserted. dT=PT0.937S 3550 rows inserted. dT=PT1.051S 3560 rows inserted. dT=PT0.97S 3570 rows inserted. dT=PT0.934S 3580 rows inserted. dT=PT0.985S 3590 rows inserted. dT=PT0.93S 3600 rows inserted. dT=PT1.165S 3610 rows inserted. dT=PT1.033S 3620 rows inserted. dT=PT1.01S 2023-05-08 19:19:13:085 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Checkpoint started [checkpointId=97aae934-9b21-4a6d-8af5-147b21f6d39c, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=78, reason='timeout'] 2023-05-08 19:19:13:664 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Checkpoint finished [checkpointId=97aae934-9b21-4a6d-8af5-147b21f6d39c, pages=78, pagesWriteTime=341ms, fsyncTime=225ms, totalTime=577ms] 3630 rows inserted. dT=PT1.703S 3640 rows inserted. dT=PT1.009S 3650 rows inserted. dT=PT0.986S 3660 rows inserted. dT=PT0.997S 3670 rows inserted. dT=PT1.039S 3680 rows inserted. dT=PT1.079S 3690 rows inserted. dT=PT1.067S 3700 rows inserted. dT=PT1.042S 3710 rows inserted. dT=PT1.149S 3720 rows inserted. dT=PT1.194S 3730 rows inserted. dT=PT1.118S 3740 rows inserted. dT=PT1.007S 3750 rows inserted. dT=PT1.057S 3760 rows inserted. dT=PT0.987S 3770 rows inserted. dT=PT1.028S 3780 rows inserted. dT=PT0.945S 3790 rows inserted. dT=PT0.942S 3800 rows inserted. dT=PT0.778S 3810 rows inserted. dT=PT1.206S 3820 rows inserted. dT=PT0.998S 3830 rows inserted. dT=PT0.854S 3840 rows inserted. dT=PT1.197S 3850 rows inserted. dT=PT1.045S 3860 rows inserted. dT=PT1.014S 3870 rows inserted. dT=PT0.973S 3880 rows inserted. dT=PT1.185S 3890 rows inserted. dT=PT1.056S 3900 rows inserted. dT=PT1.077S 3910 rows inserted. dT=PT1.029S 3920 rows inserted. dT=PT1.019S 3930 rows inserted. dT=PT0.991S 3940 rows inserted. dT=PT1.043S 3950 rows inserted. dT=PT0.981S 3960 rows inserted. dT=PT0.969S 3970 rows inserted. dT=PT1.04S 3980 rows inserted. dT=PT1.074S 3990 rows inserted. dT=PT1.025S 4000 rows inserted. dT=PT0.942S 4010 rows inserted. dT=PT1.003S 4020 rows inserted. dT=PT1.013S 4030 rows inserted. dT=PT1.018S 4040 rows inserted. dT=PT1.088S 4050 rows inserted. dT=PT1.017S 4060 rows inserted. dT=PT0.989S 4070 rows inserted. dT=PT0.981S 4080 rows inserted. dT=PT0.928S 4090 rows inserted. dT=PT1.047S 4100 rows inserted. dT=PT0.983S 4110 rows inserted. dT=PT1.04S 4120 rows inserted. dT=PT0.939S 4130 rows inserted. dT=PT0.98S 4140 rows inserted. dT=PT1.031S 4150 rows inserted. dT=PT0.966S 4160 rows inserted. dT=PT0.966S 4170 rows inserted. dT=PT0.964S 4180 rows inserted. dT=PT1.174S 4190 rows inserted. dT=PT1.018S 4200 rows inserted. dT=PT0.999S 4210 rows inserted. dT=PT0.985S 4220 rows inserted. dT=PT1.259S 4230 rows inserted. dT=PT0.737S 4240 rows inserted. dT=PT0.993S 4250 rows inserted. dT=PT1.188S 4260 rows inserted. dT=PT0.933S 4270 rows inserted. dT=PT0.908S 4280 rows inserted. dT=PT1.074S 4290 rows inserted. dT=PT1.319S 4300 rows inserted. dT=PT1.057S 4310 rows inserted. dT=PT1.012S 4320 rows inserted. dT=PT0.947S 4330 rows inserted. dT=PT0.945S 4340 rows inserted. dT=PT0.938S 4350 rows inserted. dT=PT1.05S 4360 rows inserted. dT=PT0.91S 4370 rows inserted. dT=PT0.791S 4380 rows inserted. dT=PT1.12S 4390 rows inserted. dT=PT0.83S 4400 rows inserted. dT=PT0.98S 4410 rows inserted. dT=PT0.978S 4420 rows inserted. dT=PT0.962S 4430 rows inserted. dT=PT1.008S 4440 rows inserted. dT=PT0.935S 4450 rows inserted. dT=PT1.02S 4460 rows inserted. dT=PT1.044S 4470 rows inserted. dT=PT0.96S 4480 rows inserted. dT=PT1.157S 4490 rows inserted. dT=PT1.024S 4500 rows inserted. dT=PT1.088S 4510 rows inserted. dT=PT0.93S 4520 rows inserted. dT=PT0.859S 4530 rows inserted. dT=PT0.944S 4540 rows inserted. dT=PT1.039S 4550 rows inserted. dT=PT0.931S 4560 rows inserted. dT=PT1.037S 4570 rows inserted. dT=PT0.989S 4580 rows inserted. dT=PT1.011S 4590 rows inserted. dT=PT0.966S 4600 rows inserted. dT=PT1.007S 4610 rows inserted. dT=PT1.035S 4620 rows inserted. dT=PT1.012S 4630 rows inserted. dT=PT1.044S 4640 rows inserted. dT=PT0.999S 4650 rows inserted. dT=PT1.013S 4660 rows inserted. dT=PT1.013S 4670 rows inserted. dT=PT1.056S 4680 rows inserted. dT=PT1.003S 4690 rows inserted. dT=PT1.196S 4700 rows inserted. dT=PT0.85S 4710 rows inserted. dT=PT1.035S 4720 rows inserted. dT=PT1.155S 4730 rows inserted. dT=PT0.982S 4740 rows inserted. dT=PT0.788S 4750 rows inserted. dT=PT0.961S 4760 rows inserted. dT=PT0.978S 4770 rows inserted. dT=PT1.069S 4780 rows inserted. dT=PT1.373S 4790 rows inserted. dT=PT1.038S 4800 rows inserted. dT=PT0.988S 4810 rows inserted. dT=PT1.046S 4820 rows inserted. dT=PT0.985S 4830 rows inserted. dT=PT0.978S 4840 rows inserted. dT=PT1.039S 4850 rows inserted. dT=PT0.992S 4860 rows inserted. dT=PT0.99S 4870 rows inserted. dT=PT1.01S 4880 rows inserted. dT=PT0.992S 4890 rows inserted. dT=PT1.024S 4900 rows inserted. dT=PT0.972S 4910 rows inserted. dT=PT1.002S 4920 rows inserted. dT=PT0.98S 4930 rows inserted. dT=PT1.007S 4940 rows inserted. dT=PT1.075S 4950 rows inserted. dT=PT0.968S 4960 rows inserted. dT=PT1.002S 4970 rows inserted. dT=PT1.015S 4980 rows inserted. dT=PT0.957S 4990 rows inserted. dT=PT1.001S 5000 rows inserted. dT=PT0.997S 5010 rows inserted. dT=PT1.101S 2023-05-08 19:21:35:108 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Checkpoint started [checkpointId=eb801d53-8720-41ad-a548-b5b5297ff832, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=50, reason='timeout'] 2023-05-08 19:21:35:582 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Checkpoint finished [checkpointId=eb801d53-8720-41ad-a548-b5b5297ff832, pages=50, pagesWriteTime=328ms, fsyncTime=135ms, totalTime=475ms] 5020 rows inserted. dT=PT1.236S 5030 rows inserted. dT=PT1.021S 5040 rows inserted. dT=PT0.982S 5050 rows inserted. dT=PT0.932S 5060 rows inserted. dT=PT0.937S 5070 rows inserted. dT=PT1.15S 5080 rows inserted. dT=PT0.968S 5090 rows inserted. dT=PT1.023S 5100 rows inserted. dT=PT0.97S 5110 rows inserted. dT=PT0.987S 5120 rows inserted. dT=PT0.928S 5130 rows inserted. dT=PT1.026S 5140 rows inserted. dT=PT0.997S 5150 rows inserted. dT=PT0.984S 2023-05-08 19:21:48:905 +0300 [INFO][%idt_n_0%checkpoint-thread-1][Checkpointer] Checkpoint started [checkpointId=a61a3f3d-d497-4499-a99b-9602ef4e15c3, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=108, reason='timeout'] 2023-05-08 19:21:49:534 +0300 [INFO][%idt_n_0%checkpoint-thread-1][Checkpointer] Checkpoint finished [checkpointId=a61a3f3d-d497-4499-a99b-9602ef4e15c3, pages=108, pagesWriteTime=227ms, fsyncTime=389ms, totalTime=628ms] 5160 rows inserted. dT=PT1.713S 5170 rows inserted. dT=PT1.02S 5180 rows inserted. dT=PT1.018S 5190 rows inserted. dT=PT1.058S 5200 rows inserted. dT=PT0.98S 5210 rows inserted. dT=PT0.996S 5220 rows inserted. dT=PT1.016S 5230 rows inserted. dT=PT0.979S 5240 rows inserted. dT=PT0.99S 5250 rows inserted. dT=PT0.989S 5260 rows inserted. dT=PT0.991S 5270 rows inserted. dT=PT1.025S 5280 rows inserted. dT=PT1.025S 2023-05-08 19:22:02:883 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Checkpoint started [checkpointId=9e0776b6-0067-4dd4-afdf-cb0a6fda5d48, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=88, reason='timeout'] 2023-05-08 19:22:03:257 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Checkpoint finished [checkpointId=9e0776b6-0067-4dd4-afdf-cb0a6fda5d48, pages=88, pagesWriteTime=97ms, fsyncTime=274ms, totalTime=381ms] 5290 rows inserted. dT=PT1.321S 5300 rows inserted. dT=PT1.025S 5310 rows inserted. dT=PT0.997S 5320 rows inserted. dT=PT0.991S 5330 rows inserted. dT=PT1.08S 5340 rows inserted. dT=PT0.948S 5350 rows inserted. dT=PT0.999S 5360 rows inserted. dT=PT1.337S 5370 rows inserted. dT=PT0.943S 5380 rows inserted. dT=PT1.126S 5390 rows inserted. dT=PT1.11S 5400 rows inserted. dT=PT1.03S 5410 rows inserted. dT=PT1.069S 5420 rows inserted. dT=PT0.962S 5430 rows inserted. dT=PT0.955S 5440 rows inserted. dT=PT0.973S 5450 rows inserted. dT=PT1.016S 5460 rows inserted. dT=PT1.022S 5470 rows inserted. dT=PT1.007S 5480 rows inserted. dT=PT0.998S 5490 rows inserted. dT=PT0.967S 5500 rows inserted. dT=PT0.806S 5510 rows inserted. dT=PT1.203S 5520 rows inserted. dT=PT0.933S 5530 rows inserted. dT=PT0.793S 5540 rows inserted. dT=PT1.134S 5550 rows inserted. dT=PT0.783S 5560 rows inserted. dT=PT0.964S 5570 rows inserted. dT=PT0.989S 5580 rows inserted. dT=PT1.004S 5590 rows inserted. dT=PT1.007S 5600 rows inserted. dT=PT1.033S 5610 rows inserted. dT=PT0.966S 5620 rows inserted. dT=PT1.114S 5630 rows inserted. dT=PT1.177S 5640 rows inserted. dT=PT1.154S 5650 rows inserted. dT=PT1.142S 5660 rows inserted. dT=PT1.001S 5670 rows inserted. dT=PT1.038S 5680 rows inserted. dT=PT1.057S 5690 rows inserted. dT=PT1.016S 5700 rows inserted. dT=PT0.934S 5710 rows inserted. dT=PT1.037S 5720 rows inserted. dT=PT1.005S 5730 rows inserted. dT=PT1.012S 5740 rows inserted. dT=PT0.912S 2023-05-08 19:22:50:234 +0300 [INFO][%idt_n_0%vault-1][LowWatermark] Successful low watermark update: HybridTimestamp [time=110333805869268992] 5750 rows inserted. dT=PT1.022S 2023-05-08 19:22:50:816 +0300 [INFO][%idt_n_2%vault-0][LowWatermark] Successful low watermark update: HybridTimestamp [time=110333805908131840] 2023-05-08 19:22:51:003 +0300 [INFO][%idt_n_1%vault-0][LowWatermark] Successful low watermark update: HybridTimestamp [time=110333805919076352] 5760 rows inserted. dT=PT0.984S 5770 rows inserted. dT=PT1.076S 5780 rows inserted. dT=PT1.061S 5790 rows inserted. dT=PT1.035S 5800 rows inserted. dT=PT0.958S 5810 rows inserted. dT=PT1.034S 5820 rows inserted. dT=PT1.031S 5830 rows inserted. dT=PT1.018S 5840 rows inserted. dT=PT1.065S 5850 rows inserted. dT=PT0.939S 5860 rows inserted. dT=PT1.057S 5870 rows inserted. dT=PT1.058S 5880 rows inserted. dT=PT0.964S 5890 rows inserted. dT=PT1.01S 5900 rows inserted. dT=PT1.035S 5910 rows inserted. dT=PT1.051S 5920 rows inserted. dT=PT0.984S 5930 rows inserted. dT=PT0.975S 5940 rows inserted. dT=PT0.995S 5950 rows inserted. dT=PT1.48S 5960 rows inserted. dT=PT1.04S 5970 rows inserted. dT=PT0.993S 5980 rows inserted. dT=PT1.036S 5990 rows inserted. dT=PT1.177S 6000 rows inserted. dT=PT1.198S 6010 rows inserted. dT=PT1.07S 6020 rows inserted. dT=PT1.048S 6030 rows inserted. dT=PT1.053S 6040 rows inserted. dT=PT1.343S 6050 rows inserted. dT=PT1.085S 6060 rows inserted. dT=PT1.042S 6070 rows inserted. dT=PT1.085S 6080 rows inserted. dT=PT1.062S 6090 rows inserted. dT=PT1.082S 6100 rows inserted. dT=PT1.068S 6110 rows inserted. dT=PT1.016S 6120 rows inserted. dT=PT1.063S 6130 rows inserted. dT=PT1.063S 6140 rows inserted. dT=PT1.022S 6150 rows inserted. dT=PT1.436S 6160 rows inserted. dT=PT1.064S 6170 rows inserted. dT=PT1.035S 6180 rows inserted. dT=PT1.021S 6190 rows inserted. dT=PT1.012S 6200 rows inserted. dT=PT1.071S 6210 rows inserted. dT=PT1.03S 6220 rows inserted. dT=PT1.229S 6230 rows inserted. dT=PT1.072S 6240 rows inserted. dT=PT1.084S 6250 rows inserted. dT=PT1.338S 6260 rows inserted. dT=PT1.013S 6270 rows inserted. dT=PT1.004S 6280 rows inserted. dT=PT1.03S 6290 rows inserted. dT=PT1.042S 6300 rows inserted. dT=PT0.991S 6310 rows inserted. dT=PT0.975S 6320 rows inserted. dT=PT1.066S 6330 rows inserted. dT=PT1.017S 6340 rows inserted. dT=PT1.043S 6350 rows inserted. dT=PT1.004S 6360 rows inserted. dT=PT1.004S 6370 rows inserted. dT=PT1.021S 6380 rows inserted. dT=PT1.065S 6390 rows inserted. dT=PT0.993S 6400 rows inserted. dT=PT1.035S 6410 rows inserted. dT=PT1.012S 6420 rows inserted. dT=PT1.008S 6430 rows inserted. dT=PT1.067S 6440 rows inserted. dT=PT1.048S 6450 rows inserted. dT=PT1.015S 6460 rows inserted. dT=PT1.087S 6470 rows inserted. dT=PT1.032S 6480 rows inserted. dT=PT1.049S 6490 rows inserted. dT=PT1.322S 6500 rows inserted. dT=PT1.104S 6510 rows inserted. dT=PT1.027S 6520 rows inserted. dT=PT1.077S 6530 rows inserted. dT=PT1.032S 6540 rows inserted. dT=PT1.046S 6550 rows inserted. dT=PT1.017S 6560 rows inserted. dT=PT1.053S 6570 rows inserted. dT=PT1.053S 6580 rows inserted. dT=PT1.009S 6590 rows inserted. dT=PT1.045S 6600 rows inserted. dT=PT1.033S 6610 rows inserted. dT=PT0.995S 6620 rows inserted. dT=PT1.041S 6630 rows inserted. dT=PT1.081S 6640 rows inserted. dT=PT1.014S 6650 rows inserted. dT=PT1.068S 6660 rows inserted. dT=PT1S 6670 rows inserted. dT=PT0.967S 6680 rows inserted. dT=PT1.037S 6690 rows inserted. dT=PT1.027S 6700 rows inserted. dT=PT1.32S 6710 rows inserted. dT=PT1.059S 6720 rows inserted. dT=PT1.047S 6730 rows inserted. dT=PT1.037S 6740 rows inserted. dT=PT1.087S 6750 rows inserted. dT=PT1.067S 6760 rows inserted. dT=PT1.001S 6770 rows inserted. dT=PT1.073S 2023-05-08 19:24:38:755 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Checkpoint started [checkpointId=10422b5f-bf6d-4a36-8cdd-b78c0517b2ef, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=11ms, checkpointWriteLockHoldTime=11ms, splitAndSortPagesDuration=0ms, pages=57, reason='timeout'] 2023-05-08 19:24:38:946 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Checkpoint finished [checkpointId=10422b5f-bf6d-4a36-8cdd-b78c0517b2ef, pages=57, pagesWriteTime=72ms, fsyncTime=110ms, totalTime=193ms] 6780 rows inserted. dT=PT1.715S 6790 rows inserted. dT=PT1.017S 6800 rows inserted. dT=PT1.052S 6810 rows inserted. dT=PT1.049S 6820 rows inserted. dT=PT0.989S 6830 rows inserted. dT=PT1.068S 6840 rows inserted. dT=PT0.999S 6850 rows inserted. dT=PT1.001S 6860 rows inserted. dT=PT1.073S 6870 rows inserted. dT=PT1.03S 6880 rows inserted. dT=PT1.067S 6890 rows inserted. dT=PT1.029S 6900 rows inserted. dT=PT1.021S 6910 rows inserted. dT=PT1.077S 6920 rows inserted. dT=PT1.128S 6930 rows inserted. dT=PT1.325S 6940 rows inserted. dT=PT1.059S 6950 rows inserted. dT=PT1.052S 6960 rows inserted. dT=PT1.004S 6970 rows inserted. dT=PT1.056S 6980 rows inserted. dT=PT1.074S 2023-05-08 19:25:02:239 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Checkpoint started [checkpointId=786b11ed-f32c-42a4-a9ed-9741c92c6001, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=111, reason='timeout'] 2023-05-08 19:25:02:765 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Checkpoint finished [checkpointId=786b11ed-f32c-42a4-a9ed-9741c92c6001, pages=111, pagesWriteTime=293ms, fsyncTime=226ms, totalTime=533ms] 6990 rows inserted. dT=PT1.149S 7000 rows inserted. dT=PT1.639S 7010 rows inserted. dT=PT1.012S 7020 rows inserted. dT=PT1.069S 7030 rows inserted. dT=PT0.974S 7040 rows inserted. dT=PT0.96S 7050 rows inserted. dT=PT1.058S 7060 rows inserted. dT=PT1.183S 7070 rows inserted. dT=PT1.065S 7080 rows inserted. dT=PT1.063S 7090 rows inserted. dT=PT1.024S 7100 rows inserted. dT=PT1.026S 7110 rows inserted. dT=PT1.079S 7120 rows inserted. dT=PT1.072S 7130 rows inserted. dT=PT1.053S 7140 rows inserted. dT=PT1.287S 7150 rows inserted. dT=PT0.849S 7160 rows inserted. dT=PT0.956S 7170 rows inserted. dT=PT1.204S 7180 rows inserted. dT=PT1.01S 2023-05-08 19:25:24:116 +0300 [INFO][%idt_n_0%checkpoint-thread-1][Checkpointer] Checkpoint started [checkpointId=ed36792c-2e06-4cac-8c7a-e14a93e01be1, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=133, reason='timeout'] 7190 rows inserted. dT=PT1.074S 2023-05-08 19:25:24:834 +0300 [INFO][%idt_n_0%checkpoint-thread-1][Checkpointer] Checkpoint finished [checkpointId=ed36792c-2e06-4cac-8c7a-e14a93e01be1, pages=133, pagesWriteTime=394ms, fsyncTime=314ms, totalTime=723ms] 7200 rows inserted. dT=PT1.531S 7210 rows inserted. dT=PT1.001S 7220 rows inserted. dT=PT1.026S 7230 rows inserted. dT=PT1.024S 7240 rows inserted. dT=PT1.192S 7250 rows inserted. dT=PT1.198S 7260 rows inserted. dT=PT1.051S 7270 rows inserted. dT=PT1.081S 7280 rows inserted. dT=PT1.05S 7290 rows inserted. dT=PT1.027S 7300 rows inserted. dT=PT1.073S 7310 rows inserted. dT=PT1.029S 7320 rows inserted. dT=PT1.042S 7330 rows inserted. dT=PT1.025S 7340 rows inserted. dT=PT1.157S 7350 rows inserted. dT=PT1.072S 7360 rows inserted. dT=PT1.094S 7370 rows inserted. dT=PT1.375S 7380 rows inserted. dT=PT1.016S 7390 rows inserted. dT=PT0.994S 7400 rows inserted. dT=PT1.07S 7410 rows inserted. dT=PT1.041S 7420 rows inserted. dT=PT1.053S 7430 rows inserted. dT=PT1.031S 7440 rows inserted. dT=PT1.044S 7450 rows inserted. dT=PT1.088S 7460 rows inserted. dT=PT1.01S 7470 rows inserted. dT=PT1.103S 7480 rows inserted. dT=PT0.949S 7490 rows inserted. dT=PT1.057S 7500 rows inserted. dT=PT1.033S 7510 rows inserted. dT=PT1.033S 7520 rows inserted. dT=PT1.131S 7530 rows inserted. dT=PT0.963S 7540 rows inserted. dT=PT1.007S 7550 rows inserted. dT=PT0.957S 7560 rows inserted. dT=PT1.301S 7570 rows inserted. dT=PT1.024S 7580 rows inserted. dT=PT1.103S 7590 rows inserted. dT=PT1.063S 7600 rows inserted. dT=PT1.065S 7610 rows inserted. dT=PT1.031S 7620 rows inserted. dT=PT1.243S 7630 rows inserted. dT=PT1.002S 7640 rows inserted. dT=PT0.964S 7650 rows inserted. dT=PT1.044S 7660 rows inserted. dT=PT1.081S 7670 rows inserted. dT=PT0.996S 7680 rows inserted. dT=PT1.126S 7690 rows inserted. dT=PT1.123S 7700 rows inserted. dT=PT1.204S 7710 rows inserted. dT=PT1.216S 7720 rows inserted. dT=PT1.236S 7730 rows inserted. dT=PT1.184S 7740 rows inserted. dT=PT1.53S 7750 rows inserted. dT=PT1.174S 7760 rows inserted. dT=PT1.169S 7770 rows inserted. dT=PT1.315S 7780 rows inserted. dT=PT0.911S 7790 rows inserted. dT=PT0.825S 7800 rows inserted. dT=PT1.175S 7810 rows inserted. dT=PT1.09S 7820 rows inserted. dT=PT1.203S 7830 rows inserted. dT=PT1.047S 7840 rows inserted. dT=PT1.059S 7850 rows inserted. dT=PT1.011S 7860 rows inserted. dT=PT1.006S 7870 rows inserted. dT=PT1.058S 7880 rows inserted. dT=PT0.996S 7890 rows inserted. dT=PT1.289S 7900 rows inserted. dT=PT1.082S 7910 rows inserted. dT=PT1.334S 7920 rows inserted. dT=PT1.006S 7930 rows inserted. dT=PT0.946S 7940 rows inserted. dT=PT0.987S 7950 rows inserted. dT=PT0.858S 7960 rows inserted. dT=PT1.269S 7970 rows inserted. dT=PT1.042S 7980 rows inserted. dT=PT1.048S 7990 rows inserted. dT=PT0.992S 8000 rows inserted. dT=PT0.992S 8010 rows inserted. dT=PT1.042S 8020 rows inserted. dT=PT1.01S 8030 rows inserted. dT=PT1.068S 8040 rows inserted. dT=PT1.022S 8050 rows inserted. dT=PT0.982S 8060 rows inserted. dT=PT1.02S 8070 rows inserted. dT=PT1.024S 8080 rows inserted. dT=PT0.98S 8090 rows inserted. dT=PT1.039S 8100 rows inserted. dT=PT1.005S 8110 rows inserted. dT=PT1.003S 8120 rows inserted. dT=PT1.033S 8130 rows inserted. dT=PT1.016S 8140 rows inserted. dT=PT1.017S 8150 rows inserted. dT=PT1.043S 8160 rows inserted. dT=PT1.12S 8170 rows inserted. dT=PT1.015S 8180 rows inserted. dT=PT1.229S 8190 rows inserted. dT=PT1.261S 8200 rows inserted. dT=PT1.009S 8210 rows inserted. dT=PT1.059S 8220 rows inserted. dT=PT1.046S 8230 rows inserted. dT=PT1.015S 8240 rows inserted. dT=PT0.962S 8250 rows inserted. dT=PT0.955S 8260 rows inserted. dT=PT1.031S 8270 rows inserted. dT=PT0.999S 8280 rows inserted. dT=PT1.027S 8290 rows inserted. dT=PT0.978S 8300 rows inserted. dT=PT1.025S 8310 rows inserted. dT=PT1.007S 8320 rows inserted. dT=PT1.023S 8330 rows inserted. dT=PT1.04S 8340 rows inserted. dT=PT0.933S 8350 rows inserted. dT=PT0.979S 8360 rows inserted. dT=PT1.009S 8370 rows inserted. dT=PT1.046S 8380 rows inserted. dT=PT1.027S 8390 rows inserted. dT=PT0.987S 8400 rows inserted. dT=PT1.027S 8410 rows inserted. dT=PT1.007S 8420 rows inserted. dT=PT0.975S 8430 rows inserted. dT=PT1.008S 8440 rows inserted. dT=PT1.055S 8450 rows inserted. dT=PT1.034S 8460 rows inserted. dT=PT1.027S 8470 rows inserted. dT=PT1.177S 8480 rows inserted. dT=PT1.032S 8490 rows inserted. dT=PT0.977S 8500 rows inserted. dT=PT1.039S 8510 rows inserted. dT=PT1.041S 8520 rows inserted. dT=PT1.054S 8530 rows inserted. dT=PT1.083S 2023-05-08 19:27:47:465 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Checkpoint started [checkpointId=dca898ed-00bd-41db-af44-9ed5be3a9cf7, checkpointBeforeWriteLockTime=13ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=68, reason='timeout'] 2023-05-08 19:27:47:666 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Checkpoint finished [checkpointId=dca898ed-00bd-41db-af44-9ed5be3a9cf7, pages=68, pagesWriteTime=68ms, fsyncTime=112ms, totalTime=206ms] 8540 rows inserted. dT=PT1.451S 8550 rows inserted. dT=PT0.989S 2023-05-08 19:27:50:258 +0300 [INFO][%idt_n_0%vault-2][LowWatermark] Successful low watermark update: HybridTimestamp [time=110333825531510784] 8560 rows inserted. dT=PT0.96S 2023-05-08 19:27:50:841 +0300 [INFO][%idt_n_2%vault-2][LowWatermark] Successful low watermark update: HybridTimestamp [time=110333825569652736] 2023-05-08 19:27:51:010 +0300 [INFO][%idt_n_1%vault-2][LowWatermark] Successful low watermark update: HybridTimestamp [time=110333825581645824] 8570 rows inserted. dT=PT1.009S 8580 rows inserted. dT=PT1.096S 8590 rows inserted. dT=PT1.033S 8600 rows inserted. dT=PT1.026S 8610 rows inserted. dT=PT1.065S 8620 rows inserted. dT=PT1.033S 8630 rows inserted. dT=PT0.978S 8640 rows inserted. dT=PT1.004S 8650 rows inserted. dT=PT1.014S 8660 rows inserted. dT=PT0.95S 8670 rows inserted. dT=PT1.02S 8680 rows inserted. dT=PT1.018S 8690 rows inserted. dT=PT1.03S 8700 rows inserted. dT=PT0.957S 8710 rows inserted. dT=PT0.993S 8720 rows inserted. dT=PT0.959S 8730 rows inserted. dT=PT1.001S 2023-05-08 19:28:08:199 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Checkpoint started [checkpointId=b0c13172-120f-4032-9f2a-3db74bfad50e, checkpointBeforeWriteLockTime=10ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=119, reason='timeout'] 2023-05-08 19:28:08:785 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Checkpoint finished [checkpointId=b0c13172-120f-4032-9f2a-3db74bfad50e, pages=119, pagesWriteTime=339ms, fsyncTime=219ms, totalTime=591ms] 8740 rows inserted. dT=PT1.797S 8750 rows inserted. dT=PT1.124S 8760 rows inserted. dT=PT1.013S 8770 rows inserted. dT=PT1.029S 8780 rows inserted. dT=PT1.011S 8790 rows inserted. dT=PT1.052S 8800 rows inserted. dT=PT0.988S 8810 rows inserted. dT=PT1.037S 2023-05-08 19:28:17:333 +0300 [INFO][%idt_n_0%checkpoint-thread-1][Checkpointer] Checkpoint started [checkpointId=e27e82f8-8c73-4256-8607-28da2183d6dd, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=149, reason='timeout'] 2023-05-08 19:28:17:834 +0300 [INFO][%idt_n_0%checkpoint-thread-1][Checkpointer] Checkpoint finished [checkpointId=e27e82f8-8c73-4256-8607-28da2183d6dd, pages=149, pagesWriteTime=178ms, fsyncTime=308ms, totalTime=502ms] 8820 rows inserted. dT=PT1.747S 8830 rows inserted. dT=PT1.068S 8840 rows inserted. dT=PT0.957S 8850 rows inserted. dT=PT1.085S 8860 rows inserted. dT=PT1.036S 8870 rows inserted. dT=PT1.047S 8880 rows inserted. dT=PT1.036S 8890 rows inserted. dT=PT1.045S 8900 rows inserted. dT=PT1.02S 8910 rows inserted. dT=PT0.986S 8920 rows inserted. dT=PT1.03S 8930 rows inserted. dT=PT0.933S 8940 rows inserted. dT=PT1.074S 8950 rows inserted. dT=PT1.006S 8960 rows inserted. dT=PT1.052S 8970 rows inserted. dT=PT1.041S 8980 rows inserted. dT=PT1.068S 8990 rows inserted. dT=PT1.005S 9000 rows inserted. dT=PT0.929S 9010 rows inserted. dT=PT1.022S 9020 rows inserted. dT=PT1.009S 9030 rows inserted. dT=PT1.073S 9040 rows inserted. dT=PT1.363S 9050 rows inserted. dT=PT1.068S 9060 rows inserted. dT=PT1.027S 9070 rows inserted. dT=PT1.017S 9080 rows inserted. dT=PT1.072S 9090 rows inserted. dT=PT1.027S 9100 rows inserted. dT=PT1.071S 9110 rows inserted. dT=PT1.025S 9120 rows inserted. dT=PT1.05S 9130 rows inserted. dT=PT1.048S 9140 rows inserted. dT=PT1.013S 9150 rows inserted. dT=PT1.012S 9160 rows inserted. dT=PT1.05S 9170 rows inserted. dT=PT1.071S 9180 rows inserted. dT=PT1.054S 9190 rows inserted. dT=PT1.046S 9200 rows inserted. dT=PT1.037S 9210 rows inserted. dT=PT0.966S 9220 rows inserted. dT=PT1.217S 9230 rows inserted. dT=PT1.024S 9240 rows inserted. dT=PT0.99S 9250 rows inserted. dT=PT0.809S 9260 rows inserted. dT=PT1.006S 9270 rows inserted. dT=PT1.035S 9280 rows inserted. dT=PT1.173S 9290 rows inserted. dT=PT0.87S 9300 rows inserted. dT=PT1.235S 9310 rows inserted. dT=PT1.066S 9320 rows inserted. dT=PT1.107S 9330 rows inserted. dT=PT0.975S 9340 rows inserted. dT=PT1.09S 9350 rows inserted. dT=PT1.002S 9360 rows inserted. dT=PT0.956S 9370 rows inserted. dT=PT1.092S 9380 rows inserted. dT=PT1.042S 9390 rows inserted. dT=PT1.016S 9400 rows inserted. dT=PT0.974S 9410 rows inserted. dT=PT1.039S 9420 rows inserted. dT=PT1.041S 9430 rows inserted. dT=PT1.029S 9440 rows inserted. dT=PT1.024S 9450 rows inserted. dT=PT0.977S 9460 rows inserted. dT=PT1.011S 9470 rows inserted. dT=PT0.984S 9480 rows inserted. dT=PT0.971S 9490 rows inserted. dT=PT1.044S 9500 rows inserted. dT=PT1.044S 9510 rows inserted. dT=PT1.06S 9520 rows inserted. dT=PT1.006S 9530 rows inserted. dT=PT1.002S 9540 rows inserted. dT=PT1.01S 9550 rows inserted. dT=PT0.941S 9560 rows inserted. dT=PT1.011S 9570 rows inserted. dT=PT1.007S 9580 rows inserted. dT=PT1.002S 9590 rows inserted. dT=PT0.976S 9600 rows inserted. dT=PT1.044S 9610 rows inserted. dT=PT1.004S 9620 rows inserted. dT=PT1.251S 9630 rows inserted. dT=PT0.834S 9640 rows inserted. dT=PT1.006S 9650 rows inserted. dT=PT1.044S 9660 rows inserted. dT=PT0.964S 9670 rows inserted. dT=PT0.984S 9680 rows inserted. dT=PT1.215S 9690 rows inserted. dT=PT0.9S 9700 rows inserted. dT=PT0.896S 9710 rows inserted. dT=PT0.991S 9720 rows inserted. dT=PT1.345S 9730 rows inserted. dT=PT1.061S 9740 rows inserted. dT=PT1.096S 9750 rows inserted. dT=PT0.969S 9760 rows inserted. dT=PT1.077S 9770 rows inserted. dT=PT1.019S 9780 rows inserted. dT=PT0.984S 9790 rows inserted. dT=PT0.987S 9800 rows inserted. dT=PT1.018S 9810 rows inserted. dT=PT0.986S 9820 rows inserted. dT=PT0.987S 9830 rows inserted. dT=PT1.005S 9840 rows inserted. dT=PT1.05S 9850 rows inserted. dT=PT1.004S 9860 rows inserted. dT=PT1.071S 9870 rows inserted. dT=PT1.028S 9880 rows inserted. dT=PT1S 9890 rows inserted. dT=PT1.077S 9900 rows inserted. dT=PT1.019S 9910 rows inserted. dT=PT1.131S 9920 rows inserted. dT=PT0.992S 9930 rows inserted. dT=PT1.026S 9940 rows inserted. dT=PT1.079S 9950 rows inserted. dT=PT0.952S 9960 rows inserted. dT=PT0.957S 9970 rows inserted. dT=PT1.015S 9980 rows inserted. dT=PT1.036S 9990 rows inserted. dT=PT1.142S 10000 rows inserted. dT=PT0.873S IgniteProject(ROWCOUNT=[CAST($0):BIGINT NOT NULL]) IgniteColocatedHashAggregate(group=[{}], agg#0=[$SUM0($0)]) IgniteExchange(distribution=[single]) IgniteTableModify(table=[[PUBLIC, T]], operation=[DELETE], flattened=[false]) IgniteTableScan(table=[[PUBLIC, T]], requiredColumns=[{0}]) Iteration 2 started 10 rows inserted. dT=PT0.969S 20 rows inserted. dT=PT0.953S 30 rows inserted. dT=PT1.006S 40 rows inserted. dT=PT1S 50 rows inserted. dT=PT1.024S 60 rows inserted. dT=PT1.053S 70 rows inserted. dT=PT1.09S 80 rows inserted. dT=PT0.992S 90 rows inserted. dT=PT1.06S 100 rows inserted. dT=PT1.044S 110 rows inserted. dT=PT1.017S 120 rows inserted. dT=PT1.03S 130 rows inserted. dT=PT1.004S 140 rows inserted. dT=PT1.084S 150 rows inserted. dT=PT1.066S 160 rows inserted. dT=PT1.377S 170 rows inserted. dT=PT1.066S 2023-05-08 19:30:42:481 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Checkpoint started [checkpointId=45346a20-bdd9-4de3-8565-91e9bccda54d, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=136, reason='timeout'] 180 rows inserted. dT=PT1.031S 2023-05-08 19:30:42:842 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Checkpoint finished [checkpointId=45346a20-bdd9-4de3-8565-91e9bccda54d, pages=136, pagesWriteTime=100ms, fsyncTime=252ms, totalTime=363ms] 190 rows inserted. dT=PT1.422S 200 rows inserted. dT=PT0.985S 210 rows inserted. dT=PT1S 220 rows inserted. dT=PT1.009S 230 rows inserted. dT=PT1.048S 240 rows inserted. dT=PT0.987S 250 rows inserted. dT=PT1.035S 260 rows inserted. dT=PT0.987S 270 rows inserted. dT=PT1.017S 280 rows inserted. dT=PT1.185S 290 rows inserted. dT=PT0.853S 300 rows inserted. dT=PT1.109S 310 rows inserted. dT=PT1.244S 320 rows inserted. dT=PT0.968S 330 rows inserted. dT=PT1.053S 340 rows inserted. dT=PT1.042S 350 rows inserted. dT=PT0.996S 2023-05-08 19:31:01:352 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Checkpoint started [checkpointId=8a0981ee-d260-4313-9d50-8dd76e120f05, checkpointBeforeWriteLockTime=11ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=79, reason='timeout'] 360 rows inserted. dT=PT0.995S 2023-05-08 19:31:01:634 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Checkpoint finished [checkpointId=8a0981ee-d260-4313-9d50-8dd76e120f05, pages=79, pagesWriteTime=138ms, fsyncTime=127ms, totalTime=287ms] 370 rows inserted. dT=PT1.264S 380 rows inserted. dT=PT0.951S 390 rows inserted. dT=PT1.003S 400 rows inserted. dT=PT0.982S 410 rows inserted. dT=PT1.061S 420 rows inserted. dT=PT1.046S 430 rows inserted. dT=PT0.997S 440 rows inserted. dT=PT1.068S 450 rows inserted. dT=PT1.171S 460 rows inserted. dT=PT1.021S 470 rows inserted. dT=PT1.036S 480 rows inserted. dT=PT1.323S 490 rows inserted. dT=PT0.967S 500 rows inserted. dT=PT0.886S 510 rows inserted. dT=PT1.145S 520 rows inserted. dT=PT0.962S 530 rows inserted. dT=PT0.822S 2023-05-08 19:31:19:446 +0300 [INFO][%idt_n_0%checkpoint-thread-1][Checkpointer] Checkpoint started [checkpointId=ad20cf3d-e21f-4490-b0d9-ece389789443, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=170, reason='timeout'] 2023-05-08 19:31:19:857 +0300 [INFO][%idt_n_0%checkpoint-thread-1][Checkpointer] Checkpoint finished [checkpointId=ad20cf3d-e21f-4490-b0d9-ece389789443, pages=170, pagesWriteTime=148ms, fsyncTime=237ms, totalTime=408ms] 540 rows inserted. dT=PT1.604S 550 rows inserted. dT=PT1.053S 560 rows inserted. dT=PT0.969S 570 rows inserted. dT=PT1.031S 580 rows inserted. dT=PT1.029S 590 rows inserted. dT=PT1.016S 600 rows inserted. dT=PT1.002S 610 rows inserted. dT=PT1.001S 620 rows inserted. dT=PT1.081S 630 rows inserted. dT=PT1.069S 640 rows inserted. dT=PT0.971S 650 rows inserted. dT=PT0.988S 660 rows inserted. dT=PT1.005S 670 rows inserted. dT=PT1.02S 680 rows inserted. dT=PT1.042S 690 rows inserted. dT=PT0.906S 700 rows inserted. dT=PT0.975S 710 rows inserted. dT=PT0.981S 720 rows inserted. dT=PT1.031S 730 rows inserted. dT=PT0.955S 740 rows inserted. dT=PT1.082S 750 rows inserted. dT=PT1.019S 760 rows inserted. dT=PT1.017S 770 rows inserted. dT=PT0.955S 780 rows inserted. dT=PT1.033S 790 rows inserted. dT=PT0.995S 800 rows inserted. dT=PT1.02S 810 rows inserted. dT=PT1.023S 820 rows inserted. dT=PT1.364S 830 rows inserted. dT=PT0.866S 840 rows inserted. dT=PT1.19S 850 rows inserted. dT=PT0.994S 860 rows inserted. dT=PT0.998S 870 rows inserted. dT=PT1.032S 880 rows inserted. dT=PT1.042S 890 rows inserted. dT=PT1.023S 900 rows inserted. dT=PT1.005S 910 rows inserted. dT=PT1.062S 920 rows inserted. dT=PT1.03S 930 rows inserted. dT=PT0.953S 940 rows inserted. dT=PT1.047S 950 rows inserted. dT=PT0.99S 960 rows inserted. dT=PT1.042S 970 rows inserted. dT=PT1.016S 980 rows inserted. dT=PT1.026S 990 rows inserted. dT=PT1.023S 1000 rows inserted. dT=PT0.963S 1010 rows inserted. dT=PT1.012S 1020 rows inserted. dT=PT1.058S 1030 rows inserted. dT=PT1.162S 1040 rows inserted. dT=PT1.05S 1050 rows inserted. dT=PT1.066S 1060 rows inserted. dT=PT1.154S 1070 rows inserted. dT=PT0.883S 1080 rows inserted. dT=PT1.003S 1090 rows inserted. dT=PT0.959S 1100 rows inserted. dT=PT0.983S 1110 rows inserted. dT=PT0.975S 1120 rows inserted. dT=PT1.085S 1130 rows inserted. dT=PT1.315S 1140 rows inserted. dT=PT0.985S 1150 rows inserted. dT=PT1.013S 1160 rows inserted. dT=PT1.058S 1170 rows inserted. dT=PT1.024S 1180 rows inserted. dT=PT1.046S 1190 rows inserted. dT=PT1.001S 1200 rows inserted. dT=PT0.996S 1210 rows inserted. dT=PT0.985S 1220 rows inserted. dT=PT0.974S 1230 rows inserted. dT=PT1.009S 1240 rows inserted. dT=PT1.052S 1250 rows inserted. dT=PT0.949S 1260 rows inserted. dT=PT1.02S 1270 rows inserted. dT=PT1.057S 1280 rows inserted. dT=PT1.026S 1290 rows inserted. dT=PT0.986S 1300 rows inserted. dT=PT1.071S 1310 rows inserted. dT=PT1.021S 1320 rows inserted. dT=PT1.154S 1330 rows inserted. dT=PT0.994S 1340 rows inserted. dT=PT1.017S 1350 rows inserted. dT=PT1.037S 1360 rows inserted. dT=PT1.015S 1370 rows inserted. dT=PT1.075S 1380 rows inserted. dT=PT1.027S 1390 rows inserted. dT=PT0.995S 1400 rows inserted. dT=PT0.983S 1410 rows inserted. dT=PT1.056S 2023-05-08 19:32:50:274 +0300 [INFO][%idt_n_0%vault-3][LowWatermark] Successful low watermark update: HybridTimestamp [time=110333845193621504] 2023-05-08 19:32:50:867 +0300 [INFO][%idt_n_2%vault-3][LowWatermark] Successful low watermark update: HybridTimestamp [time=110333845232091136] 2023-05-08 19:32:51:032 +0300 [INFO][%idt_n_1%vault-3][LowWatermark] Successful low watermark update: HybridTimestamp [time=110333845243494400] 1420 rows inserted. dT=PT1.16S 1430 rows inserted. dT=PT0.887S 1440 rows inserted. dT=PT1.014S 1450 rows inserted. dT=PT0.992S 1460 rows inserted. dT=PT1.195S 1470 rows inserted. dT=PT1.146S 1480 rows inserted. dT=PT1.058S 1490 rows inserted. dT=PT0.981S 1500 rows inserted. dT=PT0.99S 1510 rows inserted. dT=PT0.998S 1520 rows inserted. dT=PT1.048S 1530 rows inserted. dT=PT1.05S 1540 rows inserted. dT=PT1.016S 1550 rows inserted. dT=PT1.02S 1560 rows inserted. dT=PT0.997S 1570 rows inserted. dT=PT1.025S 1580 rows inserted. dT=PT1.082S 1590 rows inserted. dT=PT1.042S 1600 rows inserted. dT=PT0.971S 1610 rows inserted. dT=PT1.175S 1620 rows inserted. dT=PT1.08S 1630 rows inserted. dT=PT1.003S 1640 rows inserted. dT=PT1.042S 1650 rows inserted. dT=PT0.969S 1660 rows inserted. dT=PT1.066S 1670 rows inserted. dT=PT0.954S 1680 rows inserted. dT=PT1.035S 1690 rows inserted. dT=PT1.019S 1700 rows inserted. dT=PT1.002S 1710 rows inserted. dT=PT0.952S 1720 rows inserted. dT=PT0.977S 1730 rows inserted. dT=PT1.047S 1740 rows inserted. dT=PT0.97S 1750 rows inserted. dT=PT0.999S 1760 rows inserted. dT=PT1.084S 1770 rows inserted. dT=PT0.963S 1780 rows inserted. dT=PT0.982S 1790 rows inserted. dT=PT1.227S 1800 rows inserted. dT=PT0.829S 1810 rows inserted. dT=PT0.971S 1820 rows inserted. dT=PT0.949S 1830 rows inserted. dT=PT1.054S 1840 rows inserted. dT=PT0.976S 1850 rows inserted. dT=PT1.211S 1860 rows inserted. dT=PT0.886S 1870 rows inserted. dT=PT0.905S 1880 rows inserted. dT=PT1.197S 1890 rows inserted. dT=PT0.895S 1900 rows inserted. dT=PT1.143S 1910 rows inserted. dT=PT1.223S 1920 rows inserted. dT=PT1.018S 1930 rows inserted. dT=PT1.037S 1940 rows inserted. dT=PT1.016S 1950 rows inserted. dT=PT1S 1960 rows inserted. dT=PT0.958S 1970 rows inserted. dT=PT1.002S 1980 rows inserted. dT=PT0.98S 1990 rows inserted. dT=PT1.023S 2000 rows inserted. dT=PT0.961S 2010 rows inserted. dT=PT1.039S 2020 rows inserted. dT=PT0.963S 2030 rows inserted. dT=PT0.991S 2040 rows inserted. dT=PT1.023S 2050 rows inserted. dT=PT0.999S 2060 rows inserted. dT=PT1.076S 2070 rows inserted. dT=PT0.999S 2080 rows inserted. dT=PT1.059S 2090 rows inserted. dT=PT1.027S 2100 rows inserted. dT=PT1.011S 2110 rows inserted. dT=PT1.046S 2120 rows inserted. dT=PT1.002S 2130 rows inserted. dT=PT0.994S 2140 rows inserted. dT=PT1.004S 2150 rows inserted. dT=PT0.971S 2160 rows inserted. dT=PT1.026S 2170 rows inserted. dT=PT0.994S 2180 rows inserted. dT=PT1.025S 2190 rows inserted. dT=PT1.026S 2200 rows inserted. dT=PT1.07S 2210 rows inserted. dT=PT1.015S 2023-05-08 19:34:12:684 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Checkpoint started [checkpointId=f66a18a2-de66-4afe-a0f1-73db568ce598, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=94, reason='timeout'] 2220 rows inserted. dT=PT1.182S 2023-05-08 19:34:13:064 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Checkpoint finished [checkpointId=f66a18a2-de66-4afe-a0f1-73db568ce598, pages=94, pagesWriteTime=143ms, fsyncTime=241ms, totalTime=384ms] 2230 rows inserted. dT=PT1.561S 2240 rows inserted. dT=PT1.041S 2250 rows inserted. dT=PT1.05S 2260 rows inserted. dT=PT1.051S 2270 rows inserted. dT=PT1.075S 2280 rows inserted. dT=PT1.03S 2290 rows inserted. dT=PT1.068S 2300 rows inserted. dT=PT1.026S 2310 rows inserted. dT=PT0.958S 2320 rows inserted. dT=PT1.046S 2023-05-08 19:34:24:359 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Checkpoint started [checkpointId=24da99f3-dfc3-4bad-a0ac-b3b8ebf00f48, checkpointBeforeWriteLockTime=11ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=52, reason='timeout'] 2023-05-08 19:34:24:757 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Checkpoint finished [checkpointId=24da99f3-dfc3-4bad-a0ac-b3b8ebf00f48, pages=52, pagesWriteTime=251ms, fsyncTime=134ms, totalTime=411ms] 2330 rows inserted. dT=PT1.598S 2023-05-08 19:34:25:775 +0300 [INFO][%idt_n_0%checkpoint-thread-1][Checkpointer] Checkpoint started [checkpointId=d60a1ec4-5611-4e0d-975e-5cf7e0eaf017, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=115, reason='timeout'] 2023-05-08 19:34:26:217 +0300 [INFO][%idt_n_0%checkpoint-thread-1][Checkpointer] Checkpoint finished [checkpointId=d60a1ec4-5611-4e0d-975e-5cf7e0eaf017, pages=115, pagesWriteTime=98ms, fsyncTime=313ms, totalTime=435ms] 2340 rows inserted. dT=PT1.47S 2350 rows inserted. dT=PT1.002S 2360 rows inserted. dT=PT1.032S 2370 rows inserted. dT=PT0.943S 2380 rows inserted. dT=PT0.94S 2390 rows inserted. dT=PT1.009S 2400 rows inserted. dT=PT1.096S 2410 rows inserted. dT=PT1.002S 2420 rows inserted. dT=PT1.275S 2430 rows inserted. dT=PT1.055S 2440 rows inserted. dT=PT1.029S 2450 rows inserted. dT=PT1.07S 2460 rows inserted. dT=PT1.002S 2470 rows inserted. dT=PT1.18S 2480 rows inserted. dT=PT1.068S 2490 rows inserted. dT=PT0.989S 2500 rows inserted. dT=PT0.983S 2510 rows inserted. dT=PT1.005S 2520 rows inserted. dT=PT1.01S 2530 rows inserted. dT=PT1.063S 2540 rows inserted. dT=PT1.027S 2550 rows inserted. dT=PT1.088S 2560 rows inserted. dT=PT1.013S 2570 rows inserted. dT=PT1.034S 2580 rows inserted. dT=PT1.056S 2590 rows inserted. dT=PT1.034S 2600 rows inserted. dT=PT0.975S 2610 rows inserted. dT=PT1.017S 2620 rows inserted. dT=PT0.982S 2630 rows inserted. dT=PT0.999S 2640 rows inserted. dT=PT0.945S 2650 rows inserted. dT=PT1.026S 2660 rows inserted. dT=PT1.031S 2670 rows inserted. dT=PT0.995S 2680 rows inserted. dT=PT0.977S 2690 rows inserted. dT=PT1.053S 2700 rows inserted. dT=PT1.006S 2710 rows inserted. dT=PT0.996S 2720 rows inserted. dT=PT1.027S 2730 rows inserted. dT=PT1.167S 2740 rows inserted. dT=PT0.848S 2750 rows inserted. dT=PT0.996S 2760 rows inserted. dT=PT1.458S 2770 rows inserted. dT=PT1.042S 2780 rows inserted. dT=PT1S 2790 rows inserted. dT=PT1.06S 2800 rows inserted. dT=PT0.981S 2810 rows inserted. dT=PT0.996S 2820 rows inserted. dT=PT1.042S 2830 rows inserted. dT=PT1.017S 2840 rows inserted. dT=PT1.043S 2850 rows inserted. dT=PT0.975S 2860 rows inserted. dT=PT1.012S 2870 rows inserted. dT=PT1.017S 2880 rows inserted. dT=PT0.973S 2890 rows inserted. dT=PT1.046S 2900 rows inserted. dT=PT1.047S 2910 rows inserted. dT=PT1.002S 2920 rows inserted. dT=PT1.029S 2930 rows inserted. dT=PT1.024S 2940 rows inserted. dT=PT0.982S 2950 rows inserted. dT=PT1.025S 2960 rows inserted. dT=PT1.026S 2970 rows inserted. dT=PT1.056S 2980 rows inserted. dT=PT0.991S 2990 rows inserted. dT=PT1.025S 3000 rows inserted. dT=PT0.972S 3010 rows inserted. dT=PT0.976S 3020 rows inserted. dT=PT1.031S 3030 rows inserted. dT=PT0.936S 3040 rows inserted. dT=PT1.062S 3050 rows inserted. dT=PT1.075S 3060 rows inserted. dT=PT1.085S 3070 rows inserted. dT=PT1.202S 3080 rows inserted. dT=PT0.827S 3090 rows inserted. dT=PT0.953S 3100 rows inserted. dT=PT0.969S 3110 rows inserted. dT=PT0.91S 3120 rows inserted. dT=PT1.027S 3130 rows inserted. dT=PT1.006S 3140 rows inserted. dT=PT1.017S 3150 rows inserted. dT=PT1.044S 3160 rows inserted. dT=PT1.033S 3170 rows inserted. dT=PT1.334S 3180 rows inserted. dT=PT0.794S 3190 rows inserted. dT=PT0.981S 3200 rows inserted. dT=PT1.236S 3210 rows inserted. dT=PT1.078S 3220 rows inserted. dT=PT0.997S 3230 rows inserted. dT=PT1.048S 3240 rows inserted. dT=PT0.997S 3250 rows inserted. dT=PT1.051S 3260 rows inserted. dT=PT1.054S 3270 rows inserted. dT=PT0.997S 3280 rows inserted. dT=PT0.986S 3290 rows inserted. dT=PT1.025S 3300 rows inserted. dT=PT1.027S 3310 rows inserted. dT=PT1.021S 3320 rows inserted. dT=PT0.967S 3330 rows inserted. dT=PT0.948S 3340 rows inserted. dT=PT1.044S 3350 rows inserted. dT=PT1.221S 3360 rows inserted. dT=PT0.979S 3370 rows inserted. dT=PT1.041S 3380 rows inserted. dT=PT1.03S 3390 rows inserted. dT=PT0.982S 3400 rows inserted. dT=PT0.981S 3410 rows inserted. dT=PT1.043S 3420 rows inserted. dT=PT0.97S 3430 rows inserted. dT=PT0.953S 3440 rows inserted. dT=PT1.02S 3450 rows inserted. dT=PT1.001S 3460 rows inserted. dT=PT0.992S 3470 rows inserted. dT=PT1.042S 3480 rows inserted. dT=PT0.98S 3490 rows inserted. dT=PT1.029S 3500 rows inserted. dT=PT1.01S 3510 rows inserted. dT=PT0.969S 3520 rows inserted. dT=PT1.013S 3530 rows inserted. dT=PT1.004S 3540 rows inserted. dT=PT0.979S 3550 rows inserted. dT=PT1.058S 3560 rows inserted. dT=PT0.994S 3570 rows inserted. dT=PT1.049S 3580 rows inserted. dT=PT1.015S 3590 rows inserted. dT=PT1.035S 3600 rows inserted. dT=PT1.026S 2023-05-08 19:36:36:745 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Checkpoint started [checkpointId=9c8e4fed-0a69-4cf6-a959-7728109b3996, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=132, reason='timeout'] 2023-05-08 19:36:37:145 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Checkpoint finished [checkpointId=9c8e4fed-0a69-4cf6-a959-7728109b3996, pages=132, pagesWriteTime=131ms, fsyncTime=265ms, totalTime=396ms] 3610 rows inserted. dT=PT1.567S 3620 rows inserted. dT=PT1.101S 3630 rows inserted. dT=PT1.034S 3640 rows inserted. dT=PT1.207S 3650 rows inserted. dT=PT0.99S 3660 rows inserted. dT=PT1.01S 3670 rows inserted. dT=PT1.012S 3680 rows inserted. dT=PT1.073S 3690 rows inserted. dT=PT1.115S 3700 rows inserted. dT=PT0.944S 3710 rows inserted. dT=PT0.988S 3720 rows inserted. dT=PT0.938S 3730 rows inserted. dT=PT1.016S 3740 rows inserted. dT=PT1.049S 3750 rows inserted. dT=PT0.938S 3760 rows inserted. dT=PT1.034S 3770 rows inserted. dT=PT1.337S 3780 rows inserted. dT=PT0.995S 3790 rows inserted. dT=PT1.053S 3800 rows inserted. dT=PT0.999S 3810 rows inserted. dT=PT0.986S 3820 rows inserted. dT=PT1.051S 3830 rows inserted. dT=PT1.091S 3840 rows inserted. dT=PT1.035S 3850 rows inserted. dT=PT0.989S 3860 rows inserted. dT=PT1.063S 3870 rows inserted. dT=PT1.001S 3880 rows inserted. dT=PT1.039S 3890 rows inserted. dT=PT1.065S 3900 rows inserted. dT=PT1.03S 3910 rows inserted. dT=PT1.017S 3920 rows inserted. dT=PT1.002S 3930 rows inserted. dT=PT1.187S 3940 rows inserted. dT=PT0.986S 3950 rows inserted. dT=PT1.05S 3960 rows inserted. dT=PT1.107S 3970 rows inserted. dT=PT0.967S 3980 rows inserted. dT=PT1.042S 3990 rows inserted. dT=PT1.171S 4000 rows inserted. dT=PT0.789S 4010 rows inserted. dT=PT1.272S 4020 rows inserted. dT=PT0.779S 2023-05-08 19:37:20:155 +0300 [INFO][%idt_n_0%checkpoint-thread-1][Checkpointer] Checkpoint started [checkpointId=c36d5618-2aef-485f-a30c-3f86ae2e12f9, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=159, reason='timeout'] 2023-05-08 19:37:20:894 +0300 [INFO][%idt_n_0%checkpoint-thread-1][Checkpointer] Checkpoint finished [checkpointId=c36d5618-2aef-485f-a30c-3f86ae2e12f9, pages=159, pagesWriteTime=408ms, fsyncTime=303ms, totalTime=737ms] 4030 rows inserted. dT=PT1.705S 2023-05-08 19:37:22:137 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Checkpoint started [checkpointId=9b724a33-8e32-461f-a466-da712c312c89, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=76, reason='timeout'] 2023-05-08 19:37:22:633 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Checkpoint finished [checkpointId=9b724a33-8e32-461f-a466-da712c312c89, pages=76, pagesWriteTime=365ms, fsyncTime=134ms, totalTime=499ms] 4040 rows inserted. dT=PT1.581S 4050 rows inserted. dT=PT1.014S 4060 rows inserted. dT=PT0.902S 4070 rows inserted. dT=PT0.777S 4080 rows inserted. dT=PT1.281S 4090 rows inserted. dT=PT1.039S 4100 rows inserted. dT=PT0.977S 4110 rows inserted. dT=PT1.085S 4120 rows inserted. dT=PT0.988S 4130 rows inserted. dT=PT1.01S 4140 rows inserted. dT=PT0.919S 4150 rows inserted. dT=PT1.071S 4160 rows inserted. dT=PT1.072S 4170 rows inserted. dT=PT0.989S 4180 rows inserted. dT=PT1.039S 4190 rows inserted. dT=PT1.011S 4200 rows inserted. dT=PT1.017S 4210 rows inserted. dT=PT1.211S 4220 rows inserted. dT=PT0.989S 4230 rows inserted. dT=PT1.082S 4240 rows inserted. dT=PT1.027S 4250 rows inserted. dT=PT1.01S 4260 rows inserted. dT=PT0.981S 4270 rows inserted. dT=PT1S 4280 rows inserted. dT=PT1.004S 4290 rows inserted. dT=PT1.071S 4300 rows inserted. dT=PT1.026S 2023-05-08 19:37:50:305 +0300 [INFO][%idt_n_0%vault-0][LowWatermark] Successful low watermark update: HybridTimestamp [time=110333864856387584] 2023-05-08 19:37:50:890 +0300 [INFO][%idt_n_2%vault-1][LowWatermark] Successful low watermark update: HybridTimestamp [time=110333864895381504] 4310 rows inserted. dT=PT0.977S 2023-05-08 19:37:51:056 +0300 [INFO][%idt_n_1%vault-1][LowWatermark] Successful low watermark update: HybridTimestamp [time=110333864906326016] 4320 rows inserted. dT=PT1.031S 4330 rows inserted. dT=PT1.003S 4340 rows inserted. dT=PT1.044S 4350 rows inserted. dT=PT1.358S 4360 rows inserted. dT=PT1.065S 4370 rows inserted. dT=PT0.995S 4380 rows inserted. dT=PT1.02S 4390 rows inserted. dT=PT1.023S 4400 rows inserted. dT=PT0.975S 4410 rows inserted. dT=PT0.995S 4420 rows inserted. dT=PT1.095S 4430 rows inserted. dT=PT1.001S 4440 rows inserted. dT=PT0.977S 4450 rows inserted. dT=PT0.996S 4460 rows inserted. dT=PT0.999S 4470 rows inserted. dT=PT1.038S 4480 rows inserted. dT=PT1.027S 4490 rows inserted. dT=PT1.023S 4500 rows inserted. dT=PT1.092S 4510 rows inserted. dT=PT0.96S 4520 rows inserted. dT=PT0.964S 4530 rows inserted. dT=PT0.997S 4540 rows inserted. dT=PT0.975S 4550 rows inserted. dT=PT1.094S 4560 rows inserted. dT=PT1.016S 4570 rows inserted. dT=PT1.016S 4580 rows inserted. dT=PT1.01S 4590 rows inserted. dT=PT1.023S 4600 rows inserted. dT=PT0.972S 4610 rows inserted. dT=PT1.007S 4620 rows inserted. dT=PT0.982S 4630 rows inserted. dT=PT1.022S 4640 rows inserted. dT=PT1.04S 4650 rows inserted. dT=PT1.039S 4660 rows inserted. dT=PT0.998S 4670 rows inserted. dT=PT0.957S 4680 rows inserted. dT=PT1.032S 4690 rows inserted. dT=PT1.039S 4700 rows inserted. dT=PT0.964S 4710 rows inserted. dT=PT1.02S 4720 rows inserted. dT=PT0.963S 4730 rows inserted. dT=PT0.975S 4740 rows inserted. dT=PT0.991S 4750 rows inserted. dT=PT1.001S 4760 rows inserted. dT=PT1.03S 4770 rows inserted. dT=PT1.02S 4780 rows inserted. dT=PT0.959S 4790 rows inserted. dT=PT0.934S 4800 rows inserted. dT=PT1.132S 4810 rows inserted. dT=PT1.049S 4820 rows inserted. dT=PT1.045S 4830 rows inserted. dT=PT1.021S 4840 rows inserted. dT=PT1.008S 4850 rows inserted. dT=PT0.977S 4860 rows inserted. dT=PT1.062S 4870 rows inserted. dT=PT0.998S 4880 rows inserted. dT=PT0.99S 4890 rows inserted. dT=PT1.018S 4900 rows inserted. dT=PT1.145S 4910 rows inserted. dT=PT0.975S 4920 rows inserted. dT=PT0.865S 4930 rows inserted. dT=PT1S 4940 rows inserted. dT=PT1.099S 4950 rows inserted. dT=PT1.143S 4960 rows inserted. dT=PT0.846S 4970 rows inserted. dT=PT1.197S 4980 rows inserted. dT=PT0.907S 4990 rows inserted. dT=PT1.166S 5000 rows inserted. dT=PT1.019S 5010 rows inserted. dT=PT1.044S 5020 rows inserted. dT=PT1.018S 5030 rows inserted. dT=PT1.093S 5040 rows inserted. dT=PT1.041S 5050 rows inserted. dT=PT1.001S 2023-05-08 19:39:06:796 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Checkpoint started [checkpointId=16b08b44-bb2f-45fa-80b8-6caf3f013838, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=123, reason='timeout'] 2023-05-08 19:39:07:149 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Checkpoint finished [checkpointId=16b08b44-bb2f-45fa-80b8-6caf3f013838, pages=123, pagesWriteTime=117ms, fsyncTime=233ms, totalTime=350ms] 5060 rows inserted. dT=PT1.395S 5070 rows inserted. dT=PT1.322S 5080 rows inserted. dT=PT1.199S 5090 rows inserted. dT=PT1.067S 5100 rows inserted. dT=PT1.011S 5110 rows inserted. dT=PT1.066S 5120 rows inserted. dT=PT1.003S 5130 rows inserted. dT=PT1.003S 5140 rows inserted. dT=PT1S 5150 rows inserted. dT=PT1.057S 5160 rows inserted. dT=PT1.074S 5170 rows inserted. dT=PT1.047S 5180 rows inserted. dT=PT1.039S 5190 rows inserted. dT=PT0.982S 5200 rows inserted. dT=PT1.04S 5210 rows inserted. dT=PT1.006S 5220 rows inserted. dT=PT1.008S 5230 rows inserted. dT=PT1.064S 5240 rows inserted. dT=PT0.934S 5250 rows inserted. dT=PT0.998S 5260 rows inserted. dT=PT1.036S 5270 rows inserted. dT=PT1.002S 5280 rows inserted. dT=PT1.061S 5290 rows inserted. dT=PT1.072S 5300 rows inserted. dT=PT0.948S 5310 rows inserted. dT=PT1.225S 5320 rows inserted. dT=PT0.856S 5330 rows inserted. dT=PT1.053S 5340 rows inserted. dT=PT1.284S 5350 rows inserted. dT=PT1.061S 5360 rows inserted. dT=PT0.993S 5370 rows inserted. dT=PT1.096S 5380 rows inserted. dT=PT0.972S 5390 rows inserted. dT=PT0.985S 5400 rows inserted. dT=PT1.001S 5410 rows inserted. dT=PT1.033S 5420 rows inserted. dT=PT1.031S 5430 rows inserted. dT=PT1.073S 5440 rows inserted. dT=PT0.962S 5450 rows inserted. dT=PT1.033S 5460 rows inserted. dT=PT1.086S 5470 rows inserted. dT=PT1.04S 5480 rows inserted. dT=PT0.925S 5490 rows inserted. dT=PT0.943S 5500 rows inserted. dT=PT1.025S 5510 rows inserted. dT=PT1S 5520 rows inserted. dT=PT0.996S 5530 rows inserted. dT=PT1.018S 5540 rows inserted. dT=PT0.975S 5550 rows inserted. dT=PT1.024S 5560 rows inserted. dT=PT1S 5570 rows inserted. dT=PT1.003S 5580 rows inserted. dT=PT1.009S 5590 rows inserted. dT=PT1.048S 5600 rows inserted. dT=PT1.001S 5610 rows inserted. dT=PT0.997S 5620 rows inserted. dT=PT0.97S 2023-05-08 19:40:05:790 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Checkpoint started [checkpointId=7c63a2cd-18d2-446a-bada-142da8776ee6, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=69, reason='timeout'] 2023-05-08 19:40:05:986 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Checkpoint finished [checkpointId=7c63a2cd-18d2-446a-bada-142da8776ee6, pages=69, pagesWriteTime=48ms, fsyncTime=135ms, totalTime=195ms] 5630 rows inserted. dT=PT1.251S 5640 rows inserted. dT=PT1.007S 5650 rows inserted. dT=PT1.002S 5660 rows inserted. dT=PT1.134S 5670 rows inserted. dT=PT1.341S 5680 rows inserted. dT=PT1S 5690 rows inserted. dT=PT1.015S 5700 rows inserted. dT=PT1.059S 5710 rows inserted. dT=PT1.057S 5720 rows inserted. dT=PT0.982S 5730 rows inserted. dT=PT1.053S 5740 rows inserted. dT=PT1.016S 5750 rows inserted. dT=PT1.028S 5760 rows inserted. dT=PT1.043S 5770 rows inserted. dT=PT1.078S 5780 rows inserted. dT=PT1.061S 5790 rows inserted. dT=PT1.054S 5800 rows inserted. dT=PT0.961S 5810 rows inserted. dT=PT1.056S 5820 rows inserted. dT=PT0.985S 2023-05-08 19:40:27:033 +0300 [INFO][%idt_n_0%checkpoint-thread-1][Checkpointer] Checkpoint started [checkpointId=7f8ea5cb-a74d-412d-933c-41196807f45d, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=158, reason='timeout'] 2023-05-08 19:40:27:797 +0300 [INFO][%idt_n_0%checkpoint-thread-1][Checkpointer] Checkpoint finished [checkpointId=7f8ea5cb-a74d-412d-933c-41196807f45d, pages=158, pagesWriteTime=459ms, fsyncTime=303ms, totalTime=762ms] 5830 rows inserted. dT=PT1.739S 5840 rows inserted. dT=PT1.021S 5850 rows inserted. dT=PT1.038S 5860 rows inserted. dT=PT0.978S 5870 rows inserted. dT=PT1.033S 5880 rows inserted. dT=PT1.013S 5890 rows inserted. dT=PT1.032S 5900 rows inserted. dT=PT0.982S 5910 rows inserted. dT=PT1.018S 5920 rows inserted. dT=PT1.015S 5930 rows inserted. dT=PT0.974S 5940 rows inserted. dT=PT1.019S 5950 rows inserted. dT=PT1.14S 5960 rows inserted. dT=PT0.955S 5970 rows inserted. dT=PT1.016S 5980 rows inserted. dT=PT1.028S 5990 rows inserted. dT=PT1.071S 6000 rows inserted. dT=PT0.949S 6010 rows inserted. dT=PT1S 6020 rows inserted. dT=PT0.968S 6030 rows inserted. dT=PT1.057S 6040 rows inserted. dT=PT1.034S 6050 rows inserted. dT=PT0.978S 6060 rows inserted. dT=PT1.021S 6070 rows inserted. dT=PT1.102S 6080 rows inserted. dT=PT1.187S 6090 rows inserted. dT=PT0.785S 6100 rows inserted. dT=PT1.379S 6110 rows inserted. dT=PT0.98S 6120 rows inserted. dT=PT1S 6130 rows inserted. dT=PT0.989S 6140 rows inserted. dT=PT0.967S 6150 rows inserted. dT=PT1S 6160 rows inserted. dT=PT0.762S 6170 rows inserted. dT=PT1.219S 6180 rows inserted. dT=PT1.005S 6190 rows inserted. dT=PT0.88S 6200 rows inserted. dT=PT1.046S 6210 rows inserted. dT=PT1.118S 6220 rows inserted. dT=PT1.005S 6230 rows inserted. dT=PT1.06S 6240 rows inserted. dT=PT1.105S 6250 rows inserted. dT=PT0.99S 6260 rows inserted. dT=PT1.071S 6270 rows inserted. dT=PT1.033S 6280 rows inserted. dT=PT1.028S 6290 rows inserted. dT=PT1.061S 6300 rows inserted. dT=PT1.051S 6310 rows inserted. dT=PT1.026S 6320 rows inserted. dT=PT1.003S 6330 rows inserted. dT=PT1.023S 6340 rows inserted. dT=PT1.024S 6350 rows inserted. dT=PT1.091S 6360 rows inserted. dT=PT1.081S 6370 rows inserted. dT=PT1.08S 6380 rows inserted. dT=PT1.194S 6390 rows inserted. dT=PT0.962S 6400 rows inserted. dT=PT1.121S 6410 rows inserted. dT=PT1.014S 6420 rows inserted. dT=PT1.104S 6430 rows inserted. dT=PT1.023S 6440 rows inserted. dT=PT1.054S 6450 rows inserted. dT=PT1.014S 6460 rows inserted. dT=PT1.017S 6470 rows inserted. dT=PT1.042S 6480 rows inserted. dT=PT0.977S 6490 rows inserted. dT=PT0.984S 6500 rows inserted. dT=PT0.999S 6510 rows inserted. dT=PT1.021S 6520 rows inserted. dT=PT1.038S 6530 rows inserted. dT=PT1.055S 6540 rows inserted. dT=PT1.036S 6550 rows inserted. dT=PT0.973S 6560 rows inserted. dT=PT1.041S 6570 rows inserted. dT=PT1.056S 6580 rows inserted. dT=PT1.007S 6590 rows inserted. dT=PT1.012S 6600 rows inserted. dT=PT0.982S 6610 rows inserted. dT=PT0.999S 6620 rows inserted. dT=PT1.037S 6630 rows inserted. dT=PT0.992S 6640 rows inserted. dT=PT0.998S 6650 rows inserted. dT=PT1.044S 6660 rows inserted. dT=PT0.999S 6670 rows inserted. dT=PT1.049S 6680 rows inserted. dT=PT1.399S 6690 rows inserted. dT=PT0.893S 6700 rows inserted. dT=PT0.731S 6710 rows inserted. dT=PT0.993S 6720 rows inserted. dT=PT1.066S 6730 rows inserted. dT=PT1.214S 6740 rows inserted. dT=PT1.11S 6750 rows inserted. dT=PT1.045S 6760 rows inserted. dT=PT0.997S 6770 rows inserted. dT=PT1.051S 6780 rows inserted. dT=PT1.012S 6790 rows inserted. dT=PT1.044S 6800 rows inserted. dT=PT1.037S 6810 rows inserted. dT=PT0.971S 2023-05-08 19:42:09:827 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Checkpoint started [checkpointId=d00c4fec-c675-41c6-a5d0-169ba70aa28b, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=135, reason='timeout'] 2023-05-08 19:42:10:141 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Checkpoint finished [checkpointId=d00c4fec-c675-41c6-a5d0-169ba70aa28b, pages=135, pagesWriteTime=120ms, fsyncTime=178ms, totalTime=311ms] 6820 rows inserted. dT=PT1.417S 6830 rows inserted. dT=PT1.004S 6840 rows inserted. dT=PT0.969S 6850 rows inserted. dT=PT1.036S 6860 rows inserted. dT=PT1.004S 6870 rows inserted. dT=PT0.989S 6880 rows inserted. dT=PT0.976S 6890 rows inserted. dT=PT1S 6900 rows inserted. dT=PT1.024S 6910 rows inserted. dT=PT0.992S 6920 rows inserted. dT=PT1.007S 6930 rows inserted. dT=PT0.976S 6940 rows inserted. dT=PT1.013S 6950 rows inserted. dT=PT1.054S 6960 rows inserted. dT=PT1.115S 6970 rows inserted. dT=PT0.991S 6980 rows inserted. dT=PT1.306S 6990 rows inserted. dT=PT1.019S 7000 rows inserted. dT=PT0.976S 7010 rows inserted. dT=PT0.963S 7020 rows inserted. dT=PT1.077S 7030 rows inserted. dT=PT1.002S 7040 rows inserted. dT=PT1.023S 7050 rows inserted. dT=PT1.026S 7060 rows inserted. dT=PT0.995S 7070 rows inserted. dT=PT1.045S 7080 rows inserted. dT=PT1.052S 7090 rows inserted. dT=PT0.996S 7100 rows inserted. dT=PT1.025S 7110 rows inserted. dT=PT1.111S 7120 rows inserted. dT=PT1.063S 7130 rows inserted. dT=PT1.051S 7140 rows inserted. dT=PT1.083S 7150 rows inserted. dT=PT1.062S 7160 rows inserted. dT=PT1.026S 7170 rows inserted. dT=PT1.111S 7180 rows inserted. dT=PT0.871S 7190 rows inserted. dT=PT1.011S 2023-05-08 19:42:50:317 +0300 [INFO][%idt_n_0%vault-1][LowWatermark] Successful low watermark update: HybridTimestamp [time=110333884518629376] 7200 rows inserted. dT=PT1.371S 2023-05-08 19:42:50:911 +0300 [INFO][%idt_n_2%vault-0][LowWatermark] Successful low watermark update: HybridTimestamp [time=110333884556902400] 2023-05-08 19:42:51:081 +0300 [INFO][%idt_n_1%vault-0][LowWatermark] Successful low watermark update: HybridTimestamp [time=110333884568109056] 7210 rows inserted. dT=PT1.06S 7220 rows inserted. dT=PT0.951S 7230 rows inserted. dT=PT1S 7240 rows inserted. dT=PT1.029S 7250 rows inserted. dT=PT1.018S 7260 rows inserted. dT=PT0.997S 7270 rows inserted. dT=PT1.027S 7280 rows inserted. dT=PT0.977S 2023-05-08 19:42:58:557 +0300 [INFO][%idt_n_0%checkpoint-thread-1][Checkpointer] Checkpoint started [checkpointId=5b7bbe82-7de7-4726-8a8b-2736226c7128, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=11ms, checkpointWriteLockHoldTime=11ms, splitAndSortPagesDuration=0ms, pages=174, reason='Triggered by replicator'] 2023-05-08 19:42:58:996 +0300 [INFO][%idt_n_0%checkpoint-thread-1][Checkpointer] Checkpoint finished [checkpointId=5b7bbe82-7de7-4726-8a8b-2736226c7128, pages=174, pagesWriteTime=146ms, fsyncTime=292ms, totalTime=449ms] 7290 rows inserted. dT=PT1.515S 7300 rows inserted. dT=PT1.033S 2023-05-08 19:43:01:162 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Checkpoint started [checkpointId=ecaefad8-898f-429f-95ee-d24ae1bf9d89, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=73, reason='timeout'] 2023-05-08 19:43:01:667 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Checkpoint finished [checkpointId=ecaefad8-898f-429f-95ee-d24ae1bf9d89, pages=73, pagesWriteTime=372ms, fsyncTime=132ms, totalTime=504ms] 7310 rows inserted. dT=PT1.604S 7320 rows inserted. dT=PT1.048S 7330 rows inserted. dT=PT1.032S 7340 rows inserted. dT=PT0.95S 7350 rows inserted. dT=PT1.021S 7360 rows inserted. dT=PT1.072S 7370 rows inserted. dT=PT0.995S 7380 rows inserted. dT=PT1.061S 7390 rows inserted. dT=PT1.185S 7400 rows inserted. dT=PT1.017S 7410 rows inserted. dT=PT1.148S 7420 rows inserted. dT=PT1.041S 7430 rows inserted. dT=PT0.936S 7440 rows inserted. dT=PT0.949S 7450 rows inserted. dT=PT1.02S 7460 rows inserted. dT=PT0.999S 7470 rows inserted. dT=PT0.951S 7480 rows inserted. dT=PT0.984S 7490 rows inserted. dT=PT1.224S 7500 rows inserted. dT=PT0.897S 7510 rows inserted. dT=PT0.975S 7520 rows inserted. dT=PT1.135S 7530 rows inserted. dT=PT0.869S 7540 rows inserted. dT=PT1.293S 7550 rows inserted. dT=PT1.063S 7560 rows inserted. dT=PT1.054S 7570 rows inserted. dT=PT0.981S 7580 rows inserted. dT=PT1.075S 7590 rows inserted. dT=PT0.946S 7600 rows inserted. dT=PT1.006S 7610 rows inserted. dT=PT0.995S 7620 rows inserted. dT=PT1.015S 7630 rows inserted. dT=PT1.056S 7640 rows inserted. dT=PT1.04S 7650 rows inserted. dT=PT1.035S 7660 rows inserted. dT=PT1.004S 7670 rows inserted. dT=PT1.007S 7680 rows inserted. dT=PT1.092S 7690 rows inserted. dT=PT1.039S 7700 rows inserted. dT=PT0.945S 7710 rows inserted. dT=PT0.963S 7720 rows inserted. dT=PT1.068S 7730 rows inserted. dT=PT1.065S 7740 rows inserted. dT=PT0.96S 7750 rows inserted. dT=PT1.018S 7760 rows inserted. dT=PT1.04S 7770 rows inserted. dT=PT1.032S 7780 rows inserted. dT=PT1.018S 7790 rows inserted. dT=PT1.018S 7800 rows inserted. dT=PT1.031S 7810 rows inserted. dT=PT1.044S 7820 rows inserted. dT=PT1.021S 7830 rows inserted. dT=PT1.201S 7840 rows inserted. dT=PT1.158S 7850 rows inserted. dT=PT1.069S 7860 rows inserted. dT=PT1.003S 7870 rows inserted. dT=PT1.05S 7880 rows inserted. dT=PT1.053S 7890 rows inserted. dT=PT1.052S 7900 rows inserted. dT=PT1.07S 7910 rows inserted. dT=PT1.025S 7920 rows inserted. dT=PT1.047S 7930 rows inserted. dT=PT1.035S 7940 rows inserted. dT=PT1.011S 7950 rows inserted. dT=PT1.05S 7960 rows inserted. dT=PT1.01S 7970 rows inserted. dT=PT1.193S 7980 rows inserted. dT=PT1.126S 7990 rows inserted. dT=PT0.848S 8000 rows inserted. dT=PT1.299S 8010 rows inserted. dT=PT0.823S 8020 rows inserted. dT=PT0.994S 8030 rows inserted. dT=PT1.013S 8040 rows inserted. dT=PT1.232S 8050 rows inserted. dT=PT1.057S 8060 rows inserted. dT=PT0.972S 8070 rows inserted. dT=PT1.042S 8080 rows inserted. dT=PT1.037S 8090 rows inserted. dT=PT1.049S 8100 rows inserted. dT=PT1.121S 8110 rows inserted. dT=PT0.991S 8120 rows inserted. dT=PT0.988S 8130 rows inserted. dT=PT0.972S 8140 rows inserted. dT=PT1.024S 8150 rows inserted. dT=PT1.019S 8160 rows inserted. dT=PT1.024S 8170 rows inserted. dT=PT1.057S 8180 rows inserted. dT=PT1.053S 8190 rows inserted. dT=PT1.005S 8200 rows inserted. dT=PT1.047S 8210 rows inserted. dT=PT1.072S 8220 rows inserted. dT=PT1.02S 8230 rows inserted. dT=PT1.027S 8240 rows inserted. dT=PT0.968S 8250 rows inserted. dT=PT0.96S 8260 rows inserted. dT=PT1.509S 8270 rows inserted. dT=PT1.004S 8280 rows inserted. dT=PT1.073S 8290 rows inserted. dT=PT0.995S 8300 rows inserted. dT=PT1.027S 8310 rows inserted. dT=PT1.05S 8320 rows inserted. dT=PT1.098S 8330 rows inserted. dT=PT1.037S 8340 rows inserted. dT=PT0.991S 8350 rows inserted. dT=PT1.02S 8360 rows inserted. dT=PT1.032S 2023-05-08 19:44:52:121 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Checkpoint started [checkpointId=6e0a14b0-bd39-4157-84ae-f5f01d873929, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=146, reason='timeout'] 2023-05-08 19:44:52:803 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Checkpoint finished [checkpointId=6e0a14b0-bd39-4157-84ae-f5f01d873929, pages=146, pagesWriteTime=409ms, fsyncTime=263ms, totalTime=685ms] 8370 rows inserted. dT=PT1.741S 8380 rows inserted. dT=PT1.086S 8390 rows inserted. dT=PT1.038S 8400 rows inserted. dT=PT1.064S 8410 rows inserted. dT=PT1.027S 8420 rows inserted. dT=PT1.009S 8430 rows inserted. dT=PT0.932S 8440 rows inserted. dT=PT1.032S 8450 rows inserted. dT=PT1.011S 8460 rows inserted. dT=PT1.05S 8470 rows inserted. dT=PT1.082S 8480 rows inserted. dT=PT0.982S 8490 rows inserted. dT=PT1.026S 8500 rows inserted. dT=PT1.092S 8510 rows inserted. dT=PT1.077S 8520 rows inserted. dT=PT1.045S 8530 rows inserted. dT=PT0.944S 8540 rows inserted. dT=PT1.413S 8550 rows inserted. dT=PT1.047S 8560 rows inserted. dT=PT1.09S 8570 rows inserted. dT=PT0.982S 8580 rows inserted. dT=PT1.069S 8590 rows inserted. dT=PT0.985S 8600 rows inserted. dT=PT1.076S 8610 rows inserted. dT=PT1.004S 8620 rows inserted. dT=PT0.991S 8630 rows inserted. dT=PT1.046S 8640 rows inserted. dT=PT1.036S 8650 rows inserted. dT=PT1.006S 8660 rows inserted. dT=PT0.937S 8670 rows inserted. dT=PT1.049S 2023-05-08 19:45:25:648 +0300 [INFO][%idt_n_0%checkpoint-thread-1][Checkpointer] Checkpoint started [checkpointId=dd5e8c29-35a1-49fc-8e3c-85faa19e4939, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=168, reason='Triggered by replicator'] 8680 rows inserted. dT=PT0.999S 2023-05-08 19:45:26:107 +0300 [INFO][%idt_n_0%checkpoint-thread-1][Checkpointer] Checkpoint finished [checkpointId=dd5e8c29-35a1-49fc-8e3c-85faa19e4939, pages=168, pagesWriteTime=146ms, fsyncTime=310ms, totalTime=456ms] 8690 rows inserted. dT=PT1.824S 8700 rows inserted. dT=PT1.038S 8710 rows inserted. dT=PT1.014S 8720 rows inserted. dT=PT1.041S 8730 rows inserted. dT=PT0.999S 8740 rows inserted. dT=PT1.029S 8750 rows inserted. dT=PT1.026S 8760 rows inserted. dT=PT0.964S 8770 rows inserted. dT=PT0.966S 8780 rows inserted. dT=PT1.075S 8790 rows inserted. dT=PT1.074S 8800 rows inserted. dT=PT0.934S 8810 rows inserted. dT=PT1.033S 8820 rows inserted. dT=PT1.116S 8830 rows inserted. dT=PT0.977S 8840 rows inserted. dT=PT1.069S 8850 rows inserted. dT=PT1.017S 8860 rows inserted. dT=PT1.047S 8870 rows inserted. dT=PT1.032S 8880 rows inserted. dT=PT1.044S 8890 rows inserted. dT=PT1.006S 8900 rows inserted. dT=PT1.06S 8910 rows inserted. dT=PT1.409S 8920 rows inserted. dT=PT1.053S 8930 rows inserted. dT=PT1.085S 8940 rows inserted. dT=PT1.05S 8950 rows inserted. dT=PT0.975S 8960 rows inserted. dT=PT1.046S 8970 rows inserted. dT=PT1.037S 8980 rows inserted. dT=PT1.049S 8990 rows inserted. dT=PT1.02S 9000 rows inserted. dT=PT1.042S 9010 rows inserted. dT=PT1.031S 9020 rows inserted. dT=PT1.02S 9030 rows inserted. dT=PT1.049S 9040 rows inserted. dT=PT1S 9050 rows inserted. dT=PT1.023S 9060 rows inserted. dT=PT1.04S 9070 rows inserted. dT=PT1.139S 9080 rows inserted. dT=PT1.289S 9090 rows inserted. dT=PT0.973S 9100 rows inserted. dT=PT1.199S 9110 rows inserted. dT=PT1.01S 9120 rows inserted. dT=PT1.075S 9130 rows inserted. dT=PT1.026S 9140 rows inserted. dT=PT1.042S 9150 rows inserted. dT=PT1.034S 2023-05-08 19:46:16:804 +0300 [INFO][%idt_n_0%checkpoint-thread-1][Checkpointer] Checkpoint started [checkpointId=212b5a7e-1fdb-4b5a-83ef-a56aae435e7b, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=158, reason='Triggered by replicator'] 9160 rows inserted. dT=PT0.981S 2023-05-08 19:46:17:289 +0300 [INFO][%idt_n_0%checkpoint-thread-1][Checkpointer] Checkpoint finished [checkpointId=212b5a7e-1fdb-4b5a-83ef-a56aae435e7b, pages=158, pagesWriteTime=144ms, fsyncTime=312ms, totalTime=479ms] 9170 rows inserted. dT=PT1.82S 9180 rows inserted. dT=PT1.067S 9190 rows inserted. dT=PT1.011S 9200 rows inserted. dT=PT1.048S 9210 rows inserted. dT=PT1.046S 9220 rows inserted. dT=PT1.047S 9230 rows inserted. dT=PT1.109S 9240 rows inserted. dT=PT1.014S 9250 rows inserted. dT=PT1.027S 9260 rows inserted. dT=PT1.004S 9270 rows inserted. dT=PT1.003S 9280 rows inserted. dT=PT0.965S 9290 rows inserted. dT=PT1.002S 9300 rows inserted. dT=PT0.976S 2023-05-08 19:46:32:444 +0300 [INFO][%idt_n_0%checkpoint-thread-1][Checkpointer] Checkpoint started [checkpointId=68f617a5-0c84-4671-8cb5-c8a476f35ab7, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=134, reason='Triggered by replicator'] 2023-05-08 19:46:32:915 +0300 [INFO][%idt_n_0%checkpoint-thread-1][Checkpointer] Checkpoint finished [checkpointId=68f617a5-0c84-4671-8cb5-c8a476f35ab7, pages=134, pagesWriteTime=196ms, fsyncTime=269ms, totalTime=478ms] 9310 rows inserted. dT=PT1.908S 2023-05-08 19:46:34:231 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Checkpoint started [checkpointId=67ce8bab-42f4-4dd7-93e1-9bcef4f38028, checkpointBeforeWriteLockTime=12ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=82, reason='timeout'] 2023-05-08 19:46:34:620 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Checkpoint finished [checkpointId=67ce8bab-42f4-4dd7-93e1-9bcef4f38028, pages=82, pagesWriteTime=250ms, fsyncTime=140ms, totalTime=402ms] 9320 rows inserted. dT=PT1.61S 9330 rows inserted. dT=PT1.024S 9340 rows inserted. dT=PT1.041S 9350 rows inserted. dT=PT1.045S 9360 rows inserted. dT=PT1.065S 9370 rows inserted. dT=PT1.09S 9380 rows inserted. dT=PT1.085S 9390 rows inserted. dT=PT1.042S 9400 rows inserted. dT=PT0.998S 9410 rows inserted. dT=PT1.018S 9420 rows inserted. dT=PT0.951S 9430 rows inserted. dT=PT1.031S 9440 rows inserted. dT=PT0.996S 9450 rows inserted. dT=PT1.034S 9460 rows inserted. dT=PT1S 9470 rows inserted. dT=PT0.991S 9480 rows inserted. dT=PT1.046S 9490 rows inserted. dT=PT1.044S 9500 rows inserted. dT=PT1.086S 9510 rows inserted. dT=PT1.384S 9520 rows inserted. dT=PT1.116S 9530 rows inserted. dT=PT1.048S 9540 rows inserted. dT=PT1.037S 9550 rows inserted. dT=PT1.045S 9560 rows inserted. dT=PT0.941S 9570 rows inserted. dT=PT1.002S 9580 rows inserted. dT=PT0.983S 9590 rows inserted. dT=PT1.005S 9600 rows inserted. dT=PT1.048S 9610 rows inserted. dT=PT0.99S 9620 rows inserted. dT=PT1.037S 9630 rows inserted. dT=PT0.994S 9640 rows inserted. dT=PT0.947S 9650 rows inserted. dT=PT1.052S 9660 rows inserted. dT=PT1.144S 9670 rows inserted. dT=PT0.947S 9680 rows inserted. dT=PT1.014S 9690 rows inserted. dT=PT0.993S 9700 rows inserted. dT=PT0.993S 9710 rows inserted. dT=PT1.007S 9720 rows inserted. dT=PT1.049S 9730 rows inserted. dT=PT1.064S 9740 rows inserted. dT=PT1.032S 2023-05-08 19:47:19:100 +0300 [INFO][%idt_n_0%checkpoint-thread-1][Checkpointer] Checkpoint started [checkpointId=f31f76ff-566b-4d4d-86c5-bffcba5b3063, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=157, reason='Triggered by replicator'] 2023-05-08 19:47:19:798 +0300 [INFO][%idt_n_0%checkpoint-thread-1][Checkpointer] Checkpoint finished [checkpointId=f31f76ff-566b-4d4d-86c5-bffcba5b3063, pages=157, pagesWriteTime=431ms, fsyncTime=268ms, totalTime=699ms] 9750 rows inserted. dT=PT1.711S 9760 rows inserted. dT=PT0.973S 2023-05-08 19:47:21:788 +0300 [INFO][%idt_n_0%JRaft-Common-Executor-1][LocalSnapshotStorage] Deleting snapshot build/work/ItDmlTest/static_555993353560259/idt_n_0/cmg_group_idt_n_0_0/snapshot/snapshot_11. 2023-05-08 19:47:21:805 +0300 [INFO][%idt_n_0%JRaft-Common-Executor-1][LocalSnapshotStorage] Renaming build/work/ItDmlTest/static_555993353560259/idt_n_0/cmg_group_idt_n_0_0/snapshot/temp to build/work/ItDmlTest/static_555993353560259/idt_n_0/cmg_group_idt_n_0_0/snapshot/snapshot_11. 9770 rows inserted. dT=PT1.103S 9780 rows inserted. dT=PT1.058S 9790 rows inserted. dT=PT1.025S 9800 rows inserted. dT=PT1.031S 9810 rows inserted. dT=PT1.023S 9820 rows inserted. dT=PT0.983S 9830 rows inserted. dT=PT0.973S 9840 rows inserted. dT=PT1.038S 9850 rows inserted. dT=PT1.02S 2023-05-08 19:47:31:725 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Checkpoint started [checkpointId=4935aa96-1754-40c9-8a83-3651758844ec, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=144, reason='timeout'] 9860 rows inserted. dT=PT1.061S 2023-05-08 19:47:32:072 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Checkpoint finished [checkpointId=4935aa96-1754-40c9-8a83-3651758844ec, pages=144, pagesWriteTime=117ms, fsyncTime=231ms, totalTime=348ms] 9870 rows inserted. dT=PT1.606S 9880 rows inserted. dT=PT1.015S 9890 rows inserted. dT=PT0.982S 9900 rows inserted. dT=PT1.025S 9910 rows inserted. dT=PT1.04S 9920 rows inserted. dT=PT0.995S 9930 rows inserted. dT=PT1.043S 9940 rows inserted. dT=PT1.171S 9950 rows inserted. dT=PT1.076S 9960 rows inserted. dT=PT1.077S 9970 rows inserted. dT=PT1.02S 9980 rows inserted. dT=PT0.953S 9990 rows inserted. dT=PT0.99S 10000 rows inserted. dT=PT0.998S 2023-05-08 19:47:50:345 +0300 [INFO][%idt_n_0%vault-2][LowWatermark] Successful low watermark update: HybridTimestamp [time=110333904180346880] 2023-05-08 19:47:50:926 +0300 [INFO][%idt_n_2%vault-2][LowWatermark] Successful low watermark update: HybridTimestamp [time=110333904218947584] Iteration 3 started 2023-05-08 19:47:51:092 +0300 [INFO][%idt_n_1%vault-2][LowWatermark] Successful low watermark update: HybridTimestamp [time=110333904230088704] 10 rows inserted. dT=PT1.009S 20 rows inserted. dT=PT1.019S 30 rows inserted. dT=PT1.049S 40 rows inserted. dT=PT1.042S 50 rows inserted. dT=PT0.976S 60 rows inserted. dT=PT1.008S 70 rows inserted. dT=PT1.003S 80 rows inserted. dT=PT0.995S 90 rows inserted. dT=PT1.368S 100 rows inserted. dT=PT1.032S 110 rows inserted. dT=PT1.064S 120 rows inserted. dT=PT1.052S 130 rows inserted. dT=PT1.031S 140 rows inserted. dT=PT0.969S 150 rows inserted. dT=PT1.005S 160 rows inserted. dT=PT1.059S 170 rows inserted. dT=PT1.057S 180 rows inserted. dT=PT1.045S 190 rows inserted. dT=PT1.134S 200 rows inserted. dT=PT1.044S 210 rows inserted. dT=PT0.996S 220 rows inserted. dT=PT0.999S 230 rows inserted. dT=PT1.079S 240 rows inserted. dT=PT0.977S 250 rows inserted. dT=PT0.986S 260 rows inserted. dT=PT1.048S 270 rows inserted. dT=PT0.979S 280 rows inserted. dT=PT1.048S 290 rows inserted. dT=PT0.954S 300 rows inserted. dT=PT0.983S 310 rows inserted. dT=PT0.958S 320 rows inserted. dT=PT1.062S 330 rows inserted. dT=PT0.976S 340 rows inserted. dT=PT0.976S 350 rows inserted. dT=PT1.003S 360 rows inserted. dT=PT1.023S 370 rows inserted. dT=PT0.947S 380 rows inserted. dT=PT0.98S 390 rows inserted. dT=PT1.012S 400 rows inserted. dT=PT0.966S 410 rows inserted. dT=PT1.002S 420 rows inserted. dT=PT1.015S 430 rows inserted. dT=PT1.015S 440 rows inserted. dT=PT1.043S 450 rows inserted. dT=PT1.051S 2023-05-08 19:48:38:008 +0300 [INFO][%idt_n_2%JRaft-Common-Executor-1][LocalSnapshotStorage] Deleting snapshot build/work/ItDmlTest/static_555993353560259/idt_n_2/metastorage_group_idt_n_2_0/snapshot/snapshot_21. 2023-05-08 19:48:38:008 +0300 [INFO][%idt_n_2%JRaft-Common-Executor-1][LocalSnapshotStorage] Renaming build/work/ItDmlTest/static_555993353560259/idt_n_2/metastorage_group_idt_n_2_0/snapshot/temp to build/work/ItDmlTest/static_555993353560259/idt_n_2/metastorage_group_idt_n_2_0/snapshot/snapshot_21. 460 rows inserted. dT=PT1.109S 2023-05-08 19:48:38:722 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Checkpoint started [checkpointId=ff761de9-e598-4005-a4dd-56cd20e80840, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=204, reason='Triggered by replicator'] 2023-05-08 19:48:39:100 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Checkpoint finished [checkpointId=ff761de9-e598-4005-a4dd-56cd20e80840, pages=204, pagesWriteTime=152ms, fsyncTime=228ms, totalTime=380ms] 470 rows inserted. dT=PT1.741S 480 rows inserted. dT=PT1.203S 490 rows inserted. dT=PT1.027S 500 rows inserted. dT=PT0.999S 510 rows inserted. dT=PT1.018S 520 rows inserted. dT=PT1.167S 530 rows inserted. dT=PT0.941S 540 rows inserted. dT=PT1.113S 550 rows inserted. dT=PT1.155S 560 rows inserted. dT=PT0.981S 570 rows inserted. dT=PT1.022S 580 rows inserted. dT=PT0.882S 590 rows inserted. dT=PT1.105S 600 rows inserted. dT=PT0.998S 610 rows inserted. dT=PT1.04S 620 rows inserted. dT=PT0.941S 630 rows inserted. dT=PT1.067S 640 rows inserted. dT=PT1.025S 650 rows inserted. dT=PT1.001S 660 rows inserted. dT=PT1.013S 670 rows inserted. dT=PT0.998S 680 rows inserted. dT=PT0.997S 690 rows inserted. dT=PT1.068S 700 rows inserted. dT=PT1.07S 710 rows inserted. dT=PT1.072S 720 rows inserted. dT=PT1.094S 730 rows inserted. dT=PT1.056S 740 rows inserted. dT=PT1.043S 750 rows inserted. dT=PT1.051S 760 rows inserted. dT=PT1.028S 770 rows inserted. dT=PT1.414S 780 rows inserted. dT=PT1.117S 790 rows inserted. dT=PT1.033S 800 rows inserted. dT=PT0.968S 810 rows inserted. dT=PT1.033S 820 rows inserted. dT=PT1.027S 830 rows inserted. dT=PT0.983S 840 rows inserted. dT=PT1.04S 850 rows inserted. dT=PT1.022S 860 rows inserted. dT=PT1S 870 rows inserted. dT=PT1.03S 880 rows inserted. dT=PT1.016S 890 rows inserted. dT=PT0.998S 900 rows inserted. dT=PT1.047S 910 rows inserted. dT=PT0.951S 920 rows inserted. dT=PT1.003S 930 rows inserted. dT=PT1.094S 940 rows inserted. dT=PT1.029S 950 rows inserted. dT=PT1.096S 960 rows inserted. dT=PT0.99S 970 rows inserted. dT=PT1.067S 980 rows inserted. dT=PT1.029S 990 rows inserted. dT=PT1.093S 1000 rows inserted. dT=PT1.043S 1010 rows inserted. dT=PT1.175S 1020 rows inserted. dT=PT1.007S 1030 rows inserted. dT=PT0.785S 1040 rows inserted. dT=PT0.994S 1050 rows inserted. dT=PT1.189S 1060 rows inserted. dT=PT1.276S 1070 rows inserted. dT=PT1.02S 1080 rows inserted. dT=PT1.057S 1090 rows inserted. dT=PT1.031S 1100 rows inserted. dT=PT1.03S 1110 rows inserted. dT=PT1.05S 1120 rows inserted. dT=PT0.991S 1130 rows inserted. dT=PT1.027S 1140 rows inserted. dT=PT1.032S 1150 rows inserted. dT=PT0.936S 1160 rows inserted. dT=PT1.075S 1170 rows inserted. dT=PT1.039S 2023-05-08 19:49:53:562 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Checkpoint started [checkpointId=9483031b-531d-4cb4-b931-d765400c8a98, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=116, reason='timeout'] 2023-05-08 19:49:53:818 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Checkpoint finished [checkpointId=9483031b-531d-4cb4-b931-d765400c8a98, pages=116, pagesWriteTime=76ms, fsyncTime=158ms, totalTime=260ms] 1180 rows inserted. dT=PT1.232S 1190 rows inserted. dT=PT1.175S 1200 rows inserted. dT=PT0.931S 1210 rows inserted. dT=PT1.293S 1220 rows inserted. dT=PT0.923S 1230 rows inserted. dT=PT1.066S 1240 rows inserted. dT=PT1.024S 1250 rows inserted. dT=PT0.976S 1260 rows inserted. dT=PT0.999S 1270 rows inserted. dT=PT0.936S 1280 rows inserted. dT=PT0.777S 1290 rows inserted. dT=PT1.281S 1300 rows inserted. dT=PT1.062S 1310 rows inserted. dT=PT0.995S 1320 rows inserted. dT=PT1.025S 1330 rows inserted. dT=PT1.049S 1340 rows inserted. dT=PT1.149S 1350 rows inserted. dT=PT1.011S 1360 rows inserted. dT=PT0.986S 1370 rows inserted. dT=PT1.032S 1380 rows inserted. dT=PT0.996S 1390 rows inserted. dT=PT1.021S 1400 rows inserted. dT=PT1.013S 1410 rows inserted. dT=PT1S 1420 rows inserted. dT=PT1.058S 1430 rows inserted. dT=PT1S 1440 rows inserted. dT=PT1.023S 1450 rows inserted. dT=PT1.054S 1460 rows inserted. dT=PT1.014S 1470 rows inserted. dT=PT0.976S 1480 rows inserted. dT=PT1.052S 1490 rows inserted. dT=PT1.016S 1500 rows inserted. dT=PT1.01S 1510 rows inserted. dT=PT1.048S 1520 rows inserted. dT=PT0.983S 1530 rows inserted. dT=PT1.114S 1540 rows inserted. dT=PT0.983S 2023-05-08 19:50:31:318 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Checkpoint started [checkpointId=47d6fc27-1988-4c09-8f61-474d08435d3e, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=66, reason='Triggered by replicator'] 2023-05-08 19:50:31:644 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Checkpoint finished [checkpointId=47d6fc27-1988-4c09-8f61-474d08435d3e, pages=66, pagesWriteTime=176ms, fsyncTime=129ms, totalTime=328ms] 1550 rows inserted. dT=PT1.658S 1560 rows inserted. dT=PT1.07S 1570 rows inserted. dT=PT1.04S 1580 rows inserted. dT=PT1.078S 1590 rows inserted. dT=PT1.008S 1600 rows inserted. dT=PT0.999S 1610 rows inserted. dT=PT1.005S 1620 rows inserted. dT=PT1.007S 2023-05-08 19:50:40:492 +0300 [INFO][%idt_n_0%checkpoint-thread-1][Checkpointer] Checkpoint started [checkpointId=fe0fb741-6a6f-4fe3-b677-a026cf5f7f15, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=262, reason='Triggered by replicator'] 2023-05-08 19:50:41:097 +0300 [INFO][%idt_n_0%checkpoint-thread-1][Checkpointer] Checkpoint finished [checkpointId=fe0fb741-6a6f-4fe3-b677-a026cf5f7f15, pages=262, pagesWriteTime=306ms, fsyncTime=298ms, totalTime=604ms] 1630 rows inserted. dT=PT1.988S 1640 rows inserted. dT=PT1.078S 1650 rows inserted. dT=PT1.023S 1660 rows inserted. dT=PT1.008S 1670 rows inserted. dT=PT0.983S 1680 rows inserted. dT=PT1.206S 1690 rows inserted. dT=PT0.897S 1700 rows inserted. dT=PT1.287S 1710 rows inserted. dT=PT1.047S 1720 rows inserted. dT=PT0.999S 1730 rows inserted. dT=PT1.006S 1740 rows inserted. dT=PT1.067S 1750 rows inserted. dT=PT1.044S 1760 rows inserted. dT=PT1.053S 1770 rows inserted. dT=PT0.98S 1780 rows inserted. dT=PT1.011S 1790 rows inserted. dT=PT0.977S 1800 rows inserted. dT=PT1.021S 1810 rows inserted. dT=PT1.055S 1820 rows inserted. dT=PT1.029S 1830 rows inserted. dT=PT0.99S 1840 rows inserted. dT=PT1.076S 1850 rows inserted. dT=PT1.006S 1860 rows inserted. dT=PT1.036S 1870 rows inserted. dT=PT1.025S 1880 rows inserted. dT=PT0.976S 1890 rows inserted. dT=PT1.024S 1900 rows inserted. dT=PT1.007S 1910 rows inserted. dT=PT1.129S 1920 rows inserted. dT=PT1.029S 2023-05-08 19:51:12:119 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Checkpoint started [checkpointId=e5fd426e-4d2e-423a-96c9-52e26428aa7d, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=67, reason='Triggered by replicator'] 2023-05-08 19:51:12:646 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Checkpoint finished [checkpointId=e5fd426e-4d2e-423a-96c9-52e26428aa7d, pages=67, pagesWriteTime=374ms, fsyncTime=139ms, totalTime=536ms] 1930 rows inserted. dT=PT1.713S 1940 rows inserted. dT=PT1.025S 1950 rows inserted. dT=PT1.031S 1960 rows inserted. dT=PT1.027S 1970 rows inserted. dT=PT1.008S 1980 rows inserted. dT=PT0.971S 1990 rows inserted. dT=PT0.982S 2000 rows inserted. dT=PT1.04S 2010 rows inserted. dT=PT1.005S 2020 rows inserted. dT=PT0.979S 2030 rows inserted. dT=PT1.05S 2040 rows inserted. dT=PT1.045S 2050 rows inserted. dT=PT0.961S 2060 rows inserted. dT=PT1.003S 2070 rows inserted. dT=PT1.027S 2080 rows inserted. dT=PT1.031S 2090 rows inserted. dT=PT1.038S 2100 rows inserted. dT=PT0.999S 2110 rows inserted. dT=PT1.05S 2120 rows inserted. dT=PT1.022S 2130 rows inserted. dT=PT1.073S 2140 rows inserted. dT=PT1.367S 2023-05-08 19:51:35:515 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Checkpoint started [checkpointId=6791cbea-db47-4e8d-9e7c-7ac3537c3792, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=125, reason='timeout'] 2023-05-08 19:51:35:860 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Checkpoint finished [checkpointId=6791cbea-db47-4e8d-9e7c-7ac3537c3792, pages=125, pagesWriteTime=98ms, fsyncTime=231ms, totalTime=351ms] 2150 rows inserted. dT=PT1.399S 2160 rows inserted. dT=PT1.015S 2170 rows inserted. dT=PT0.987S 2180 rows inserted. dT=PT1.023S 2190 rows inserted. dT=PT1.151S 2200 rows inserted. dT=PT1.023S 2210 rows inserted. dT=PT1.263S 2220 rows inserted. dT=PT1.137S 2230 rows inserted. dT=PT1.028S 2240 rows inserted. dT=PT1.025S 2250 rows inserted. dT=PT0.986S 2260 rows inserted. dT=PT1.063S 2270 rows inserted. dT=PT0.956S 2280 rows inserted. dT=PT1.049S 2290 rows inserted. dT=PT0.984S 2300 rows inserted. dT=PT1.025S 2310 rows inserted. dT=PT1.078S 2320 rows inserted. dT=PT1.011S 2330 rows inserted. dT=PT0.986S 2340 rows inserted. dT=PT0.94S 2350 rows inserted. dT=PT1.021S 2360 rows inserted. dT=PT0.959S 2370 rows inserted. dT=PT0.996S 2380 rows inserted. dT=PT1.042S 2390 rows inserted. dT=PT1.03S 2400 rows inserted. dT=PT1.034S 2410 rows inserted. dT=PT1.04S 2420 rows inserted. dT=PT1.009S 2430 rows inserted. dT=PT1.047S 2440 rows inserted. dT=PT1.035S 2450 rows inserted. dT=PT1.043S 2460 rows inserted. dT=PT1.025S 2470 rows inserted. dT=PT1.062S 2480 rows inserted. dT=PT1.208S 2490 rows inserted. dT=PT1.41S 2500 rows inserted. dT=PT1.021S 2510 rows inserted. dT=PT1.045S 2520 rows inserted. dT=PT0.955S 2530 rows inserted. dT=PT0.989S 2540 rows inserted. dT=PT0.958S 2550 rows inserted. dT=PT1.034S 2560 rows inserted. dT=PT0.981S 2570 rows inserted. dT=PT1.023S 2580 rows inserted. dT=PT0.954S 2590 rows inserted. dT=PT0.981S 2600 rows inserted. dT=PT1.006S 2610 rows inserted. dT=PT1.064S 2620 rows inserted. dT=PT1.032S 2630 rows inserted. dT=PT1.027S 2640 rows inserted. dT=PT1.077S 2650 rows inserted. dT=PT0.993S 2660 rows inserted. dT=PT1.002S 2670 rows inserted. dT=PT1.034S 2680 rows inserted. dT=PT1.044S 2690 rows inserted. dT=PT1.076S 2700 rows inserted. dT=PT1.047S 2710 rows inserted. dT=PT1.03S 2720 rows inserted. dT=PT0.981S 2730 rows inserted. dT=PT1.012S 2740 rows inserted. dT=PT1.029S 2750 rows inserted. dT=PT1.014S 2760 rows inserted. dT=PT1.07S 2770 rows inserted. dT=PT1.466S 2780 rows inserted. dT=PT0.945S 2790 rows inserted. dT=PT1.001S 2800 rows inserted. dT=PT1.062S 2810 rows inserted. dT=PT1.052S 2820 rows inserted. dT=PT1.071S 2830 rows inserted. dT=PT1.025S 2840 rows inserted. dT=PT0.988S 2850 rows inserted. dT=PT0.997S 2023-05-08 19:52:50:357 +0300 [INFO][%idt_n_0%vault-3][LowWatermark] Successful low watermark update: HybridTimestamp [time=110333923842457600] 2860 rows inserted. dT=PT0.999S 2023-05-08 19:52:50:924 +0300 [INFO][%idt_n_2%vault-3][LowWatermark] Successful low watermark update: HybridTimestamp [time=110333923880009728] 2023-05-08 19:52:51:091 +0300 [INFO][%idt_n_1%vault-3][LowWatermark] Successful low watermark update: HybridTimestamp [time=110333923890954240] 2870 rows inserted. dT=PT0.978S 2880 rows inserted. dT=PT1.003S 2890 rows inserted. dT=PT1.02S 2900 rows inserted. dT=PT1.061S 2910 rows inserted. dT=PT1.076S 2920 rows inserted. dT=PT1.046S 2930 rows inserted. dT=PT1.034S 2940 rows inserted. dT=PT1.007S 2950 rows inserted. dT=PT1.031S 2960 rows inserted. dT=PT1.047S 2970 rows inserted. dT=PT1.042S 2980 rows inserted. dT=PT1.044S 2990 rows inserted. dT=PT0.948S 3000 rows inserted. dT=PT1.024S 3010 rows inserted. dT=PT1.02S 3020 rows inserted. dT=PT1.077S 3030 rows inserted. dT=PT0.938S 3040 rows inserted. dT=PT1.123S 3050 rows inserted. dT=PT1.346S 3060 rows inserted. dT=PT1.049S 3070 rows inserted. dT=PT1.012S 3080 rows inserted. dT=PT0.955S 3090 rows inserted. dT=PT1.019S 3100 rows inserted. dT=PT1.015S 3110 rows inserted. dT=PT1.008S 3120 rows inserted. dT=PT1.055S 3130 rows inserted. dT=PT1.015S 3140 rows inserted. dT=PT1.047S 3150 rows inserted. dT=PT1.037S 3160 rows inserted. dT=PT1.009S 3170 rows inserted. dT=PT1.034S 3180 rows inserted. dT=PT1.024S 3190 rows inserted. dT=PT0.952S 3200 rows inserted. dT=PT1.028S 3210 rows inserted. dT=PT1.006S 3220 rows inserted. dT=PT1.003S 3230 rows inserted. dT=PT1.032S 3240 rows inserted. dT=PT1.052S 3250 rows inserted. dT=PT1.036S 2023-05-08 19:53:31:718 +0300 [INFO][%idt_n_0%checkpoint-thread-1][Checkpointer] Checkpoint started [checkpointId=74d8fdaf-7241-4f7f-91a2-1b839b6f6696, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=165, reason='timeout'] 3260 rows inserted. dT=PT1.044S 2023-05-08 19:53:32:153 +0300 [INFO][%idt_n_0%checkpoint-thread-1][Checkpointer] Checkpoint finished [checkpointId=74d8fdaf-7241-4f7f-91a2-1b839b6f6696, pages=165, pagesWriteTime=149ms, fsyncTime=288ms, totalTime=437ms] 3270 rows inserted. dT=PT1.685S 3280 rows inserted. dT=PT1.013S 3290 rows inserted. dT=PT1.03S 3300 rows inserted. dT=PT1.038S 3310 rows inserted. dT=PT0.99S 3320 rows inserted. dT=PT1.025S 3330 rows inserted. dT=PT1.03S 3340 rows inserted. dT=PT1.103S 3350 rows inserted. dT=PT1.044S 3360 rows inserted. dT=PT0.984S 3370 rows inserted. dT=PT1.005S 3380 rows inserted. dT=PT1.022S 3390 rows inserted. dT=PT0.991S 3400 rows inserted. dT=PT1.041S 3410 rows inserted. dT=PT1.088S 3420 rows inserted. dT=PT1.01S 3430 rows inserted. dT=PT1.388S 3440 rows inserted. dT=PT1.004S 3450 rows inserted. dT=PT1.072S 3460 rows inserted. dT=PT1.094S 3470 rows inserted. dT=PT1.03S 2023-05-08 19:53:55:543 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Checkpoint started [checkpointId=0eab4173-8f3a-4690-9b35-b5a12b1f218f, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=78, reason='timeout'] 2023-05-08 19:53:55:764 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Checkpoint finished [checkpointId=0eab4173-8f3a-4690-9b35-b5a12b1f218f, pages=78, pagesWriteTime=76ms, fsyncTime=136ms, totalTime=223ms] 3480 rows inserted. dT=PT1.146S 3490 rows inserted. dT=PT1.057S 3500 rows inserted. dT=PT1.019S 3510 rows inserted. dT=PT0.973S 3520 rows inserted. dT=PT0.978S 3530 rows inserted. dT=PT1.029S 3540 rows inserted. dT=PT1.036S 3550 rows inserted. dT=PT1.008S 3560 rows inserted. dT=PT1.07S 3570 rows inserted. dT=PT0.955S 3580 rows inserted. dT=PT1.11S 3590 rows inserted. dT=PT1.017S 3600 rows inserted. dT=PT1.003S 3610 rows inserted. dT=PT1.03S 3620 rows inserted. dT=PT0.99S 3630 rows inserted. dT=PT1.44S 2023-05-08 19:54:11:749 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Checkpoint started [checkpointId=548ba770-2c52-4b82-bf08-6b05ffd319f5, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=158, reason='timeout'] 2023-05-08 19:54:12:142 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Checkpoint finished [checkpointId=548ba770-2c52-4b82-bf08-6b05ffd319f5, pages=158, pagesWriteTime=126ms, fsyncTime=258ms, totalTime=398ms] 3640 rows inserted. dT=PT1.41S 3650 rows inserted. dT=PT1.01S 3660 rows inserted. dT=PT1.059S 3670 rows inserted. dT=PT1.04S 3680 rows inserted. dT=PT1.085S 3690 rows inserted. dT=PT0.959S 3700 rows inserted. dT=PT1.044S 3710 rows inserted. dT=PT1.025S 3720 rows inserted. dT=PT1.02S 3730 rows inserted. dT=PT1.281S 3740 rows inserted. dT=PT1.033S 3750 rows inserted. dT=PT1.058S 3760 rows inserted. dT=PT1.006S 3770 rows inserted. dT=PT0.988S 3780 rows inserted. dT=PT1.066S 3790 rows inserted. dT=PT1.002S 3800 rows inserted. dT=PT0.998S 3810 rows inserted. dT=PT1.112S 3820 rows inserted. dT=PT1.039S 3830 rows inserted. dT=PT1.028S 3840 rows inserted. dT=PT0.982S 3850 rows inserted. dT=PT1.087S 3860 rows inserted. dT=PT0.934S 3870 rows inserted. dT=PT1.039S 3880 rows inserted. dT=PT1.032S 3890 rows inserted. dT=PT1.071S 3900 rows inserted. dT=PT1.025S 3910 rows inserted. dT=PT1.075S 3920 rows inserted. dT=PT1.14S 3930 rows inserted. dT=PT1.234S 3940 rows inserted. dT=PT0.846S 3950 rows inserted. dT=PT1.191S 3960 rows inserted. dT=PT0.971S 3970 rows inserted. dT=PT0.984S 3980 rows inserted. dT=PT1.003S 3990 rows inserted. dT=PT1.068S 4000 rows inserted. dT=PT0.961S 4010 rows inserted. dT=PT1.072S 4020 rows inserted. dT=PT1.078S 4030 rows inserted. dT=PT1.04S 4040 rows inserted. dT=PT1.048S 4050 rows inserted. dT=PT1.012S 4060 rows inserted. dT=PT1.065S 4070 rows inserted. dT=PT1.032S 4080 rows inserted. dT=PT1.054S 4090 rows inserted. dT=PT1.029S 4100 rows inserted. dT=PT1.078S 4110 rows inserted. dT=PT0.995S 4120 rows inserted. dT=PT1.064S 4130 rows inserted. dT=PT1.033S 4140 rows inserted. dT=PT1.011S 4150 rows inserted. dT=PT1.053S 4160 rows inserted. dT=PT1.124S 4170 rows inserted. dT=PT1.235S 4180 rows inserted. dT=PT1.126S 4190 rows inserted. dT=PT1.071S 4200 rows inserted. dT=PT1.023S 4210 rows inserted. dT=PT1.012S 4220 rows inserted. dT=PT1.074S 4230 rows inserted. dT=PT1.07S 4240 rows inserted. dT=PT1.221S 4250 rows inserted. dT=PT1.507S 4260 rows inserted. dT=PT1.582S 4270 rows inserted. dT=PT1.641S 4280 rows inserted. dT=PT1.14S 4290 rows inserted. dT=PT1.004S 4300 rows inserted. dT=PT1.07S 4310 rows inserted. dT=PT1.22S 4320 rows inserted. dT=PT0.92S 4330 rows inserted. dT=PT1.076S 4340 rows inserted. dT=PT1.259S 4350 rows inserted. dT=PT1.042S 4360 rows inserted. dT=PT1.078S 4370 rows inserted. dT=PT1.051S 4380 rows inserted. dT=PT1.07S 4390 rows inserted. dT=PT1.049S 4400 rows inserted. dT=PT1.064S 4410 rows inserted. dT=PT0.929S 4420 rows inserted. dT=PT1.005S 4430 rows inserted. dT=PT1.031S 2023-05-08 19:55:38:149 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Checkpoint started [checkpointId=66f5300b-d282-4cd6-b714-77b0339cc3c4, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=140, reason='Triggered by replicator'] 2023-05-08 19:55:38:733 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Checkpoint finished [checkpointId=66f5300b-d282-4cd6-b714-77b0339cc3c4, pages=140, pagesWriteTime=366ms, fsyncTime=216ms, totalTime=582ms] 4440 rows inserted. dT=PT1.843S 4450 rows inserted. dT=PT1.096S 2023-05-08 19:55:41:225 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Checkpoint started [checkpointId=ba5cf620-af86-4986-af2e-42b4e2d82e8e, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=32, reason='Triggered by replicator'] 2023-05-08 19:55:41:578 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Checkpoint finished [checkpointId=ba5cf620-af86-4986-af2e-42b4e2d82e8e, pages=32, pagesWriteTime=245ms, fsyncTime=87ms, totalTime=344ms] 4460 rows inserted. dT=PT1.134S 4470 rows inserted. dT=PT1.117S 4480 rows inserted. dT=PT0.981S 4490 rows inserted. dT=PT1.056S 4500 rows inserted. dT=PT1.02S 4510 rows inserted. dT=PT0.937S 4520 rows inserted. dT=PT1.009S 4530 rows inserted. dT=PT1.023S 4540 rows inserted. dT=PT1.037S 4550 rows inserted. dT=PT1.039S 4560 rows inserted. dT=PT1.058S 4570 rows inserted. dT=PT1.165S 4580 rows inserted. dT=PT0.891S 4590 rows inserted. dT=PT0.942S 4600 rows inserted. dT=PT1.038S 4610 rows inserted. dT=PT1.247S 4620 rows inserted. dT=PT0.989S 4630 rows inserted. dT=PT1.1S 4640 rows inserted. dT=PT1.008S 4650 rows inserted. dT=PT1.044S 4660 rows inserted. dT=PT1.028S 4670 rows inserted. dT=PT0.981S 4680 rows inserted. dT=PT1.04S 4690 rows inserted. dT=PT1.028S 4700 rows inserted. dT=PT1.069S 4710 rows inserted. dT=PT1.072S 4720 rows inserted. dT=PT1.075S 4730 rows inserted. dT=PT1.057S 4740 rows inserted. dT=PT1.147S 4750 rows inserted. dT=PT0.965S 4760 rows inserted. dT=PT0.93S 4770 rows inserted. dT=PT0.96S 4780 rows inserted. dT=PT1.073S 2023-05-08 19:56:15:099 +0300 [INFO][%idt_n_0%checkpoint-thread-1][Checkpointer] Checkpoint started [checkpointId=6cc7f8b3-4af1-4387-9562-93fb4a4ef606, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=179, reason='timeout'] 2023-05-08 19:56:15:840 +0300 [INFO][%idt_n_0%checkpoint-thread-1][Checkpointer] Checkpoint finished [checkpointId=6cc7f8b3-4af1-4387-9562-93fb4a4ef606, pages=179, pagesWriteTime=428ms, fsyncTime=307ms, totalTime=735ms] 4790 rows inserted. dT=PT1.784S 4800 rows inserted. dT=PT1.026S 4810 rows inserted. dT=PT1.028S 4820 rows inserted. dT=PT1.055S 4830 rows inserted. dT=PT1.047S 4840 rows inserted. dT=PT1.032S 4850 rows inserted. dT=PT1.047S 4860 rows inserted. dT=PT0.974S 4870 rows inserted. dT=PT0.968S 4880 rows inserted. dT=PT0.994S 4890 rows inserted. dT=PT1.013S 4900 rows inserted. dT=PT0.984S 4910 rows inserted. dT=PT0.943S 4920 rows inserted. dT=PT0.994S 4930 rows inserted. dT=PT1.014S 4940 rows inserted. dT=PT1.058S 4950 rows inserted. dT=PT1.028S 4960 rows inserted. dT=PT0.939S 4970 rows inserted. dT=PT0.966S 4980 rows inserted. dT=PT1.02S 4990 rows inserted. dT=PT1.015S 5000 rows inserted. dT=PT1.027S 5010 rows inserted. dT=PT1.065S 5020 rows inserted. dT=PT0.983S 5030 rows inserted. dT=PT1.453S 5040 rows inserted. dT=PT1.004S 5050 rows inserted. dT=PT1.049S 5060 rows inserted. dT=PT1.008S 5070 rows inserted. dT=PT1.031S 5080 rows inserted. dT=PT0.992S 5090 rows inserted. dT=PT1.022S 5100 rows inserted. dT=PT1.011S 5110 rows inserted. dT=PT1.013S 5120 rows inserted. dT=PT1.027S 5130 rows inserted. dT=PT1.048S 5140 rows inserted. dT=PT0.978S 5150 rows inserted. dT=PT1.045S 5160 rows inserted. dT=PT0.969S 5170 rows inserted. dT=PT1.027S 5180 rows inserted. dT=PT1.072S 5190 rows inserted. dT=PT1.066S 5200 rows inserted. dT=PT1.012S 5210 rows inserted. dT=PT1.021S 5220 rows inserted. dT=PT1.029S 5230 rows inserted. dT=PT1.053S 5240 rows inserted. dT=PT1.062S 5250 rows inserted. dT=PT1.061S 5260 rows inserted. dT=PT0.961S 5270 rows inserted. dT=PT1.012S 5280 rows inserted. dT=PT1.064S 5290 rows inserted. dT=PT0.984S 2023-05-08 19:57:08:992 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Checkpoint started [checkpointId=5d76cb4e-4a87-433b-a984-29bbb9c730f6, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=88, reason='timeout'] 5300 rows inserted. dT=PT1.033S 2023-05-08 19:57:09:231 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Checkpoint finished [checkpointId=5d76cb4e-4a87-433b-a984-29bbb9c730f6, pages=88, pagesWriteTime=74ms, fsyncTime=151ms, totalTime=236ms] 5310 rows inserted. dT=PT1.685S 5320 rows inserted. dT=PT1.028S 5330 rows inserted. dT=PT0.959S 5340 rows inserted. dT=PT1.027S 5350 rows inserted. dT=PT1.013S 5360 rows inserted. dT=PT1.065S 5370 rows inserted. dT=PT1.079S 5380 rows inserted. dT=PT1.053S 5390 rows inserted. dT=PT0.988S 5400 rows inserted. dT=PT1.004S 5410 rows inserted. dT=PT0.992S 5420 rows inserted. dT=PT1.028S 5430 rows inserted. dT=PT1.033S 5440 rows inserted. dT=PT1.01S 5450 rows inserted. dT=PT1.36S 5460 rows inserted. dT=PT1.09S 5470 rows inserted. dT=PT0.978S 5480 rows inserted. dT=PT0.998S 5490 rows inserted. dT=PT0.959S 5500 rows inserted. dT=PT1.052S 5510 rows inserted. dT=PT1.01S 5520 rows inserted. dT=PT1.081S 5530 rows inserted. dT=PT1.029S 5540 rows inserted. dT=PT1.006S 5550 rows inserted. dT=PT0.94S 5560 rows inserted. dT=PT0.982S 5570 rows inserted. dT=PT1.016S 5580 rows inserted. dT=PT1.037S 5590 rows inserted. dT=PT1.023S 5600 rows inserted. dT=PT1.213S 5610 rows inserted. dT=PT1.076S 5620 rows inserted. dT=PT1.029S 5630 rows inserted. dT=PT1.049S 5640 rows inserted. dT=PT1.029S 5650 rows inserted. dT=PT1.075S 5660 rows inserted. dT=PT0.978S 5670 rows inserted. dT=PT0.991S 5680 rows inserted. dT=PT1.066S 5690 rows inserted. dT=PT1.074S 2023-05-08 19:57:50:380 +0300 [INFO][%idt_n_0%vault-0][LowWatermark] Successful low watermark update: HybridTimestamp [time=110333943504502784] 2023-05-08 19:57:50:943 +0300 [INFO][%idt_n_2%vault-1][LowWatermark] Successful low watermark update: HybridTimestamp [time=110333943541661696] 5700 rows inserted. dT=PT0.861S 2023-05-08 19:57:51:112 +0300 [INFO][%idt_n_1%vault-1][LowWatermark] Successful low watermark update: HybridTimestamp [time=110333943552540672] 5710 rows inserted. dT=PT0.98S 5720 rows inserted. dT=PT1.044S 5730 rows inserted. dT=PT0.982S 5740 rows inserted. dT=PT1.058S 5750 rows inserted. dT=PT1.375S 5760 rows inserted. dT=PT0.979S 5770 rows inserted. dT=PT1.008S 5780 rows inserted. dT=PT0.965S 5790 rows inserted. dT=PT1.008S 5800 rows inserted. dT=PT1.064S 5810 rows inserted. dT=PT1.036S 5820 rows inserted. dT=PT1.076S 5830 rows inserted. dT=PT1.029S 5840 rows inserted. dT=PT1.033S 5850 rows inserted. dT=PT1.06S 5860 rows inserted. dT=PT1.057S 5870 rows inserted. dT=PT1.082S 5880 rows inserted. dT=PT1.052S 5890 rows inserted. dT=PT1.128S 5900 rows inserted. dT=PT1.049S 5910 rows inserted. dT=PT1.327S 5920 rows inserted. dT=PT1.106S 5930 rows inserted. dT=PT1.053S 5940 rows inserted. dT=PT1.017S 5950 rows inserted. dT=PT1.038S 5960 rows inserted. dT=PT1.034S 5970 rows inserted. dT=PT1.013S 5980 rows inserted. dT=PT1.013S 5990 rows inserted. dT=PT1.049S 6000 rows inserted. dT=PT1.07S 6010 rows inserted. dT=PT1.024S 6020 rows inserted. dT=PT1.014S 6030 rows inserted. dT=PT1.052S 6040 rows inserted. dT=PT1.042S 6050 rows inserted. dT=PT1.026S 6060 rows inserted. dT=PT1.076S 6070 rows inserted. dT=PT1.336S 6080 rows inserted. dT=PT1.014S 6090 rows inserted. dT=PT1.022S 6100 rows inserted. dT=PT1.034S 6110 rows inserted. dT=PT1.053S 6120 rows inserted. dT=PT1.047S 6130 rows inserted. dT=PT1.01S 6140 rows inserted. dT=PT1.021S 2023-05-08 19:58:38:451 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Checkpoint started [checkpointId=0434bd8a-3659-487b-9e2a-f8a713f52978, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=168, reason='timeout'] 6150 rows inserted. dT=PT1.016S 2023-05-08 19:58:38:838 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Checkpoint finished [checkpointId=0434bd8a-3659-487b-9e2a-f8a713f52978, pages=168, pagesWriteTime=123ms, fsyncTime=248ms, totalTime=394ms] 6160 rows inserted. dT=PT1.433S 6170 rows inserted. dT=PT1.413S 6180 rows inserted. dT=PT0.962S 6190 rows inserted. dT=PT0.921S 6200 rows inserted. dT=PT1.072S 6210 rows inserted. dT=PT0.834S 6220 rows inserted. dT=PT0.963S 6230 rows inserted. dT=PT1.233S 6240 rows inserted. dT=PT1.058S 6250 rows inserted. dT=PT1.03S 6260 rows inserted. dT=PT1.06S 6270 rows inserted. dT=PT1.049S 6280 rows inserted. dT=PT1.001S 6290 rows inserted. dT=PT1.047S 6300 rows inserted. dT=PT1.025S 6310 rows inserted. dT=PT1.057S 6320 rows inserted. dT=PT1.027S 6330 rows inserted. dT=PT1.014S 6340 rows inserted. dT=PT1.028S 6350 rows inserted. dT=PT1.028S 6360 rows inserted. dT=PT1.005S 6370 rows inserted. dT=PT1.031S 6380 rows inserted. dT=PT1.013S 6390 rows inserted. dT=PT1.02S 6400 rows inserted. dT=PT1.024S 6410 rows inserted. dT=PT1.008S 6420 rows inserted. dT=PT1.027S 6430 rows inserted. dT=PT1.006S 6440 rows inserted. dT=PT1.009S 6450 rows inserted. dT=PT1.022S 6460 rows inserted. dT=PT1.418S 6470 rows inserted. dT=PT0.958S 6480 rows inserted. dT=PT1.014S 6490 rows inserted. dT=PT0.824S 6500 rows inserted. dT=PT1.06S 2023-05-08 19:59:15:482 +0300 [INFO][%idt_n_2%JRaft-Common-Executor-1][LocalSnapshotStorage] Deleting snapshot build/work/ItDmlTest/static_555993353560259/idt_n_2/cmg_group_idt_n_2_0/snapshot/snapshot_11. 2023-05-08 19:59:15:483 +0300 [INFO][%idt_n_2%JRaft-Common-Executor-1][LocalSnapshotStorage] Renaming build/work/ItDmlTest/static_555993353560259/idt_n_2/cmg_group_idt_n_2_0/snapshot/temp to build/work/ItDmlTest/static_555993353560259/idt_n_2/cmg_group_idt_n_2_0/snapshot/snapshot_11. 6510 rows inserted. dT=PT1.134S 6520 rows inserted. dT=PT0.998S 6530 rows inserted. dT=PT1.032S 2023-05-08 19:59:18:821 +0300 [INFO][%idt_n_0%checkpoint-thread-1][Checkpointer] Checkpoint started [checkpointId=0e945109-d81d-434d-9c29-a54995bce590, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=199, reason='timeout'] 2023-05-08 19:59:19:337 +0300 [INFO][%idt_n_0%checkpoint-thread-1][Checkpointer] Checkpoint finished [checkpointId=0e945109-d81d-434d-9c29-a54995bce590, pages=199, pagesWriteTime=180ms, fsyncTime=341ms, totalTime=521ms] 6540 rows inserted. dT=PT1.486S 6550 rows inserted. dT=PT1.03S 6560 rows inserted. dT=PT1.033S 6570 rows inserted. dT=PT0.997S 6580 rows inserted. dT=PT1.051S 6590 rows inserted. dT=PT0.992S 6600 rows inserted. dT=PT1.024S 6610 rows inserted. dT=PT1.138S 6620 rows inserted. dT=PT0.897S 6630 rows inserted. dT=PT0.996S 6640 rows inserted. dT=PT0.966S 6650 rows inserted. dT=PT1.145S 6660 rows inserted. dT=PT1.183S 6670 rows inserted. dT=PT1.036S 6680 rows inserted. dT=PT1.051S 6690 rows inserted. dT=PT1.023S 6700 rows inserted. dT=PT1.03S 6710 rows inserted. dT=PT1.053S 6720 rows inserted. dT=PT1.058S 6730 rows inserted. dT=PT1.023S 6740 rows inserted. dT=PT1.144S 6750 rows inserted. dT=PT1.051S 6760 rows inserted. dT=PT1.028S 6770 rows inserted. dT=PT1.058S 6780 rows inserted. dT=PT1.021S 6790 rows inserted. dT=PT0.99S 6800 rows inserted. dT=PT1.044S 6810 rows inserted. dT=PT1.023S 6820 rows inserted. dT=PT1.04S 6830 rows inserted. dT=PT0.986S 6840 rows inserted. dT=PT1.23S 6850 rows inserted. dT=PT0.985S 6860 rows inserted. dT=PT0.886S 6870 rows inserted. dT=PT1.415S 6880 rows inserted. dT=PT1.031S 6890 rows inserted. dT=PT1.004S 6900 rows inserted. dT=PT0.978S 6910 rows inserted. dT=PT1.027S 6920 rows inserted. dT=PT1.024S 6930 rows inserted. dT=PT1.01S 6940 rows inserted. dT=PT0.984S 6950 rows inserted. dT=PT0.989S 6960 rows inserted. dT=PT1.115S 6970 rows inserted. dT=PT1.023S 6980 rows inserted. dT=PT1.051S 6990 rows inserted. dT=PT1.012S 7000 rows inserted. dT=PT1.055S 7010 rows inserted. dT=PT1.061S 7020 rows inserted. dT=PT1.054S 7030 rows inserted. dT=PT1.395S 7040 rows inserted. dT=PT1.069S 7050 rows inserted. dT=PT1.031S 7060 rows inserted. dT=PT0.983S 7070 rows inserted. dT=PT1.005S 7080 rows inserted. dT=PT0.999S 7090 rows inserted. dT=PT1.046S 7100 rows inserted. dT=PT1.022S 2023-05-08 20:00:18:638 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Checkpoint started [checkpointId=2025c8b1-4c9c-4c47-870b-833ec3a33400, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=163, reason='Triggered by replicator'] 2023-05-08 20:00:19:002 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Checkpoint finished [checkpointId=2025c8b1-4c9c-4c47-870b-833ec3a33400, pages=163, pagesWriteTime=123ms, fsyncTime=218ms, totalTime=354ms] 2023-05-08 20:00:19:620 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Checkpoint started [checkpointId=c1cee673-f91e-4316-a694-e7951f042557, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=92, reason='timeout'] 2023-05-08 20:00:19:989 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Checkpoint finished [checkpointId=c1cee673-f91e-4316-a694-e7951f042557, pages=92, pagesWriteTime=233ms, fsyncTime=137ms, totalTime=370ms] 7110 rows inserted. dT=PT2.078S 7120 rows inserted. dT=PT0.992S 7130 rows inserted. dT=PT1.006S 7140 rows inserted. dT=PT1.032S 7150 rows inserted. dT=PT1.005S 2023-05-08 20:00:25:603 +0300 [INFO][%idt_n_0%JRaft-Common-Executor-1][LocalSnapshotStorage] Deleting snapshot build/work/ItDmlTest/static_555993353560259/idt_n_0/metastorage_group_idt_n_0_0/snapshot/snapshot_21. 2023-05-08 20:00:25:605 +0300 [INFO][%idt_n_0%JRaft-Common-Executor-1][LocalSnapshotStorage] Renaming build/work/ItDmlTest/static_555993353560259/idt_n_0/metastorage_group_idt_n_0_0/snapshot/temp to build/work/ItDmlTest/static_555993353560259/idt_n_0/metastorage_group_idt_n_0_0/snapshot/snapshot_21. 7160 rows inserted. dT=PT1.155S 7170 rows inserted. dT=PT1.024S 7180 rows inserted. dT=PT1.015S 7190 rows inserted. dT=PT1.002S 7200 rows inserted. dT=PT0.963S 7210 rows inserted. dT=PT1.03S 7220 rows inserted. dT=PT1.026S 7230 rows inserted. dT=PT0.981S 7240 rows inserted. dT=PT1.019S 7250 rows inserted. dT=PT1.07S 7260 rows inserted. dT=PT1.074S 7270 rows inserted. dT=PT0.979S 7280 rows inserted. dT=PT1.02S 7290 rows inserted. dT=PT1.045S 7300 rows inserted. dT=PT1.318S 7310 rows inserted. dT=PT1.16S 7320 rows inserted. dT=PT1.001S 7330 rows inserted. dT=PT1.08S 7340 rows inserted. dT=PT0.985S 7350 rows inserted. dT=PT1.068S 7360 rows inserted. dT=PT1.057S 7370 rows inserted. dT=PT0.934S 7380 rows inserted. dT=PT1.001S 7390 rows inserted. dT=PT1.031S 7400 rows inserted. dT=PT1.058S 7410 rows inserted. dT=PT1.063S 7420 rows inserted. dT=PT0.973S 7430 rows inserted. dT=PT1.004S 7440 rows inserted. dT=PT1.01S 7450 rows inserted. dT=PT0.978S 2023-05-08 20:00:56:048 +0300 [INFO][%idt_n_0%checkpoint-thread-1][Checkpointer] Checkpoint started [checkpointId=02e85d9a-a5ec-4cdd-b56d-d828036c5ad2, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=201, reason='Triggered by replicator'] 2023-05-08 20:00:56:923 +0300 [INFO][%idt_n_0%checkpoint-thread-1][Checkpointer] Checkpoint finished [checkpointId=02e85d9a-a5ec-4cdd-b56d-d828036c5ad2, pages=201, pagesWriteTime=592ms, fsyncTime=286ms, totalTime=878ms] 7460 rows inserted. dT=PT1.778S 7470 rows inserted. dT=PT1.021S 7480 rows inserted. dT=PT1.069S 7490 rows inserted. dT=PT0.979S 2023-05-08 20:01:00:771 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Checkpoint started [checkpointId=d02e7afc-e374-4cba-8093-99c27487eecf, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=81, reason='Triggered by replicator'] 2023-05-08 20:01:00:966 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Checkpoint finished [checkpointId=d02e7afc-e374-4cba-8093-99c27487eecf, pages=81, pagesWriteTime=51ms, fsyncTime=131ms, totalTime=193ms] 7500 rows inserted. dT=PT1.398S 7510 rows inserted. dT=PT1.023S 7520 rows inserted. dT=PT1.168S 7530 rows inserted. dT=PT0.892S 7540 rows inserted. dT=PT1.145S 7550 rows inserted. dT=PT1.242S 7560 rows inserted. dT=PT1.024S 7570 rows inserted. dT=PT0.992S 7580 rows inserted. dT=PT1.123S 7590 rows inserted. dT=PT0.948S 7600 rows inserted. dT=PT1.06S 7610 rows inserted. dT=PT1.033S 7620 rows inserted. dT=PT0.984S 7630 rows inserted. dT=PT1.084S 7640 rows inserted. dT=PT1.031S 7650 rows inserted. dT=PT1.038S 7660 rows inserted. dT=PT0.98S 7670 rows inserted. dT=PT0.962S 7680 rows inserted. dT=PT1.008S 7690 rows inserted. dT=PT0.986S 7700 rows inserted. dT=PT0.998S 7710 rows inserted. dT=PT1.046S 7720 rows inserted. dT=PT1.037S 7730 rows inserted. dT=PT1.05S 7740 rows inserted. dT=PT1.032S 7750 rows inserted. dT=PT0.982S 7760 rows inserted. dT=PT0.999S 7770 rows inserted. dT=PT1.047S 7780 rows inserted. dT=PT1.043S 7790 rows inserted. dT=PT1.061S 7800 rows inserted. dT=PT1.216S 7810 rows inserted. dT=PT1.137S 7820 rows inserted. dT=PT0.809S 7830 rows inserted. dT=PT1.291S 7840 rows inserted. dT=PT1.071S 7850 rows inserted. dT=PT0.973S 7860 rows inserted. dT=PT1.055S 7870 rows inserted. dT=PT1.129S 2023-05-08 20:01:41:253 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Checkpoint started [checkpointId=abbce40b-97b3-4bec-ad19-978c7ff336e6, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=157, reason='Triggered by replicator'] 2023-05-08 20:01:41:814 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Checkpoint finished [checkpointId=abbce40b-97b3-4bec-ad19-978c7ff336e6, pages=157, pagesWriteTime=304ms, fsyncTime=223ms, totalTime=568ms] 7880 rows inserted. dT=PT1.338S 7890 rows inserted. dT=PT1.432S 7900 rows inserted. dT=PT1.034S 7910 rows inserted. dT=PT1.02S 7920 rows inserted. dT=PT1.017S 7930 rows inserted. dT=PT1.049S 7940 rows inserted. dT=PT0.991S 7950 rows inserted. dT=PT0.984S 7960 rows inserted. dT=PT1.06S 7970 rows inserted. dT=PT1.027S 7980 rows inserted. dT=PT1.013S 7990 rows inserted. dT=PT1.028S 8000 rows inserted. dT=PT1.035S 2023-05-08 20:01:55:606 +0300 [INFO][%idt_n_1%JRaft-Common-Executor-1][LocalSnapshotStorage] Deleting snapshot build/work/ItDmlTest/static_555993353560259/idt_n_1/cmg_group_idt_n_1_0/snapshot/snapshot_11. 2023-05-08 20:01:55:607 +0300 [INFO][%idt_n_1%JRaft-Common-Executor-1][LocalSnapshotStorage] Renaming build/work/ItDmlTest/static_555993353560259/idt_n_1/cmg_group_idt_n_1_0/snapshot/temp to build/work/ItDmlTest/static_555993353560259/idt_n_1/cmg_group_idt_n_1_0/snapshot/snapshot_11. 8010 rows inserted. dT=PT1.088S 8020 rows inserted. dT=PT1.043S 8030 rows inserted. dT=PT1.011S 8040 rows inserted. dT=PT1.053S 8050 rows inserted. dT=PT1.001S 8060 rows inserted. dT=PT1.046S 8070 rows inserted. dT=PT1.025S 8080 rows inserted. dT=PT1.04S 8090 rows inserted. dT=PT1.055S 8100 rows inserted. dT=PT1.344S 8110 rows inserted. dT=PT1.054S 8120 rows inserted. dT=PT1.055S 8130 rows inserted. dT=PT1.05S 8140 rows inserted. dT=PT1.057S 8150 rows inserted. dT=PT1.122S 8160 rows inserted. dT=PT1.013S 8170 rows inserted. dT=PT0.953S 8180 rows inserted. dT=PT1.021S 8190 rows inserted. dT=PT1.028S 8200 rows inserted. dT=PT1.01S 8210 rows inserted. dT=PT1.029S 8220 rows inserted. dT=PT1.043S 8230 rows inserted. dT=PT1.025S 8240 rows inserted. dT=PT0.961S 8250 rows inserted. dT=PT0.987S 8260 rows inserted. dT=PT1.065S 8270 rows inserted. dT=PT1.029S 8280 rows inserted. dT=PT0.998S 8290 rows inserted. dT=PT1.02S 8300 rows inserted. dT=PT1.049S 8310 rows inserted. dT=PT1.011S 8320 rows inserted. dT=PT1.029S 8330 rows inserted. dT=PT1.037S 2023-05-08 20:02:29:299 +0300 [INFO][%idt_n_0%checkpoint-thread-1][Checkpointer] Checkpoint started [checkpointId=eb2489a8-5eb4-4de8-9c6b-acaea1c3f0c8, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=10ms, checkpointWriteLockHoldTime=10ms, splitAndSortPagesDuration=0ms, pages=202, reason='Triggered by replicator'] 2023-05-08 20:02:29:922 +0300 [INFO][%idt_n_0%checkpoint-thread-1][Checkpointer] Checkpoint finished [checkpointId=eb2489a8-5eb4-4de8-9c6b-acaea1c3f0c8, pages=202, pagesWriteTime=275ms, fsyncTime=307ms, totalTime=625ms] 8340 rows inserted. dT=PT1.853S 8350 rows inserted. dT=PT1.069S 8360 rows inserted. dT=PT0.989S 8370 rows inserted. dT=PT1.034S 8380 rows inserted. dT=PT1.004S 8390 rows inserted. dT=PT1.001S 8400 rows inserted. dT=PT1.01S 8410 rows inserted. dT=PT1.008S 8420 rows inserted. dT=PT0.975S 8430 rows inserted. dT=PT1.51S 8440 rows inserted. dT=PT1.027S 8450 rows inserted. dT=PT0.981S 8460 rows inserted. dT=PT1.029S 8470 rows inserted. dT=PT0.988S 8480 rows inserted. dT=PT0.995S 8490 rows inserted. dT=PT1.023S 8500 rows inserted. dT=PT1.046S 8510 rows inserted. dT=PT1.07S 8520 rows inserted. dT=PT1.045S 2023-05-08 20:02:50:396 +0300 [INFO][%idt_n_0%vault-1][LowWatermark] Successful low watermark update: HybridTimestamp [time=110333963167006720] 8530 rows inserted. dT=PT1.029S 2023-05-08 20:02:50:969 +0300 [INFO][%idt_n_2%vault-0][LowWatermark] Successful low watermark update: HybridTimestamp [time=110333963203575808] 2023-05-08 20:02:51:133 +0300 [INFO][%idt_n_1%vault-0][LowWatermark] Successful low watermark update: HybridTimestamp [time=110333963215044608] 8540 rows inserted. dT=PT1.046S 8550 rows inserted. dT=PT1.07S 8560 rows inserted. dT=PT1.051S 8570 rows inserted. dT=PT1.007S 8580 rows inserted. dT=PT1.028S 8590 rows inserted. dT=PT1.05S 8600 rows inserted. dT=PT1.006S 8610 rows inserted. dT=PT1.024S 8620 rows inserted. dT=PT0.992S 8630 rows inserted. dT=PT1.011S 8640 rows inserted. dT=PT0.982S 8650 rows inserted. dT=PT1.048S 8660 rows inserted. dT=PT1.011S 8670 rows inserted. dT=PT0.935S 8680 rows inserted. dT=PT0.989S 8690 rows inserted. dT=PT1.283S 8700 rows inserted. dT=PT1.025S 8710 rows inserted. dT=PT0.947S 8720 rows inserted. dT=PT1.143S 8730 rows inserted. dT=PT1.072S 8740 rows inserted. dT=PT1.044S 8750 rows inserted. dT=PT1.008S 8760 rows inserted. dT=PT1.004S 8770 rows inserted. dT=PT1.053S 8780 rows inserted. dT=PT1.005S 8790 rows inserted. dT=PT1.052S 8800 rows inserted. dT=PT1.058S 8810 rows inserted. dT=PT0.978S 8820 rows inserted. dT=PT0.981S 8830 rows inserted. dT=PT0.988S 8840 rows inserted. dT=PT1.027S 8850 rows inserted. dT=PT1.027S 8860 rows inserted. dT=PT1.034S 8870 rows inserted. dT=PT1.026S 8880 rows inserted. dT=PT1.058S 8890 rows inserted. dT=PT1.035S 8900 rows inserted. dT=PT1.028S 8910 rows inserted. dT=PT1.066S 8920 rows inserted. dT=PT1.049S 8930 rows inserted. dT=PT1.258S 8940 rows inserted. dT=PT1.072S 8950 rows inserted. dT=PT1.072S 8960 rows inserted. dT=PT1.021S 8970 rows inserted. dT=PT1.015S 8980 rows inserted. dT=PT1.006S 8990 rows inserted. dT=PT0.971S 9000 rows inserted. dT=PT1.034S 9010 rows inserted. dT=PT1.142S 9020 rows inserted. dT=PT1.022S 9030 rows inserted. dT=PT1.077S 9040 rows inserted. dT=PT1.052S 9050 rows inserted. dT=PT1.085S 9060 rows inserted. dT=PT1.031S 2023-05-08 20:03:46:177 +0300 [INFO][%idt_n_0%checkpoint-thread-1][Checkpointer] Checkpoint started [checkpointId=ff6f7318-aed8-4097-b14f-04a3761f1c3a, checkpointBeforeWriteLockTime=12ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=198, reason='Triggered by replicator'] 2023-05-08 20:03:46:910 +0300 [INFO][%idt_n_0%checkpoint-thread-1][Checkpointer] Checkpoint finished [checkpointId=ff6f7318-aed8-4097-b14f-04a3761f1c3a, pages=198, pagesWriteTime=429ms, fsyncTime=304ms, totalTime=745ms] 9070 rows inserted. dT=PT1.942S 9080 rows inserted. dT=PT1.016S 9090 rows inserted. dT=PT0.996S 9100 rows inserted. dT=PT0.974S 9110 rows inserted. dT=PT1.033S 9120 rows inserted. dT=PT1.042S 9130 rows inserted. dT=PT1.018S 9140 rows inserted. dT=PT1.077S 9150 rows inserted. dT=PT0.98S 9160 rows inserted. dT=PT1S 9170 rows inserted. dT=PT0.983S 9180 rows inserted. dT=PT1.018S 9190 rows inserted. dT=PT1.016S 9200 rows inserted. dT=PT1.044S 2023-05-08 20:04:01:889 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Checkpoint started [checkpointId=812c75c9-7cb7-4d00-84fd-e4a086ef60c7, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=101, reason='timeout'] 2023-05-08 20:04:02:106 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Checkpoint finished [checkpointId=812c75c9-7cb7-4d00-84fd-e4a086ef60c7, pages=101, pagesWriteTime=85ms, fsyncTime=128ms, totalTime=213ms] 9210 rows inserted. dT=PT1.496S 9220 rows inserted. dT=PT1.075S 9230 rows inserted. dT=PT1.025S 9240 rows inserted. dT=PT1.019S 9250 rows inserted. dT=PT1.018S 9260 rows inserted. dT=PT1.036S 9270 rows inserted. dT=PT1.051S 2023-05-08 20:04:09:083 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Checkpoint started [checkpointId=8b1d10e5-6bed-4c4f-816b-425f4ae1b68e, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=54, reason='Triggered by replicator'] 2023-05-08 20:04:09:639 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Checkpoint finished [checkpointId=8b1d10e5-6bed-4c4f-816b-425f4ae1b68e, pages=54, pagesWriteTime=409ms, fsyncTime=126ms, totalTime=549ms] 9280 rows inserted. dT=PT1.828S 9290 rows inserted. dT=PT1.005S 9300 rows inserted. dT=PT0.987S 9310 rows inserted. dT=PT1.042S 9320 rows inserted. dT=PT1.005S 9330 rows inserted. dT=PT1.054S 9340 rows inserted. dT=PT1.047S 9350 rows inserted. dT=PT1.048S 9360 rows inserted. dT=PT1.062S 9370 rows inserted. dT=PT1.041S 9380 rows inserted. dT=PT1.02S 2023-05-08 20:04:21:890 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Checkpoint started [checkpointId=aee56072-40ed-45a6-92c5-36885ae8c7a2, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=173, reason='timeout'] 9390 rows inserted. dT=PT1.044S 2023-05-08 20:04:22:292 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Checkpoint finished [checkpointId=aee56072-40ed-45a6-92c5-36885ae8c7a2, pages=173, pagesWriteTime=135ms, fsyncTime=271ms, totalTime=406ms] 9400 rows inserted. dT=PT1.669S 9410 rows inserted. dT=PT1.002S 9420 rows inserted. dT=PT1.054S 9430 rows inserted. dT=PT1.009S 9440 rows inserted. dT=PT1.036S 9450 rows inserted. dT=PT1.028S 9460 rows inserted. dT=PT0.987S 9470 rows inserted. dT=PT1.045S 9480 rows inserted. dT=PT1.028S 9490 rows inserted. dT=PT0.956S 9500 rows inserted. dT=PT0.976S 9510 rows inserted. dT=PT1.02S 9520 rows inserted. dT=PT1.051S 9530 rows inserted. dT=PT1.021S 9540 rows inserted. dT=PT1.052S 9550 rows inserted. dT=PT1.025S 9560 rows inserted. dT=PT1.062S 9570 rows inserted. dT=PT1.477S 9580 rows inserted. dT=PT1.029S 9590 rows inserted. dT=PT1.03S 9600 rows inserted. dT=PT0.988S 9610 rows inserted. dT=PT0.982S 9620 rows inserted. dT=PT1.047S 9630 rows inserted. dT=PT1.012S 9640 rows inserted. dT=PT0.958S 9650 rows inserted. dT=PT0.984S 9660 rows inserted. dT=PT1.007S 9670 rows inserted. dT=PT1.04S 9680 rows inserted. dT=PT1.033S 9690 rows inserted. dT=PT1.033S 9700 rows inserted. dT=PT1.067S 9710 rows inserted. dT=PT0.938S 9720 rows inserted. dT=PT0.998S 9730 rows inserted. dT=PT1.005S 9740 rows inserted. dT=PT0.949S 9750 rows inserted. dT=PT1.074S 9760 rows inserted. dT=PT0.97S 9770 rows inserted. dT=PT0.985S 9780 rows inserted. dT=PT1.021S 9790 rows inserted. dT=PT1.004S 9800 rows inserted. dT=PT1.024S 9810 rows inserted. dT=PT1.053S 9820 rows inserted. dT=PT0.988S 9830 rows inserted. dT=PT1.107S 9840 rows inserted. dT=PT1.01S 9850 rows inserted. dT=PT1.033S 9860 rows inserted. dT=PT1.114S 9870 rows inserted. dT=PT1.059S 9880 rows inserted. dT=PT0.979S 9890 rows inserted. dT=PT1.012S 9900 rows inserted. dT=PT1.006S 9910 rows inserted. dT=PT1.007S 9920 rows inserted. dT=PT1.005S 9930 rows inserted. dT=PT1.044S 9940 rows inserted. dT=PT1.034S 9950 rows inserted. dT=PT1.121S 9960 rows inserted. dT=PT0.899S 9970 rows inserted. dT=PT1.185S 9980 rows inserted. dT=PT1.052S 9990 rows inserted. dT=PT1.043S 10000 rows inserted. dT=PT1.137S Iteration 4 started 10 rows inserted. dT=PT1.214S 20 rows inserted. dT=PT1.055S 30 rows inserted. dT=PT1.067S 40 rows inserted. dT=PT1.043S 50 rows inserted. dT=PT1.049S 60 rows inserted. dT=PT1.046S 70 rows inserted. dT=PT0.954S 80 rows inserted. dT=PT0.981S 90 rows inserted. dT=PT1.01S 100 rows inserted. dT=PT1.031S 110 rows inserted. dT=PT1.148S 120 rows inserted. dT=PT1.016S 130 rows inserted. dT=PT0.973S 140 rows inserted. dT=PT1.077S 150 rows inserted. dT=PT1.028S 160 rows inserted. dT=PT1.211S 170 rows inserted. dT=PT1.002S 180 rows inserted. dT=PT1.127S 190 rows inserted. dT=PT1.022S 200 rows inserted. dT=PT1.046S 210 rows inserted. dT=PT1.044S 220 rows inserted. dT=PT0.993S 230 rows inserted. dT=PT1.033S 240 rows inserted. dT=PT1.023S 250 rows inserted. dT=PT1.033S 260 rows inserted. dT=PT1.004S 270 rows inserted. dT=PT1.082S 280 rows inserted. dT=PT1.003S 290 rows inserted. dT=PT1.049S 300 rows inserted. dT=PT0.958S 310 rows inserted. dT=PT0.98S 320 rows inserted. dT=PT0.96S 330 rows inserted. dT=PT1.103S 340 rows inserted. dT=PT1.055S 350 rows inserted. dT=PT1.006S 360 rows inserted. dT=PT1.01S 370 rows inserted. dT=PT0.99S 380 rows inserted. dT=PT0.984S 390 rows inserted. dT=PT1.074S 400 rows inserted. dT=PT1.124S 410 rows inserted. dT=PT1.008S 420 rows inserted. dT=PT1.001S 430 rows inserted. dT=PT1S 440 rows inserted. dT=PT1.023S 450 rows inserted. dT=PT1.02S 460 rows inserted. dT=PT1.249S 470 rows inserted. dT=PT1.115S 480 rows inserted. dT=PT1.064S 490 rows inserted. dT=PT1.096S 500 rows inserted. dT=PT1.014S 510 rows inserted. dT=PT0.988S 520 rows inserted. dT=PT1.046S 530 rows inserted. dT=PT1.034S 540 rows inserted. dT=PT1.018S 550 rows inserted. dT=PT1.005S 560 rows inserted. dT=PT1.005S 570 rows inserted. dT=PT0.986S 580 rows inserted. dT=PT1.063S 590 rows inserted. dT=PT0.985S 600 rows inserted. dT=PT1.081S 610 rows inserted. dT=PT0.982S 620 rows inserted. dT=PT1.014S 630 rows inserted. dT=PT1.004S 640 rows inserted. dT=PT1.001S 650 rows inserted. dT=PT1.047S 660 rows inserted. dT=PT1.006S 670 rows inserted. dT=PT1.058S 680 rows inserted. dT=PT1.05S 690 rows inserted. dT=PT1.127S 700 rows inserted. dT=PT1.338S 2023-05-08 20:06:42:867 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Checkpoint started [checkpointId=6f829c9d-7051-4a29-9b9a-4942d6404b24, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=239, reason='Triggered by replicator'] 2023-05-08 20:06:43:283 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Checkpoint finished [checkpointId=6f829c9d-7051-4a29-9b9a-4942d6404b24, pages=239, pagesWriteTime=149ms, fsyncTime=253ms, totalTime=427ms] 710 rows inserted. dT=PT1.567S 720 rows inserted. dT=PT1.042S 730 rows inserted. dT=PT1.041S 740 rows inserted. dT=PT1.05S 750 rows inserted. dT=PT1.009S 760 rows inserted. dT=PT1.291S 770 rows inserted. dT=PT1.093S 780 rows inserted. dT=PT1.003S 790 rows inserted. dT=PT1.041S 800 rows inserted. dT=PT1.046S 810 rows inserted. dT=PT1.006S 820 rows inserted. dT=PT1.033S 830 rows inserted. dT=PT0.973S 840 rows inserted. dT=PT1.012S 850 rows inserted. dT=PT1.056S 860 rows inserted. dT=PT1.08S 870 rows inserted. dT=PT1.053S 880 rows inserted. dT=PT0.984S 890 rows inserted. dT=PT1.028S 900 rows inserted. dT=PT1.037S 910 rows inserted. dT=PT1.032S 920 rows inserted. dT=PT1.066S 930 rows inserted. dT=PT1.004S 940 rows inserted. dT=PT0.966S 950 rows inserted. dT=PT1.031S 960 rows inserted. dT=PT1.129S 2023-05-08 20:07:10:938 +0300 [INFO][%idt_n_0%checkpoint-thread-1][Checkpointer] Checkpoint started [checkpointId=cb098074-c6a5-4478-967f-a97e26e43709, checkpointBeforeWriteLockTime=12ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=298, reason='timeout'] 970 rows inserted. dT=PT1.346S 2023-05-08 20:07:11:735 +0300 [INFO][%idt_n_0%checkpoint-thread-1][Checkpointer] Checkpoint finished [checkpointId=cb098074-c6a5-4478-967f-a97e26e43709, pages=298, pagesWriteTime=537ms, fsyncTime=248ms, totalTime=809ms] 980 rows inserted. dT=PT1.488S 990 rows inserted. dT=PT1.011S 1000 rows inserted. dT=PT0.959S 1010 rows inserted. dT=PT1.058S 1020 rows inserted. dT=PT1.036S 1030 rows inserted. dT=PT1.053S 1040 rows inserted. dT=PT1.043S 2023-05-08 20:07:19:922 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Checkpoint started [checkpointId=849c07a3-33ef-42ca-9e6f-3a9da3476486, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=133, reason='timeout'] 2023-05-08 20:07:20:202 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Checkpoint finished [checkpointId=849c07a3-33ef-42ca-9e6f-3a9da3476486, pages=133, pagesWriteTime=109ms, fsyncTime=151ms, totalTime=273ms] 1050 rows inserted. dT=PT1.483S 1060 rows inserted. dT=PT1.016S 1070 rows inserted. dT=PT1.005S 1080 rows inserted. dT=PT1.01S 1090 rows inserted. dT=PT1.027S 1100 rows inserted. dT=PT1.073S 1110 rows inserted. dT=PT1.007S 1120 rows inserted. dT=PT0.966S 1130 rows inserted. dT=PT1.015S 1140 rows inserted. dT=PT1.031S 1150 rows inserted. dT=PT0.959S 1160 rows inserted. dT=PT1.045S 1170 rows inserted. dT=PT1.07S 1180 rows inserted. dT=PT0.976S 1190 rows inserted. dT=PT1.08S 1200 rows inserted. dT=PT1.029S 1210 rows inserted. dT=PT1.025S 1220 rows inserted. dT=PT1.032S 1230 rows inserted. dT=PT1.011S 1240 rows inserted. dT=PT1.015S 1250 rows inserted. dT=PT1.262S 1260 rows inserted. dT=PT1.26S 1270 rows inserted. dT=PT1.048S 1280 rows inserted. dT=PT0.988S 1290 rows inserted. dT=PT0.981S 1300 rows inserted. dT=PT1.047S 1310 rows inserted. dT=PT1.01S 1320 rows inserted. dT=PT0.957S 1330 rows inserted. dT=PT1.047S 2023-05-08 20:07:50:427 +0300 [INFO][%idt_n_0%vault-2][LowWatermark] Successful low watermark update: HybridTimestamp [time=110333982829182976] 1340 rows inserted. dT=PT1.045S 2023-05-08 20:07:50:997 +0300 [INFO][%idt_n_2%vault-2][LowWatermark] Successful low watermark update: HybridTimestamp [time=110333982867062784] 2023-05-08 20:07:51:159 +0300 [INFO][%idt_n_1%vault-2][LowWatermark] Successful low watermark update: HybridTimestamp [time=110333982877810688] 1350 rows inserted. dT=PT1.059S 1360 rows inserted. dT=PT0.983S 1370 rows inserted. dT=PT1.024S 1380 rows inserted. dT=PT1.048S 1390 rows inserted. dT=PT1.047S 1400 rows inserted. dT=PT1.034S 1410 rows inserted. dT=PT0.957S 1420 rows inserted. dT=PT1.051S 1430 rows inserted. dT=PT1.051S 1440 rows inserted. dT=PT1.028S 1450 rows inserted. dT=PT0.997S 1460 rows inserted. dT=PT1.044S 1470 rows inserted. dT=PT1.031S 1480 rows inserted. dT=PT1.054S 1490 rows inserted. dT=PT1.026S 1500 rows inserted. dT=PT1.008S 1510 rows inserted. dT=PT1.048S 1520 rows inserted. dT=PT0.983S 1530 rows inserted. dT=PT1.5S 1540 rows inserted. dT=PT0.982S 1550 rows inserted. dT=PT0.979S 1560 rows inserted. dT=PT1.03S 1570 rows inserted. dT=PT1.028S 1580 rows inserted. dT=PT1.093S 1590 rows inserted. dT=PT1.037S 1600 rows inserted. dT=PT1.085S 1610 rows inserted. dT=PT1.021S 1620 rows inserted. dT=PT1.019S 1630 rows inserted. dT=PT1.005S 1640 rows inserted. dT=PT1.007S 1650 rows inserted. dT=PT1.016S 1660 rows inserted. dT=PT1.049S 1670 rows inserted. dT=PT1.054S 1680 rows inserted. dT=PT1S 1690 rows inserted. dT=PT1.053S 1700 rows inserted. dT=PT1.029S 1710 rows inserted. dT=PT1.037S 1720 rows inserted. dT=PT1.05S 1730 rows inserted. dT=PT1.16S 1740 rows inserted. dT=PT0.872S 2023-05-08 20:08:32:218 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Checkpoint started [checkpointId=96379e60-a05c-452c-8a5a-72a4d7346a0d, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=166, reason='Triggered by replicator'] 2023-05-08 20:08:32:800 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Checkpoint finished [checkpointId=96379e60-a05c-452c-8a5a-72a4d7346a0d, pages=166, pagesWriteTime=347ms, fsyncTime=228ms, totalTime=590ms] 1750 rows inserted. dT=PT1.726S 1760 rows inserted. dT=PT1.072S 1770 rows inserted. dT=PT0.997S 1780 rows inserted. dT=PT1.054S 1790 rows inserted. dT=PT0.96S 1800 rows inserted. dT=PT1.027S 1810 rows inserted. dT=PT0.98S 1820 rows inserted. dT=PT1.418S 1830 rows inserted. dT=PT0.974S 1840 rows inserted. dT=PT0.79S 1850 rows inserted. dT=PT0.914S 1860 rows inserted. dT=PT0.988S 1870 rows inserted. dT=PT1.229S 1880 rows inserted. dT=PT0.95S 1890 rows inserted. dT=PT1.181S 1900 rows inserted. dT=PT1.066S 1910 rows inserted. dT=PT1.03S 1920 rows inserted. dT=PT0.965S 1930 rows inserted. dT=PT1.037S 1940 rows inserted. dT=PT1.084S 1950 rows inserted. dT=PT1.006S 1960 rows inserted. dT=PT0.985S 1970 rows inserted. dT=PT1.014S 1980 rows inserted. dT=PT0.989S 1990 rows inserted. dT=PT1.036S 2000 rows inserted. dT=PT1.002S 2010 rows inserted. dT=PT1.016S 2020 rows inserted. dT=PT1.002S 2030 rows inserted. dT=PT1.075S 2040 rows inserted. dT=PT1.052S 2050 rows inserted. dT=PT1.088S 2060 rows inserted. dT=PT1.074S 2070 rows inserted. dT=PT1.133S 2080 rows inserted. dT=PT0.998S 2090 rows inserted. dT=PT1.154S 2100 rows inserted. dT=PT1.306S 2110 rows inserted. dT=PT1.019S 2120 rows inserted. dT=PT1.02S 2130 rows inserted. dT=PT0.983S 2140 rows inserted. dT=PT1.009S 2150 rows inserted. dT=PT0.989S 2160 rows inserted. dT=PT1.005S 2170 rows inserted. dT=PT1.007S 2180 rows inserted. dT=PT1.068S 2190 rows inserted. dT=PT0.972S 2200 rows inserted. dT=PT1.059S 2210 rows inserted. dT=PT1.002S 2220 rows inserted. dT=PT1.015S 2230 rows inserted. dT=PT1.033S 2240 rows inserted. dT=PT1.055S 2250 rows inserted. dT=PT0.942S 2260 rows inserted. dT=PT1.038S 2270 rows inserted. dT=PT1.004S 2280 rows inserted. dT=PT1.012S 2290 rows inserted. dT=PT1.055S 2300 rows inserted. dT=PT1.051S 2310 rows inserted. dT=PT1.075S 2320 rows inserted. dT=PT1.014S 2330 rows inserted. dT=PT0.98S 2340 rows inserted. dT=PT1.042S 2350 rows inserted. dT=PT1.028S 2360 rows inserted. dT=PT1.174S 2370 rows inserted. dT=PT0.921S 2380 rows inserted. dT=PT1.371S 2390 rows inserted. dT=PT1.115S 2400 rows inserted. dT=PT1.067S 2410 rows inserted. dT=PT1.065S 2420 rows inserted. dT=PT1.048S 2430 rows inserted. dT=PT0.964S 2440 rows inserted. dT=PT0.984S 2450 rows inserted. dT=PT1.077S 2460 rows inserted. dT=PT0.98S 2470 rows inserted. dT=PT0.94S 2480 rows inserted. dT=PT1.065S 2490 rows inserted. dT=PT1.008S 2500 rows inserted. dT=PT0.996S 2510 rows inserted. dT=PT1.028S 2520 rows inserted. dT=PT1.049S 2530 rows inserted. dT=PT1.004S 2540 rows inserted. dT=PT1.051S 2550 rows inserted. dT=PT1.053S 2560 rows inserted. dT=PT1.015S 2570 rows inserted. dT=PT1.059S 2580 rows inserted. dT=PT1.032S 2590 rows inserted. dT=PT1S 2600 rows inserted. dT=PT1.009S 2610 rows inserted. dT=PT1.034S 2620 rows inserted. dT=PT0.926S 2630 rows inserted. dT=PT0.992S 2640 rows inserted. dT=PT0.965S 2023-05-08 20:10:06:215 +0300 [INFO][%idt_n_0%checkpoint-thread-1][Checkpointer] Checkpoint started [checkpointId=df911056-66f5-4fe4-82fc-59d024a6a92f, checkpointBeforeWriteLockTime=10ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=212, reason='timeout'] 2023-05-08 20:10:06:985 +0300 [INFO][%idt_n_0%checkpoint-thread-1][Checkpointer] Checkpoint finished [checkpointId=df911056-66f5-4fe4-82fc-59d024a6a92f, pages=212, pagesWriteTime=462ms, fsyncTime=283ms, totalTime=770ms] 2650 rows inserted. dT=PT1.813S 2660 rows inserted. dT=PT0.998S 2670 rows inserted. dT=PT1.025S 2023-05-08 20:10:10:913 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Checkpoint started [checkpointId=a9b0b8d5-a596-40c6-a93d-6ef73020363c, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=94, reason='Triggered by replicator'] 2680 rows inserted. dT=PT1.107S 2023-05-08 20:10:11:134 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Checkpoint finished [checkpointId=a9b0b8d5-a596-40c6-a93d-6ef73020363c, pages=94, pagesWriteTime=89ms, fsyncTime=124ms, totalTime=213ms] 2690 rows inserted. dT=PT1.545S 2700 rows inserted. dT=PT0.931S 2710 rows inserted. dT=PT0.919S 2720 rows inserted. dT=PT0.913S 2730 rows inserted. dT=PT1.213S 2740 rows inserted. dT=PT0.985S 2750 rows inserted. dT=PT1.051S 2023-05-08 20:10:19:367 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Checkpoint started [checkpointId=0c726bfe-f09d-497b-9ef3-8070651f39b7, checkpointBeforeWriteLockTime=13ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=175, reason='Triggered by replicator'] 2760 rows inserted. dT=PT1.041S 2023-05-08 20:10:19:870 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Checkpoint finished [checkpointId=0c726bfe-f09d-497b-9ef3-8070651f39b7, pages=175, pagesWriteTime=279ms, fsyncTime=214ms, totalTime=506ms] 2770 rows inserted. dT=PT1.657S 2780 rows inserted. dT=PT1.248S 2790 rows inserted. dT=PT0.976S 2800 rows inserted. dT=PT1.026S 2810 rows inserted. dT=PT1.057S 2820 rows inserted. dT=PT0.954S 2830 rows inserted. dT=PT1.025S 2840 rows inserted. dT=PT0.975S 2850 rows inserted. dT=PT1S 2023-05-08 20:10:30:504 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Checkpoint started [checkpointId=fa3c6189-0104-42d2-b84a-03f98200561e, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=101, reason='Triggered by replicator'] 2860 rows inserted. dT=PT1.029S 2023-05-08 20:10:30:820 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Checkpoint finished [checkpointId=fa3c6189-0104-42d2-b84a-03f98200561e, pages=101, pagesWriteTime=84ms, fsyncTime=222ms, totalTime=321ms] 2870 rows inserted. dT=PT1.46S 2880 rows inserted. dT=PT1.025S 2890 rows inserted. dT=PT1.029S 2900 rows inserted. dT=PT0.988S 2910 rows inserted. dT=PT1.049S 2920 rows inserted. dT=PT1.072S 2930 rows inserted. dT=PT1.282S 2940 rows inserted. dT=PT0.81S 2023-05-08 20:10:39:878 +0300 [INFO][%idt_n_1%JRaft-Common-Executor-1][LocalSnapshotStorage] Deleting snapshot build/work/ItDmlTest/static_555993353560259/idt_n_1/metastorage_group_idt_n_1_0/snapshot/snapshot_21. 2023-05-08 20:10:39:878 +0300 [INFO][%idt_n_1%JRaft-Common-Executor-1][LocalSnapshotStorage] Renaming build/work/ItDmlTest/static_555993353560259/idt_n_1/metastorage_group_idt_n_1_0/snapshot/temp to build/work/ItDmlTest/static_555993353560259/idt_n_1/metastorage_group_idt_n_1_0/snapshot/snapshot_21. 2950 rows inserted. dT=PT1.486S 2960 rows inserted. dT=PT0.984S 2970 rows inserted. dT=PT1.025S 2980 rows inserted. dT=PT1.019S 2990 rows inserted. dT=PT0.985S 3000 rows inserted. dT=PT1.03S 2023-05-08 20:10:45:949 +0300 [INFO][%idt_n_0%checkpoint-thread-1][Checkpointer] Checkpoint started [checkpointId=dfdb68ac-3e73-4b0a-acbe-63e6e8bc6089, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=193, reason='Triggered by replicator'] 2023-05-08 20:10:46:498 +0300 [INFO][%idt_n_0%checkpoint-thread-1][Checkpointer] Checkpoint finished [checkpointId=dfdb68ac-3e73-4b0a-acbe-63e6e8bc6089, pages=193, pagesWriteTime=171ms, fsyncTime=363ms, totalTime=545ms] 3010 rows inserted. dT=PT1.792S 3020 rows inserted. dT=PT0.98S 3030 rows inserted. dT=PT1.062S 3040 rows inserted. dT=PT1.033S 3050 rows inserted. dT=PT1.028S 3060 rows inserted. dT=PT1.044S 3070 rows inserted. dT=PT1.004S 3080 rows inserted. dT=PT1.03S 3090 rows inserted. dT=PT0.997S 3100 rows inserted. dT=PT1.048S 3110 rows inserted. dT=PT1.036S 3120 rows inserted. dT=PT1.086S 3130 rows inserted. dT=PT0.963S 3140 rows inserted. dT=PT0.991S 3150 rows inserted. dT=PT1.031S 3160 rows inserted. dT=PT1.026S 3170 rows inserted. dT=PT0.93S 3180 rows inserted. dT=PT1.084S 3190 rows inserted. dT=PT1.022S 3200 rows inserted. dT=PT1.047S 3210 rows inserted. dT=PT1.036S 2023-05-08 20:11:08:419 +0300 [INFO][%idt_n_0%checkpoint-thread-1][Checkpointer] Checkpoint started [checkpointId=1b8645b5-2323-457c-9719-686b089c2ddb, checkpointBeforeWriteLockTime=10ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=158, reason='Triggered by replicator'] 2023-05-08 20:11:09:019 +0300 [INFO][%idt_n_0%checkpoint-thread-1][Checkpointer] Checkpoint finished [checkpointId=1b8645b5-2323-457c-9719-686b089c2ddb, pages=158, pagesWriteTime=255ms, fsyncTime=329ms, totalTime=607ms] 3220 rows inserted. dT=PT1.819S 3230 rows inserted. dT=PT1.162S 3240 rows inserted. dT=PT1.061S 3250 rows inserted. dT=PT1.032S 3260 rows inserted. dT=PT1.087S 3270 rows inserted. dT=PT1.073S 3280 rows inserted. dT=PT0.88S 3290 rows inserted. dT=PT1.42S 3300 rows inserted. dT=PT1.008S 3310 rows inserted. dT=PT1.028S 3320 rows inserted. dT=PT1.007S 3330 rows inserted. dT=PT1.02S 3340 rows inserted. dT=PT1.025S 3350 rows inserted. dT=PT0.945S 3360 rows inserted. dT=PT1.013S 3370 rows inserted. dT=PT1.046S 3380 rows inserted. dT=PT1.052S 3390 rows inserted. dT=PT1.03S 3400 rows inserted. dT=PT0.988S 3410 rows inserted. dT=PT1.053S 3420 rows inserted. dT=PT1.003S 3430 rows inserted. dT=PT1.003S 3440 rows inserted. dT=PT1.006S 3450 rows inserted. dT=PT1.025S 3460 rows inserted. dT=PT1.039S 3470 rows inserted. dT=PT1.032S 3480 rows inserted. dT=PT1.019S 3490 rows inserted. dT=PT0.96S 3500 rows inserted. dT=PT1.026S 3510 rows inserted. dT=PT0.969S 3520 rows inserted. dT=PT1.125S 3530 rows inserted. dT=PT0.984S 3540 rows inserted. dT=PT1.009S 3550 rows inserted. dT=PT1.068S 3560 rows inserted. dT=PT1.004S 3570 rows inserted. dT=PT0.98S 3580 rows inserted. dT=PT0.97S 3590 rows inserted. dT=PT1.002S 3600 rows inserted. dT=PT0.997S 3610 rows inserted. dT=PT1.038S 3620 rows inserted. dT=PT1.003S 3630 rows inserted. dT=PT1.057S 3640 rows inserted. dT=PT1.005S 3650 rows inserted. dT=PT1.036S 3660 rows inserted. dT=PT1.045S 3670 rows inserted. dT=PT1.003S 3680 rows inserted. dT=PT1.312S 3690 rows inserted. dT=PT1.006S 3700 rows inserted. dT=PT1.058S 3710 rows inserted. dT=PT0.987S 3720 rows inserted. dT=PT1.024S 3730 rows inserted. dT=PT1.026S 3740 rows inserted. dT=PT0.958S 3750 rows inserted. dT=PT1.051S 3760 rows inserted. dT=PT1.009S 3770 rows inserted. dT=PT1.009S 3780 rows inserted. dT=PT1.069S 3790 rows inserted. dT=PT1.032S 3800 rows inserted. dT=PT1.003S 3810 rows inserted. dT=PT1.267S 3820 rows inserted. dT=PT1.068S 3830 rows inserted. dT=PT1.044S 3840 rows inserted. dT=PT1.184S 3850 rows inserted. dT=PT0.929S 3860 rows inserted. dT=PT1.159S 3870 rows inserted. dT=PT1.147S 3880 rows inserted. dT=PT1.013S 3890 rows inserted. dT=PT0.966S 3900 rows inserted. dT=PT1.105S 3910 rows inserted. dT=PT1.054S 3920 rows inserted. dT=PT1.065S 3930 rows inserted. dT=PT1.071S 3940 rows inserted. dT=PT1.028S 3950 rows inserted. dT=PT1.054S 3960 rows inserted. dT=PT1.032S 3970 rows inserted. dT=PT1.022S 3980 rows inserted. dT=PT1.066S 3990 rows inserted. dT=PT1.075S 4000 rows inserted. dT=PT1.058S 4010 rows inserted. dT=PT1.087S 4020 rows inserted. dT=PT1.044S 4030 rows inserted. dT=PT0.92S 4040 rows inserted. dT=PT1.067S 4050 rows inserted. dT=PT1.156S 4060 rows inserted. dT=PT0.828S 4070 rows inserted. dT=PT1.224S 4080 rows inserted. dT=PT1.013S 4090 rows inserted. dT=PT1.175S 4100 rows inserted. dT=PT1.079S 4110 rows inserted. dT=PT1.046S 4120 rows inserted. dT=PT1.025S 4130 rows inserted. dT=PT1.018S 4140 rows inserted. dT=PT1.011S 4150 rows inserted. dT=PT1.034S 4160 rows inserted. dT=PT1.046S 4170 rows inserted. dT=PT1.036S 4180 rows inserted. dT=PT1.009S 2023-05-08 20:12:50:455 +0300 [INFO][%idt_n_0%vault-3][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334002491883520] 4190 rows inserted. dT=PT0.975S 2023-05-08 20:12:51:008 +0300 [INFO][%idt_n_2%vault-3][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334002528714752] 2023-05-08 20:12:51:174 +0300 [INFO][%idt_n_1%vault-3][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334002539397120] 4200 rows inserted. dT=PT1.051S 4210 rows inserted. dT=PT0.975S 4220 rows inserted. dT=PT0.989S 4230 rows inserted. dT=PT0.986S 4240 rows inserted. dT=PT1.005S 4250 rows inserted. dT=PT0.954S 4260 rows inserted. dT=PT1.01S 4270 rows inserted. dT=PT1.015S 4280 rows inserted. dT=PT1.039S 4290 rows inserted. dT=PT1.029S 4300 rows inserted. dT=PT1.06S 4310 rows inserted. dT=PT0.989S 4320 rows inserted. dT=PT1.015S 4330 rows inserted. dT=PT0.991S 4340 rows inserted. dT=PT1.007S 4350 rows inserted. dT=PT0.987S 4360 rows inserted. dT=PT1.12S 4370 rows inserted. dT=PT1.344S 4380 rows inserted. dT=PT1.187S 4390 rows inserted. dT=PT1.076S 4400 rows inserted. dT=PT1.005S 4410 rows inserted. dT=PT0.982S 2023-05-08 20:13:14:353 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Checkpoint started [checkpointId=156922ac-bbc1-4f1b-9f6f-cd56e3c8a05a, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=211, reason='timeout'] 2023-05-08 20:13:14:857 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Checkpoint finished [checkpointId=156922ac-bbc1-4f1b-9f6f-cd56e3c8a05a, pages=211, pagesWriteTime=289ms, fsyncTime=215ms, totalTime=504ms] 4420 rows inserted. dT=PT1.338S 4430 rows inserted. dT=PT1.501S 4440 rows inserted. dT=PT1.063S 4450 rows inserted. dT=PT0.984S 4460 rows inserted. dT=PT1.052S 4470 rows inserted. dT=PT1.051S 4480 rows inserted. dT=PT1.026S 4490 rows inserted. dT=PT1.033S 4500 rows inserted. dT=PT0.945S 4510 rows inserted. dT=PT1.003S 4520 rows inserted. dT=PT0.979S 4530 rows inserted. dT=PT1.05S 4540 rows inserted. dT=PT0.999S 4550 rows inserted. dT=PT1.039S 4560 rows inserted. dT=PT1.065S 4570 rows inserted. dT=PT1.029S 4580 rows inserted. dT=PT1.037S 4590 rows inserted. dT=PT1.092S 4600 rows inserted. dT=PT1.007S 4610 rows inserted. dT=PT1.021S 4620 rows inserted. dT=PT1.035S 4630 rows inserted. dT=PT1.227S 2023-05-08 20:13:37:987 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Checkpoint started [checkpointId=8a4132dc-dfe5-4515-97ed-23d9e4cb8826, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=118, reason='timeout'] 2023-05-08 20:13:38:363 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Checkpoint finished [checkpointId=8a4132dc-dfe5-4515-97ed-23d9e4cb8826, pages=118, pagesWriteTime=198ms, fsyncTime=176ms, totalTime=384ms] 4640 rows inserted. dT=PT1.369S 4650 rows inserted. dT=PT1.06S 4660 rows inserted. dT=PT1.062S 4670 rows inserted. dT=PT1.093S 2023-05-08 20:13:42:670 +0300 [INFO][%idt_n_0%checkpoint-thread-1][Checkpointer] Checkpoint started [checkpointId=9f6b4901-c13d-4ddd-a699-6da46fc70601, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=245, reason='timeout'] 4680 rows inserted. dT=PT1.114S 2023-05-08 20:13:43:115 +0300 [INFO][%idt_n_0%checkpoint-thread-1][Checkpointer] Checkpoint finished [checkpointId=9f6b4901-c13d-4ddd-a699-6da46fc70601, pages=245, pagesWriteTime=159ms, fsyncTime=265ms, totalTime=439ms] 4690 rows inserted. dT=PT1.584S 4700 rows inserted. dT=PT1.052S 4710 rows inserted. dT=PT1.059S 4720 rows inserted. dT=PT1.037S 4730 rows inserted. dT=PT0.981S 4740 rows inserted. dT=PT0.95S 4750 rows inserted. dT=PT1.054S 4760 rows inserted. dT=PT1.033S 4770 rows inserted. dT=PT1.037S 4780 rows inserted. dT=PT1.029S 4790 rows inserted. dT=PT1.079S 4800 rows inserted. dT=PT0.998S 4810 rows inserted. dT=PT1.07S 4820 rows inserted. dT=PT1.084S 4830 rows inserted. dT=PT1.147S 4840 rows inserted. dT=PT1.031S 4850 rows inserted. dT=PT0.909S 4860 rows inserted. dT=PT0.943S 4870 rows inserted. dT=PT1.369S 4880 rows inserted. dT=PT1.066S 4890 rows inserted. dT=PT1.01S 4900 rows inserted. dT=PT1.024S 4910 rows inserted. dT=PT1.058S 4920 rows inserted. dT=PT0.986S 4930 rows inserted. dT=PT0.983S 4940 rows inserted. dT=PT1.136S 4950 rows inserted. dT=PT1.016S 4960 rows inserted. dT=PT1.036S 4970 rows inserted. dT=PT1.074S 4980 rows inserted. dT=PT1.01S 4990 rows inserted. dT=PT1.029S 5000 rows inserted. dT=PT1.013S 5010 rows inserted. dT=PT1.038S 5020 rows inserted. dT=PT1.064S 5030 rows inserted. dT=PT1.002S 5040 rows inserted. dT=PT1.048S 5050 rows inserted. dT=PT1.323S 5060 rows inserted. dT=PT1.167S 5070 rows inserted. dT=PT1.029S 5080 rows inserted. dT=PT1S 5090 rows inserted. dT=PT1.004S 5100 rows inserted. dT=PT1.048S 5110 rows inserted. dT=PT1.043S 5120 rows inserted. dT=PT0.994S 5130 rows inserted. dT=PT1.013S 5140 rows inserted. dT=PT1.002S 5150 rows inserted. dT=PT1.033S 5160 rows inserted. dT=PT1.004S 5170 rows inserted. dT=PT1.009S 5180 rows inserted. dT=PT1.009S 5190 rows inserted. dT=PT1.062S 5200 rows inserted. dT=PT1.045S 5210 rows inserted. dT=PT1.002S 5220 rows inserted. dT=PT1.032S 5230 rows inserted. dT=PT1.155S 5240 rows inserted. dT=PT1.006S 5250 rows inserted. dT=PT1.112S 5260 rows inserted. dT=PT1.001S 5270 rows inserted. dT=PT1.029S 5280 rows inserted. dT=PT1.072S 5290 rows inserted. dT=PT1.258S 5300 rows inserted. dT=PT1.04S 5310 rows inserted. dT=PT0.963S 5320 rows inserted. dT=PT1.008S 5330 rows inserted. dT=PT1.031S 5340 rows inserted. dT=PT1.008S 5350 rows inserted. dT=PT1.005S 5360 rows inserted. dT=PT1.087S 5370 rows inserted. dT=PT0.932S 5380 rows inserted. dT=PT1.015S 5390 rows inserted. dT=PT0.999S 5400 rows inserted. dT=PT1.003S 5410 rows inserted. dT=PT1.011S 5420 rows inserted. dT=PT1.008S 5430 rows inserted. dT=PT1.02S 5440 rows inserted. dT=PT1.011S 5450 rows inserted. dT=PT1.029S 5460 rows inserted. dT=PT1.031S 5470 rows inserted. dT=PT0.996S 5480 rows inserted. dT=PT1.034S 5490 rows inserted. dT=PT0.954S 5500 rows inserted. dT=PT1.051S 5510 rows inserted. dT=PT0.982S 5520 rows inserted. dT=PT1.114S 5530 rows inserted. dT=PT1.068S 5540 rows inserted. dT=PT1.038S 5550 rows inserted. dT=PT1.01S 5560 rows inserted. dT=PT1.087S 5570 rows inserted. dT=PT1.019S 5580 rows inserted. dT=PT1.148S 5590 rows inserted. dT=PT0.902S 5600 rows inserted. dT=PT0.957S 5610 rows inserted. dT=PT1.028S 5620 rows inserted. dT=PT1.299S 5630 rows inserted. dT=PT0.986S 5640 rows inserted. dT=PT1.002S 5650 rows inserted. dT=PT1.126S 5660 rows inserted. dT=PT1.017S 5670 rows inserted. dT=PT0.981S 5680 rows inserted. dT=PT1.023S 5690 rows inserted. dT=PT1.038S 5700 rows inserted. dT=PT1.053S 5710 rows inserted. dT=PT0.995S 5720 rows inserted. dT=PT0.982S 5730 rows inserted. dT=PT1.025S 5740 rows inserted. dT=PT1.083S 5750 rows inserted. dT=PT1.011S 5760 rows inserted. dT=PT1.003S 5770 rows inserted. dT=PT1.026S 5780 rows inserted. dT=PT1.075S 5790 rows inserted. dT=PT1.059S 5800 rows inserted. dT=PT1.062S 5810 rows inserted. dT=PT1.136S 5820 rows inserted. dT=PT1.02S 5830 rows inserted. dT=PT1.133S 5840 rows inserted. dT=PT0.964S 5850 rows inserted. dT=PT1.031S 5860 rows inserted. dT=PT1.249S 5870 rows inserted. dT=PT1.032S 5880 rows inserted. dT=PT0.973S 5890 rows inserted. dT=PT1.007S 5900 rows inserted. dT=PT0.99S 5910 rows inserted. dT=PT1.038S 5920 rows inserted. dT=PT1.049S 5930 rows inserted. dT=PT1.007S 5940 rows inserted. dT=PT1.012S 5950 rows inserted. dT=PT0.981S 5960 rows inserted. dT=PT1.048S 5970 rows inserted. dT=PT0.991S 5980 rows inserted. dT=PT1.016S 5990 rows inserted. dT=PT1.041S 6000 rows inserted. dT=PT1.026S 6010 rows inserted. dT=PT0.985S 6020 rows inserted. dT=PT1.056S 6030 rows inserted. dT=PT0.982S 6040 rows inserted. dT=PT1.071S 6050 rows inserted. dT=PT0.968S 6060 rows inserted. dT=PT1.033S 6070 rows inserted. dT=PT1.04S 6080 rows inserted. dT=PT0.981S 6090 rows inserted. dT=PT0.995S 6100 rows inserted. dT=PT1.103S 6110 rows inserted. dT=PT1.016S 6120 rows inserted. dT=PT1.037S 6130 rows inserted. dT=PT1.025S 6140 rows inserted. dT=PT1.003S 2023-05-08 20:16:15:347 +0300 [INFO][%idt_n_0%checkpoint-thread-1][Checkpointer] Checkpoint started [checkpointId=36acc50d-4cdb-481f-9afe-d9307d9c9b5f, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=252, reason='timeout'] 2023-05-08 20:16:15:928 +0300 [INFO][%idt_n_0%checkpoint-thread-1][Checkpointer] Checkpoint finished [checkpointId=36acc50d-4cdb-481f-9afe-d9307d9c9b5f, pages=252, pagesWriteTime=287ms, fsyncTime=296ms, totalTime=583ms] 6150 rows inserted. dT=PT1.79S 6160 rows inserted. dT=PT1.099S 6170 rows inserted. dT=PT1.057S 6180 rows inserted. dT=PT0.989S 6190 rows inserted. dT=PT1.007S 6200 rows inserted. dT=PT1.016S 6210 rows inserted. dT=PT0.989S 6220 rows inserted. dT=PT1.048S 6230 rows inserted. dT=PT1.023S 6240 rows inserted. dT=PT1.016S 6250 rows inserted. dT=PT1.056S 6260 rows inserted. dT=PT0.986S 2023-05-08 20:16:28:154 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Checkpoint started [checkpointId=a0c64d94-c734-42d7-9b0e-9d7f59c02fdf, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=216, reason='timeout'] 2023-05-08 20:16:28:870 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Checkpoint finished [checkpointId=a0c64d94-c734-42d7-9b0e-9d7f59c02fdf, pages=216, pagesWriteTime=432ms, fsyncTime=276ms, totalTime=720ms] 6270 rows inserted. dT=PT1.876S 6280 rows inserted. dT=PT1.023S 6290 rows inserted. dT=PT0.947S 6300 rows inserted. dT=PT1.059S 6310 rows inserted. dT=PT1.017S 6320 rows inserted. dT=PT1.025S 6330 rows inserted. dT=PT0.976S 6340 rows inserted. dT=PT1.096S 6350 rows inserted. dT=PT1.004S 6360 rows inserted. dT=PT1.021S 6370 rows inserted. dT=PT1.183S 6380 rows inserted. dT=PT1.29S 6390 rows inserted. dT=PT1.061S 6400 rows inserted. dT=PT1.033S 6410 rows inserted. dT=PT1.008S 6420 rows inserted. dT=PT1.105S 6430 rows inserted. dT=PT0.985S 6440 rows inserted. dT=PT1.039S 6450 rows inserted. dT=PT1.064S 6460 rows inserted. dT=PT0.986S 2023-05-08 20:16:49:881 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Checkpoint started [checkpointId=e0bdccdd-45fc-4d60-ae02-47d1c79560fe, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=117, reason='timeout'] 2023-05-08 20:16:50:126 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Checkpoint finished [checkpointId=e0bdccdd-45fc-4d60-ae02-47d1c79560fe, pages=117, pagesWriteTime=106ms, fsyncTime=139ms, totalTime=245ms] 6470 rows inserted. dT=PT1.457S 6480 rows inserted. dT=PT1.102S 6490 rows inserted. dT=PT0.826S 6500 rows inserted. dT=PT1.162S 6510 rows inserted. dT=PT0.792S 6520 rows inserted. dT=PT1.35S 6530 rows inserted. dT=PT0.955S 6540 rows inserted. dT=PT1.006S 6550 rows inserted. dT=PT1.034S 6560 rows inserted. dT=PT1.019S 6570 rows inserted. dT=PT1.029S 6580 rows inserted. dT=PT0.983S 6590 rows inserted. dT=PT1.017S 6600 rows inserted. dT=PT1.024S 6610 rows inserted. dT=PT1.039S 6620 rows inserted. dT=PT1.08S 6630 rows inserted. dT=PT1.02S 6640 rows inserted. dT=PT1.013S 6650 rows inserted. dT=PT1.059S 6660 rows inserted. dT=PT1.142S 6670 rows inserted. dT=PT0.979S 6680 rows inserted. dT=PT1.031S 6690 rows inserted. dT=PT1.008S 6700 rows inserted. dT=PT0.97S 6710 rows inserted. dT=PT1.007S 6720 rows inserted. dT=PT1.047S 6730 rows inserted. dT=PT1.057S 6740 rows inserted. dT=PT1.039S 6750 rows inserted. dT=PT1.048S 6760 rows inserted. dT=PT1.246S 6770 rows inserted. dT=PT1.065S 6780 rows inserted. dT=PT1.034S 6790 rows inserted. dT=PT1.035S 6800 rows inserted. dT=PT1.003S 6810 rows inserted. dT=PT0.962S 6820 rows inserted. dT=PT0.959S 6830 rows inserted. dT=PT1.007S 6840 rows inserted. dT=PT1.073S 6850 rows inserted. dT=PT1.017S 6860 rows inserted. dT=PT1.055S 6870 rows inserted. dT=PT1.054S 6880 rows inserted. dT=PT1.029S 6890 rows inserted. dT=PT1.016S 6900 rows inserted. dT=PT1.032S 6910 rows inserted. dT=PT1.02S 6920 rows inserted. dT=PT1.021S 6930 rows inserted. dT=PT1.077S 6940 rows inserted. dT=PT1.076S 6950 rows inserted. dT=PT1.157S 6960 rows inserted. dT=PT1.273S 6970 rows inserted. dT=PT1.031S 6980 rows inserted. dT=PT0.751S 6990 rows inserted. dT=PT1.295S 7000 rows inserted. dT=PT1.051S 7010 rows inserted. dT=PT0.989S 7020 rows inserted. dT=PT1.09S 7030 rows inserted. dT=PT1.066S 2023-05-08 20:17:50:465 +0300 [INFO][%idt_n_0%vault-0][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334022153928704] 7040 rows inserted. dT=PT1.03S 2023-05-08 20:17:51:016 +0300 [WARNING][%idt_n_0%JRaft-Request-Processor-0][ReplicaManager] Failed to process replica request [request=ReadWriteMultiRowReplicaRequestImpl [binaryRows=ArrayList [org.apache.ignite.internal.schema.row.Row@2b6ae605], commitPartitionId=f6b9512f-b735-446e-85a3-d6b8636c847c_part_18, groupId=f6b9512f-b735-446e-85a3-d6b8636c847c_part_1, requestType=RW_INSERT_ALL, term=1, timestampLong=110334199137239040, transactionId=0187fc5e-9a26-0000-0000-000063a26a19]] java.util.concurrent.CompletionException: org.apache.ignite.internal.storage.StorageException: IGN-STORAGE-1 TraceId:c48307b5-59a0-4895-a79d-63153a9d47c6 Error removing row version from version chain on garbage collection: [rowId=RowId [partitionId=1, uuid=ca451c56-ea47-422e-b228-67c093ae1a10], rowTimestamp=HybridTimestamp [time=110334012513058818], table=T, partitionId=1] at java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:314) at java.base/java.util.concurrent.CompletableFuture.uniComposeStage(CompletableFuture.java:1113) at java.base/java.util.concurrent.CompletableFuture.thenCompose(CompletableFuture.java:2235) at org.apache.ignite.internal.table.distributed.replicator.PartitionReplicaListener.lambda$processMultiEntryAction$75(PartitionReplicaListener.java:1487) at java.base/java.util.concurrent.CompletableFuture.uniComposeStage(CompletableFuture.java:1106) at java.base/java.util.concurrent.CompletableFuture.thenCompose(CompletableFuture.java:2235) at org.apache.ignite.internal.table.distributed.replicator.PartitionReplicaListener.processMultiEntryAction(PartitionReplicaListener.java:1445) at org.apache.ignite.internal.table.distributed.replicator.PartitionReplicaListener.lambda$processRequest$2(PartitionReplicaListener.java:285) at org.apache.ignite.internal.table.distributed.replicator.PartitionReplicaListener.appendTxCommand(PartitionReplicaListener.java:1197) at org.apache.ignite.internal.table.distributed.replicator.PartitionReplicaListener.processRequest(PartitionReplicaListener.java:285) at org.apache.ignite.internal.table.distributed.replicator.PartitionReplicaListener.lambda$invoke$0(PartitionReplicaListener.java:274) at java.base/java.util.concurrent.CompletableFuture$UniCompose.tryFire(CompletableFuture.java:1072) at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:506) at java.base/java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:2073) at org.apache.ignite.internal.raft.RaftGroupServiceImpl.lambda$sendWithRetry$39(RaftGroupServiceImpl.java:538) at java.base/java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:859) at java.base/java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:837) at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:506) at java.base/java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:2073) at org.apache.ignite.network.DefaultMessagingService.onInvokeResponse(DefaultMessagingService.java:371) at org.apache.ignite.network.DefaultMessagingService.send0(DefaultMessagingService.java:194) at org.apache.ignite.network.DefaultMessagingService.respond(DefaultMessagingService.java:137) at org.apache.ignite.network.MessagingService.respond(MessagingService.java:89) at org.apache.ignite.raft.jraft.rpc.impl.IgniteRpcServer$NetworkRpcContext.sendResponse(IgniteRpcServer.java:233) at org.apache.ignite.raft.jraft.rpc.RpcRequestProcessor.handleRequest(RpcRequestProcessor.java:52) at org.apache.ignite.raft.jraft.rpc.RpcRequestProcessor.handleRequest(RpcRequestProcessor.java:29) at org.apache.ignite.raft.jraft.rpc.impl.IgniteRpcServer$RpcMessageHandler.lambda$onReceived$0(IgniteRpcServer.java:192) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base/java.lang.Thread.run(Thread.java:834) Caused by: org.apache.ignite.internal.storage.StorageException: IGN-STORAGE-1 TraceId:c48307b5-59a0-4895-a79d-63153a9d47c6 Error removing row version from version chain on garbage collection: [rowId=RowId [partitionId=1, uuid=ca451c56-ea47-422e-b228-67c093ae1a10], rowTimestamp=HybridTimestamp [time=110334012513058818], table=T, partitionId=1] at org.apache.ignite.internal.storage.pagememory.mv.AbstractPageMemoryMvPartitionStorage.removeWriteOnGc(AbstractPageMemoryMvPartitionStorage.java:968) at org.apache.ignite.internal.storage.pagememory.mv.AbstractPageMemoryMvPartitionStorage.vacuum(AbstractPageMemoryMvPartitionStorage.java:952) at org.apache.ignite.internal.storage.MvPartitionStorage.lambda$pollForVacuum$0(MvPartitionStorage.java:292) at org.apache.ignite.internal.storage.pagememory.mv.PersistentPageMemoryMvPartitionStorage.runConsistently(PersistentPageMemoryMvPartitionStorage.java:143) at org.apache.ignite.internal.storage.MvPartitionStorage.pollForVacuum(MvPartitionStorage.java:282) at org.apache.ignite.internal.table.distributed.raft.snapshot.outgoing.SnapshotAwarePartitionDataStorage.pollForVacuum(SnapshotAwarePartitionDataStorage.java:141) at org.apache.ignite.internal.table.distributed.StorageUpdateHandler.internalVacuum(StorageUpdateHandler.java:345) at org.apache.ignite.internal.table.distributed.StorageUpdateHandler.lambda$vacuumBatch$4(StorageUpdateHandler.java:332) at org.apache.ignite.internal.storage.pagememory.mv.PersistentPageMemoryMvPartitionStorage.lambda$runConsistently$0(PersistentPageMemoryMvPartitionStorage.java:155) at org.apache.ignite.internal.storage.pagememory.mv.AbstractPageMemoryMvPartitionStorage.busy(AbstractPageMemoryMvPartitionStorage.java:774) at org.apache.ignite.internal.storage.pagememory.mv.PersistentPageMemoryMvPartitionStorage.runConsistently(PersistentPageMemoryMvPartitionStorage.java:145) at org.apache.ignite.internal.table.distributed.raft.snapshot.outgoing.SnapshotAwarePartitionDataStorage.runConsistently(SnapshotAwarePartitionDataStorage.java:66) at org.apache.ignite.internal.table.distributed.StorageUpdateHandler.vacuumBatch(StorageUpdateHandler.java:332) at org.apache.ignite.internal.table.distributed.StorageUpdateHandler.executeBatchGc(StorageUpdateHandler.java:202) at org.apache.ignite.internal.table.distributed.StorageUpdateHandler.handleUpdateAll(StorageUpdateHandler.java:192) at org.apache.ignite.internal.table.distributed.replicator.PartitionReplicaListener.applyUpdateAllCommand(PartitionReplicaListener.java:1600) at org.apache.ignite.internal.table.distributed.replicator.PartitionReplicaListener.lambda$processMultiEntryAction$72(PartitionReplicaListener.java:1487) at java.base/java.util.concurrent.CompletableFuture.uniComposeStage(CompletableFuture.java:1106) ... 28 more Caused by: org.apache.ignite.internal.pagememory.tree.CorruptedTreeException: IGN-CMN-65535 TraceId:0f815e82-c0df-4f6e-8784-be38e9ed94cc B+Tree is corrupted [groupId=1, pageIds=[562954248388665], groupName=T, msg=Runtime failure on search row: org.apache.ignite.internal.storage.pagememory.mv.VersionChainKey@13e0d6a6] at org.apache.ignite.internal.pagememory.tree.BplusTree.corruptedTreeException(BplusTree.java:6724) at org.apache.ignite.internal.pagememory.tree.BplusTree.invoke(BplusTree.java:2135) at org.apache.ignite.internal.storage.pagememory.mv.AbstractPageMemoryMvPartitionStorage.removeWriteOnGc(AbstractPageMemoryMvPartitionStorage.java:961) ... 45 more Caused by: java.lang.AssertionError: rowId=RowId [partitionId=1, uuid=ca451c56-ea47-422e-b228-67c093ae1a10], storage=table=T, partitionId=1 at org.apache.ignite.internal.storage.pagememory.mv.RemoveWriteOnGcInvokeClosure.call(RemoveWriteOnGcInvokeClosure.java:70) at org.apache.ignite.internal.storage.pagememory.mv.RemoveWriteOnGcInvokeClosure.call(RemoveWriteOnGcInvokeClosure.java:42) at org.apache.ignite.internal.pagememory.tree.BplusTree$Invoke.invokeClosure(BplusTree.java:4298) at org.apache.ignite.internal.pagememory.tree.BplusTree.invokeDown(BplusTree.java:2209) at org.apache.ignite.internal.pagememory.tree.BplusTree.invokeDown(BplusTree.java:2191) at org.apache.ignite.internal.pagememory.tree.BplusTree.invoke(BplusTree.java:2109) ... 46 more 2023-05-08 20:17:51:020 +0300 [INFO][%idt_n_2%vault-1][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334022190366720] 2023-05-08 20:17:51:022 +0300 [INFO][%idt_n_0%sql-execution-pool-1][ExchangeServiceImpl] Failed to execute query fragment: queryId=1051306d-d937-405b-83d4-11bb390e8338, fragmentId=1 org.apache.ignite.sql.SqlException: IGN-STORAGE-1 TraceId:c48307b5-59a0-4895-a79d-63153a9d47c6 IGN-STORAGE-1 TraceId:c48307b5-59a0-4895-a79d-63153a9d47c6 Error removing row version from version chain on garbage collection: [rowId=RowId [partitionId=1, uuid=ca451c56-ea47-422e-b228-67c093ae1a10], rowTimestamp=HybridTimestamp [time=110334012513058818], table=T, partitionId=1] at org.apache.ignite.internal.sql.engine.exec.ExchangeServiceImpl.wrapIfNecessary(ExchangeServiceImpl.java:142) at org.apache.ignite.internal.sql.engine.exec.ExchangeServiceImpl.sendError(ExchangeServiceImpl.java:114) at org.apache.ignite.internal.sql.engine.exec.rel.Outbox.sendError(Outbox.java:257) at org.apache.ignite.internal.sql.engine.exec.rel.Outbox.onError(Outbox.java:179) at org.apache.ignite.internal.sql.engine.exec.rel.AbstractNode.onError(AbstractNode.java:140) at org.apache.ignite.internal.sql.engine.exec.rel.AbstractNode.onError(AbstractNode.java:140) at org.apache.ignite.internal.sql.engine.exec.ExchangeServiceImpl.onMessage(ExchangeServiceImpl.java:184) at org.apache.ignite.internal.sql.engine.exec.ExchangeServiceImpl.lambda$start$1(ExchangeServiceImpl.java:75) at org.apache.ignite.internal.sql.engine.message.MessageServiceImpl.onMessageInternal(MessageServiceImpl.java:153) at org.apache.ignite.internal.sql.engine.message.MessageServiceImpl.lambda$onMessage$0(MessageServiceImpl.java:122) at org.apache.ignite.internal.sql.engine.exec.QueryTaskExecutorImpl.lambda$execute$0(QueryTaskExecutorImpl.java:81) at org.apache.ignite.internal.util.StripedESD.lambda$wrap$1(StripedESD.java:76) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base/java.lang.Thread.run(Thread.java:834) Caused by: org.apache.ignite.internal.storage.StorageException: IGN-STORAGE-1 TraceId:c48307b5-59a0-4895-a79d-63153a9d47c6 Error removing row version from version chain on garbage collection: [rowId=RowId [partitionId=1, uuid=ca451c56-ea47-422e-b228-67c093ae1a10], rowTimestamp=HybridTimestamp [time=110334012513058818], table=T, partitionId=1] at org.apache.ignite.internal.storage.pagememory.mv.AbstractPageMemoryMvPartitionStorage.removeWriteOnGc(AbstractPageMemoryMvPartitionStorage.java:968) at org.apache.ignite.internal.storage.pagememory.mv.AbstractPageMemoryMvPartitionStorage.vacuum(AbstractPageMemoryMvPartitionStorage.java:952) at org.apache.ignite.internal.storage.MvPartitionStorage.lambda$pollForVacuum$0(MvPartitionStorage.java:292) at org.apache.ignite.internal.storage.pagememory.mv.PersistentPageMemoryMvPartitionStorage.runConsistently(PersistentPageMemoryMvPartitionStorage.java:143) at org.apache.ignite.internal.storage.MvPartitionStorage.pollForVacuum(MvPartitionStorage.java:282) at org.apache.ignite.internal.table.distributed.raft.snapshot.outgoing.SnapshotAwarePartitionDataStorage.pollForVacuum(SnapshotAwarePartitionDataStorage.java:141) at org.apache.ignite.internal.table.distributed.StorageUpdateHandler.internalVacuum(StorageUpdateHandler.java:345) at org.apache.ignite.internal.table.distributed.StorageUpdateHandler.lambda$vacuumBatch$4(StorageUpdateHandler.java:332) at org.apache.ignite.internal.storage.pagememory.mv.PersistentPageMemoryMvPartitionStorage.lambda$runConsistently$0(PersistentPageMemoryMvPartitionStorage.java:155) at org.apache.ignite.internal.storage.pagememory.mv.AbstractPageMemoryMvPartitionStorage.busy(AbstractPageMemoryMvPartitionStorage.java:774) at org.apache.ignite.internal.storage.pagememory.mv.PersistentPageMemoryMvPartitionStorage.runConsistently(PersistentPageMemoryMvPartitionStorage.java:145) at org.apache.ignite.internal.table.distributed.raft.snapshot.outgoing.SnapshotAwarePartitionDataStorage.runConsistently(SnapshotAwarePartitionDataStorage.java:66) at org.apache.ignite.internal.table.distributed.StorageUpdateHandler.vacuumBatch(StorageUpdateHandler.java:332) at org.apache.ignite.internal.table.distributed.StorageUpdateHandler.executeBatchGc(StorageUpdateHandler.java:202) at org.apache.ignite.internal.table.distributed.StorageUpdateHandler.handleUpdateAll(StorageUpdateHandler.java:192) at org.apache.ignite.internal.table.distributed.replicator.PartitionReplicaListener.applyUpdateAllCommand(PartitionReplicaListener.java:1600) at org.apache.ignite.internal.table.distributed.replicator.PartitionReplicaListener.lambda$processMultiEntryAction$72(PartitionReplicaListener.java:1487) at java.base/java.util.concurrent.CompletableFuture.uniComposeStage(CompletableFuture.java:1106) at java.base/java.util.concurrent.CompletableFuture.thenCompose(CompletableFuture.java:2235) at org.apache.ignite.internal.table.distributed.replicator.PartitionReplicaListener.lambda$processMultiEntryAction$75(PartitionReplicaListener.java:1487) at java.base/java.util.concurrent.CompletableFuture.uniComposeStage(CompletableFuture.java:1106) at java.base/java.util.concurrent.CompletableFuture.thenCompose(CompletableFuture.java:2235) at org.apache.ignite.internal.table.distributed.replicator.PartitionReplicaListener.processMultiEntryAction(PartitionReplicaListener.java:1445) at org.apache.ignite.internal.table.distributed.replicator.PartitionReplicaListener.lambda$processRequest$2(PartitionReplicaListener.java:285) at org.apache.ignite.internal.table.distributed.replicator.PartitionReplicaListener.appendTxCommand(PartitionReplicaListener.java:1197) at org.apache.ignite.internal.table.distributed.replicator.PartitionReplicaListener.processRequest(PartitionReplicaListener.java:285) at org.apache.ignite.internal.table.distributed.replicator.PartitionReplicaListener.lambda$invoke$0(PartitionReplicaListener.java:274) at java.base/java.util.concurrent.CompletableFuture$UniCompose.tryFire(CompletableFuture.java:1072) at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:506) at java.base/java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:2073) at org.apache.ignite.internal.raft.RaftGroupServiceImpl.lambda$sendWithRetry$39(RaftGroupServiceImpl.java:538) at java.base/java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:859) at java.base/java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:837) at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:506) at java.base/java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:2073) at org.apache.ignite.network.DefaultMessagingService.onInvokeResponse(DefaultMessagingService.java:371) at org.apache.ignite.network.DefaultMessagingService.send0(DefaultMessagingService.java:194) at org.apache.ignite.network.DefaultMessagingService.respond(DefaultMessagingService.java:137) at org.apache.ignite.network.MessagingService.respond(MessagingService.java:89) at org.apache.ignite.raft.jraft.rpc.impl.IgniteRpcServer$NetworkRpcContext.sendResponse(IgniteRpcServer.java:233) at org.apache.ignite.raft.jraft.rpc.RpcRequestProcessor.handleRequest(RpcRequestProcessor.java:52) at org.apache.ignite.raft.jraft.rpc.RpcRequestProcessor.handleRequest(RpcRequestProcessor.java:29) at org.apache.ignite.raft.jraft.rpc.impl.IgniteRpcServer$RpcMessageHandler.lambda$onReceived$0(IgniteRpcServer.java:192) ... 3 more Caused by: org.apache.ignite.internal.pagememory.tree.CorruptedTreeException: IGN-CMN-65535 TraceId:0f815e82-c0df-4f6e-8784-be38e9ed94cc B+Tree is corrupted [groupId=1, pageIds=[562954248388665], groupName=T, msg=Runtime failure on search row: org.apache.ignite.internal.storage.pagememory.mv.VersionChainKey@13e0d6a6] at org.apache.ignite.internal.pagememory.tree.BplusTree.corruptedTreeException(BplusTree.java:6724) at org.apache.ignite.internal.pagememory.tree.BplusTree.invoke(BplusTree.java:2135) at org.apache.ignite.internal.storage.pagememory.mv.AbstractPageMemoryMvPartitionStorage.removeWriteOnGc(AbstractPageMemoryMvPartitionStorage.java:961) ... 45 more Caused by: java.lang.AssertionError: rowId=RowId [partitionId=1, uuid=ca451c56-ea47-422e-b228-67c093ae1a10], storage=table=T, partitionId=1 at org.apache.ignite.internal.storage.pagememory.mv.RemoveWriteOnGcInvokeClosure.call(RemoveWriteOnGcInvokeClosure.java:70) at org.apache.ignite.internal.storage.pagememory.mv.RemoveWriteOnGcInvokeClosure.call(RemoveWriteOnGcInvokeClosure.java:42) at org.apache.ignite.internal.pagememory.tree.BplusTree$Invoke.invokeClosure(BplusTree.java:4298) at org.apache.ignite.internal.pagememory.tree.BplusTree.invokeDown(BplusTree.java:2209) at org.apache.ignite.internal.pagememory.tree.BplusTree.invokeDown(BplusTree.java:2191) at org.apache.ignite.internal.pagememory.tree.BplusTree.invoke(BplusTree.java:2109) ... 46 more 2023-05-08 20:17:51:155 +0300 [INFO][%idt_n_0%vault-1][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_0 2023-05-08 20:17:51:177 +0300 [INFO][%idt_n_0%vault-1][NodeImpl] Node shutdown, currTerm=1 state=STATE_LEADER. 2023-05-08 20:17:51:198 +0300 [INFO][%idt_n_1%vault-1][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334022201245696] 2023-05-08 20:17:51:198 +0300 [INFO][%idt_n_0%vault-1][ReplicatorGroupImpl] Fail to find the next candidate. 2023-05-08 20:17:51:200 +0300 [INFO][%idt_n_0%JRaft-FSMCaller-Disruptor-_stripe_0-0][StateMachineAdapter] onLeaderStop: status=Status[ESHUTDOWN<1007>: Raft node is going to quit.]. 2023-05-08 20:17:51:220 +0300 [INFO][%idt_n_1%vault-0][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_0 2023-05-08 20:17:51:221 +0300 [INFO][%idt_n_2%vault-0][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_0 2023-05-08 20:17:51:242 +0300 [INFO][%idt_n_1%vault-0][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_1 2023-05-08 20:17:51:263 +0300 [INFO][%idt_n_2%vault-0][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_1 2023-05-08 20:17:51:264 +0300 [INFO][%idt_n_1%vault-0][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_2 2023-05-08 20:17:51:285 +0300 [INFO][%idt_n_2%vault-0][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_2 2023-05-08 20:17:51:306 +0300 [INFO][%idt_n_1%vault-0][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_3 2023-05-08 20:17:51:327 +0300 [INFO][%idt_n_2%vault-0][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_3 2023-05-08 20:17:51:349 +0300 [INFO][%idt_n_1%vault-0][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_4 2023-05-08 20:17:51:349 +0300 [INFO][%idt_n_2%vault-0][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_4 2023-05-08 20:17:51:371 +0300 [INFO][%idt_n_1%vault-0][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_5 2023-05-08 20:17:51:371 +0300 [INFO][%idt_n_2%vault-0][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_5 2023-05-08 20:17:51:393 +0300 [INFO][%idt_n_1%vault-0][NodeImpl] Node shutdown, currTerm=1 state=STATE_LEADER. 2023-05-08 20:17:51:414 +0300 [INFO][%idt_n_2%vault-0][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_6 2023-05-08 20:17:51:435 +0300 [INFO][%idt_n_0%vault-1][LocalRaftMetaStorage] Save raft meta, path=build/work/ItDmlTest/static_555993353560259/idt_n_0/f6b9512f-b735-446e-85a3-d6b8636c847c_part_0_idt_n_0_0/meta, term=1, votedFor=idt_n_0, cost time=215 ms 2023-05-08 20:17:51:436 +0300 [INFO][%idt_n_1%JRaft-FSMCaller-Disruptor-_stripe_2-0][StateMachineAdapter] onLeaderStop: status=Status[ESHUTDOWN<1007>: Raft node is going to quit.]. 2023-05-08 20:17:51:436 +0300 [INFO][%idt_n_1%vault-0][ReplicatorGroupImpl] Fail to find the next candidate. 2023-05-08 20:17:51:436 +0300 [INFO][%idt_n_0%vault-1][FSMCallerImpl] Shutting down FSMCaller... 2023-05-08 20:17:51:457 +0300 [INFO][%idt_n_2%vault-0][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_7 2023-05-08 20:17:51:457 +0300 [INFO][%idt_n_2%vault-0][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_8 2023-05-08 20:17:51:457 +0300 [INFO][%idt_n_2%vault-0][NodeImpl] Node shutdown, currTerm=1 state=STATE_LEADER. 2023-05-08 20:17:51:463 +0300 [INFO][%idt_n_0%vault-1][RaftGroupService] Stop the RaftGroupService successfully. 2023-05-08 20:17:51:479 +0300 [INFO][%idt_n_2%vault-0][ReplicatorGroupImpl] Fail to find the next candidate. 2023-05-08 20:17:51:479 +0300 [INFO][%idt_n_2%JRaft-FSMCaller-Disruptor-_stripe_2-0][StateMachineAdapter] onLeaderStop: status=Status[ESHUTDOWN<1007>: Raft node is going to quit.]. 2023-05-08 20:17:51:479 +0300 [INFO][%idt_n_0%vault-1][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_1 2023-05-08 20:17:51:480 +0300 [INFO][%idt_n_0%vault-1][NodeImpl] Node shutdown, currTerm=1 state=STATE_LEADER. 2023-05-08 20:17:51:500 +0300 [INFO][%idt_n_0%vault-1][ReplicatorGroupImpl] Fail to find the next candidate. 2023-05-08 20:17:51:500 +0300 [INFO][%idt_n_0%JRaft-FSMCaller-Disruptor-_stripe_3-0][StateMachineAdapter] onLeaderStop: status=Status[ESHUTDOWN<1007>: Raft node is going to quit.]. 2023-05-08 20:17:51:601 +0300 [INFO][%idt_n_1%vault-0][LocalRaftMetaStorage] Save raft meta, path=build/work/ItDmlTest/static_555993353560259/idt_n_1/f6b9512f-b735-446e-85a3-d6b8636c847c_part_5_idt_n_1_0/meta, term=1, votedFor=idt_n_1, cost time=144 ms 2023-05-08 20:17:51:602 +0300 [INFO][%idt_n_1%vault-0][FSMCallerImpl] Shutting down FSMCaller... 2023-05-08 20:17:51:603 +0300 [INFO][%idt_n_1%vault-0][RaftGroupService] Stop the RaftGroupService successfully. 2023-05-08 20:17:51:623 +0300 [INFO][%idt_n_2%vault-0][LocalRaftMetaStorage] Save raft meta, path=build/work/ItDmlTest/static_555993353560259/idt_n_2/f6b9512f-b735-446e-85a3-d6b8636c847c_part_8_idt_n_2_0/meta, term=1, votedFor=idt_n_2, cost time=144 ms 2023-05-08 20:17:51:624 +0300 [INFO][%idt_n_1%vault-0][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_6 2023-05-08 20:17:51:624 +0300 [INFO][%idt_n_2%vault-0][FSMCallerImpl] Shutting down FSMCaller... 2023-05-08 20:17:51:624 +0300 [INFO][%idt_n_1%vault-0][NodeImpl] Node shutdown, currTerm=1 state=STATE_LEADER. 2023-05-08 20:17:51:645 +0300 [INFO][%idt_n_0%vault-1][LocalRaftMetaStorage] Save raft meta, path=build/work/ItDmlTest/static_555993353560259/idt_n_0/f6b9512f-b735-446e-85a3-d6b8636c847c_part_1_idt_n_0_0/meta, term=1, votedFor=idt_n_0, cost time=144 ms 2023-05-08 20:17:51:646 +0300 [INFO][%idt_n_1%vault-0][ReplicatorGroupImpl] Fail to find the next candidate. 2023-05-08 20:17:51:646 +0300 [INFO][%idt_n_0%vault-1][FSMCallerImpl] Shutting down FSMCaller... 2023-05-08 20:17:51:646 +0300 [INFO][%idt_n_1%JRaft-FSMCaller-Disruptor-_stripe_1-0][StateMachineAdapter] onLeaderStop: status=Status[ESHUTDOWN<1007>: Raft node is going to quit.]. 2023-05-08 20:17:51:646 +0300 [INFO][%idt_n_2%vault-0][RaftGroupService] Stop the RaftGroupService successfully. 2023-05-08 20:17:51:647 +0300 [INFO][%idt_n_2%vault-0][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_9 2023-05-08 20:17:51:648 +0300 [INFO][%idt_n_0%vault-1][RaftGroupService] Stop the RaftGroupService successfully. 2023-05-08 20:17:51:648 +0300 [INFO][%idt_n_2%vault-0][NodeImpl] Node shutdown, currTerm=1 state=STATE_LEADER. 2023-05-08 20:17:51:648 +0300 [INFO][%idt_n_0%vault-1][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_2 2023-05-08 20:17:51:648 +0300 [INFO][%idt_n_2%vault-0][ReplicatorGroupImpl] Fail to find the next candidate. 2023-05-08 20:17:51:648 +0300 [INFO][%idt_n_2%JRaft-FSMCaller-Disruptor-_stripe_1-0][StateMachineAdapter] onLeaderStop: status=Status[ESHUTDOWN<1007>: Raft node is going to quit.]. 2023-05-08 20:17:51:649 +0300 [INFO][%idt_n_0%vault-1][NodeImpl] Node shutdown, currTerm=1 state=STATE_LEADER. 2023-05-08 20:17:51:670 +0300 [INFO][%idt_n_0%JRaft-FSMCaller-Disruptor-_stripe_2-0][StateMachineAdapter] onLeaderStop: status=Status[ESHUTDOWN<1007>: Raft node is going to quit.]. 2023-05-08 20:17:51:670 +0300 [INFO][%idt_n_0%vault-1][ReplicatorGroupImpl] Fail to find the next candidate. 2023-05-08 20:17:51:691 +0300 [INFO][%idt_n_1%vault-0][LocalRaftMetaStorage] Save raft meta, path=build/work/ItDmlTest/static_555993353560259/idt_n_1/f6b9512f-b735-446e-85a3-d6b8636c847c_part_6_idt_n_1_0/meta, term=1, votedFor=idt_n_1, cost time=45 ms 2023-05-08 20:17:51:692 +0300 [INFO][%idt_n_1%vault-0][FSMCallerImpl] Shutting down FSMCaller... 2023-05-08 20:17:51:693 +0300 [INFO][%idt_n_1%vault-0][RaftGroupService] Stop the RaftGroupService successfully. 2023-05-08 20:17:51:713 +0300 [INFO][%idt_n_1%vault-0][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_7 2023-05-08 20:17:51:713 +0300 [INFO][%idt_n_1%vault-0][NodeImpl] Node shutdown, currTerm=1 state=STATE_LEADER. 2023-05-08 20:17:51:734 +0300 [INFO][%idt_n_1%vault-0][ReplicatorGroupImpl] Fail to find the next candidate. 2023-05-08 20:17:51:734 +0300 [INFO][%idt_n_1%JRaft-FSMCaller-Disruptor-_stripe_0-0][StateMachineAdapter] onLeaderStop: status=Status[ESHUTDOWN<1007>: Raft node is going to quit.]. 2023-05-08 20:17:51:755 +0300 [INFO][%idt_n_2%vault-0][LocalRaftMetaStorage] Save raft meta, path=build/work/ItDmlTest/static_555993353560259/idt_n_2/f6b9512f-b735-446e-85a3-d6b8636c847c_part_9_idt_n_2_0/meta, term=1, votedFor=idt_n_2, cost time=85 ms 2023-05-08 20:17:51:756 +0300 [INFO][%idt_n_2%vault-0][FSMCallerImpl] Shutting down FSMCaller... 2023-05-08 20:17:51:757 +0300 [INFO][%idt_n_2%vault-0][RaftGroupService] Stop the RaftGroupService successfully. 2023-05-08 20:17:51:777 +0300 [INFO][%idt_n_0%vault-1][LocalRaftMetaStorage] Save raft meta, path=build/work/ItDmlTest/static_555993353560259/idt_n_0/f6b9512f-b735-446e-85a3-d6b8636c847c_part_2_idt_n_0_0/meta, term=1, votedFor=idt_n_0, cost time=107 ms 2023-05-08 20:17:51:777 +0300 [INFO][%idt_n_2%vault-0][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_10 2023-05-08 20:17:51:778 +0300 [INFO][%idt_n_0%vault-1][FSMCallerImpl] Shutting down FSMCaller... 2023-05-08 20:17:51:778 +0300 [INFO][%idt_n_2%vault-0][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_11 2023-05-08 20:17:51:779 +0300 [INFO][%idt_n_0%vault-1][RaftGroupService] Stop the RaftGroupService successfully. 2023-05-08 20:17:51:799 +0300 [INFO][%idt_n_2%vault-0][NodeImpl] Node shutdown, currTerm=1 state=STATE_LEADER. 2023-05-08 20:17:51:799 +0300 [INFO][%idt_n_0%vault-1][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_3 2023-05-08 20:17:51:799 +0300 [INFO][%idt_n_2%vault-0][ReplicatorGroupImpl] Fail to find the next candidate. 2023-05-08 20:17:51:799 +0300 [INFO][%idt_n_2%JRaft-FSMCaller-Disruptor-_stripe_0-0][StateMachineAdapter] onLeaderStop: status=Status[ESHUTDOWN<1007>: Raft node is going to quit.]. 2023-05-08 20:17:51:800 +0300 [INFO][%idt_n_0%vault-1][NodeImpl] Node shutdown, currTerm=1 state=STATE_LEADER. 2023-05-08 20:17:51:820 +0300 [INFO][%idt_n_1%vault-0][LocalRaftMetaStorage] Save raft meta, path=build/work/ItDmlTest/static_555993353560259/idt_n_1/f6b9512f-b735-446e-85a3-d6b8636c847c_part_7_idt_n_1_0/meta, term=1, votedFor=idt_n_1, cost time=86 ms 2023-05-08 20:17:51:821 +0300 [INFO][%idt_n_1%vault-0][FSMCallerImpl] Shutting down FSMCaller... 2023-05-08 20:17:51:821 +0300 [INFO][%idt_n_0%vault-1][ReplicatorGroupImpl] Fail to find the next candidate. 2023-05-08 20:17:51:821 +0300 [INFO][%idt_n_0%JRaft-FSMCaller-Disruptor-_stripe_1-0][StateMachineAdapter] onLeaderStop: status=Status[ESHUTDOWN<1007>: Raft node is going to quit.]. 2023-05-08 20:17:51:822 +0300 [INFO][%idt_n_1%vault-0][RaftGroupService] Stop the RaftGroupService successfully. 2023-05-08 20:17:51:842 +0300 [INFO][%idt_n_1%vault-0][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_8 2023-05-08 20:17:51:842 +0300 [INFO][%idt_n_1%vault-0][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_9 2023-05-08 20:17:51:842 +0300 [INFO][%idt_n_1%vault-0][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_10 2023-05-08 20:17:51:843 +0300 [INFO][%idt_n_1%vault-0][NodeImpl] Node shutdown, currTerm=1 state=STATE_LEADER. 2023-05-08 20:17:51:843 +0300 [INFO][%idt_n_1%vault-0][ReplicatorGroupImpl] Fail to find the next candidate. 2023-05-08 20:17:51:843 +0300 [INFO][%idt_n_1%JRaft-FSMCaller-Disruptor-_stripe_2-0][StateMachineAdapter] onLeaderStop: status=Status[ESHUTDOWN<1007>: Raft node is going to quit.]. 2023-05-08 20:17:51:880 +0300 [INFO][%idt_n_2%vault-0][LocalRaftMetaStorage] Save raft meta, path=build/work/ItDmlTest/static_555993353560259/idt_n_2/f6b9512f-b735-446e-85a3-d6b8636c847c_part_11_idt_n_2_0/meta, term=1, votedFor=idt_n_2, cost time=59 ms 2023-05-08 20:17:51:880 +0300 [INFO][%idt_n_2%vault-0][FSMCallerImpl] Shutting down FSMCaller... 2023-05-08 20:17:51:882 +0300 [INFO][%idt_n_2%vault-0][RaftGroupService] Stop the RaftGroupService successfully. 2023-05-08 20:17:51:902 +0300 [INFO][%idt_n_2%vault-0][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_12 2023-05-08 20:17:51:903 +0300 [INFO][%idt_n_2%vault-0][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_13 2023-05-08 20:17:51:903 +0300 [INFO][%idt_n_2%vault-0][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_14 2023-05-08 20:17:51:903 +0300 [INFO][%idt_n_2%vault-0][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_15 2023-05-08 20:17:51:904 +0300 [INFO][%idt_n_2%vault-0][NodeImpl] Node shutdown, currTerm=1 state=STATE_LEADER. 2023-05-08 20:17:51:924 +0300 [INFO][%idt_n_0%vault-1][LocalRaftMetaStorage] Save raft meta, path=build/work/ItDmlTest/static_555993353560259/idt_n_0/f6b9512f-b735-446e-85a3-d6b8636c847c_part_3_idt_n_0_0/meta, term=1, votedFor=idt_n_0, cost time=102 ms 2023-05-08 20:17:51:924 +0300 [INFO][%idt_n_2%vault-0][ReplicatorGroupImpl] Fail to find the next candidate. 2023-05-08 20:17:51:924 +0300 [INFO][%idt_n_2%JRaft-FSMCaller-Disruptor-_stripe_0-0][StateMachineAdapter] onLeaderStop: status=Status[ESHUTDOWN<1007>: Raft node is going to quit.]. 2023-05-08 20:17:51:925 +0300 [INFO][%idt_n_0%vault-1][FSMCallerImpl] Shutting down FSMCaller... 2023-05-08 20:17:51:928 +0300 [INFO][%idt_n_0%vault-1][RaftGroupService] Stop the RaftGroupService successfully. 2023-05-08 20:17:51:945 +0300 [INFO][%idt_n_1%vault-0][LocalRaftMetaStorage] Save raft meta, path=build/work/ItDmlTest/static_555993353560259/idt_n_1/f6b9512f-b735-446e-85a3-d6b8636c847c_part_10_idt_n_1_0/meta, term=1, votedFor=idt_n_1, cost time=102 ms 2023-05-08 20:17:51:945 +0300 [INFO][%idt_n_1%vault-0][FSMCallerImpl] Shutting down FSMCaller... 2023-05-08 20:17:51:945 +0300 [INFO][%idt_n_0%vault-1][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_4 2023-05-08 20:17:51:946 +0300 [INFO][%idt_n_0%vault-1][NodeImpl] Node shutdown, currTerm=1 state=STATE_LEADER. 2023-05-08 20:17:51:946 +0300 [INFO][%idt_n_1%vault-0][RaftGroupService] Stop the RaftGroupService successfully. 2023-05-08 20:17:51:946 +0300 [INFO][%idt_n_0%vault-1][ReplicatorGroupImpl] Fail to find the next candidate. 2023-05-08 20:17:51:946 +0300 [INFO][%idt_n_1%vault-0][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_11 2023-05-08 20:17:51:946 +0300 [INFO][%idt_n_0%JRaft-FSMCaller-Disruptor-_stripe_0-0][StateMachineAdapter] onLeaderStop: status=Status[ESHUTDOWN<1007>: Raft node is going to quit.]. 2023-05-08 20:17:51:947 +0300 [INFO][%idt_n_1%vault-0][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_12 2023-05-08 20:17:51:968 +0300 [INFO][%idt_n_1%vault-0][NodeImpl] Node shutdown, currTerm=1 state=STATE_LEADER. 2023-05-08 20:17:51:968 +0300 [INFO][%idt_n_1%JRaft-FSMCaller-Disruptor-_stripe_0-0][StateMachineAdapter] onLeaderStop: status=Status[ESHUTDOWN<1007>: Raft node is going to quit.]. 2023-05-08 20:17:51:968 +0300 [INFO][%idt_n_1%vault-0][ReplicatorGroupImpl] Fail to find the next candidate. 2023-05-08 20:17:52:011 +0300 [INFO][%idt_n_2%vault-0][LocalRaftMetaStorage] Save raft meta, path=build/work/ItDmlTest/static_555993353560259/idt_n_2/f6b9512f-b735-446e-85a3-d6b8636c847c_part_15_idt_n_2_0/meta, term=1, votedFor=idt_n_2, cost time=86 ms 2023-05-08 20:17:52:011 +0300 [INFO][%idt_n_2%vault-0][FSMCallerImpl] Shutting down FSMCaller... 2023-05-08 20:17:52:012 +0300 [INFO][%idt_n_2%vault-0][RaftGroupService] Stop the RaftGroupService successfully. 2023-05-08 20:17:52:048 +0300 [INFO][%idt_n_0%vault-1][LocalRaftMetaStorage] Save raft meta, path=build/work/ItDmlTest/static_555993353560259/idt_n_0/f6b9512f-b735-446e-85a3-d6b8636c847c_part_4_idt_n_0_0/meta, term=1, votedFor=idt_n_0, cost time=101 ms 2023-05-08 20:17:52:048 +0300 [INFO][%idt_n_2%vault-0][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_16 2023-05-08 20:17:52:049 +0300 [INFO][%idt_n_0%vault-1][FSMCallerImpl] Shutting down FSMCaller... 2023-05-08 20:17:52:049 +0300 [INFO][%idt_n_2%vault-0][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_17 2023-05-08 20:17:52:050 +0300 [INFO][%idt_n_2%vault-0][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_18 2023-05-08 20:17:52:050 +0300 [INFO][%idt_n_0%vault-1][RaftGroupService] Stop the RaftGroupService successfully. 2023-05-08 20:17:52:071 +0300 [INFO][%idt_n_2%vault-0][NodeImpl] Node shutdown, currTerm=1 state=STATE_LEADER. 2023-05-08 20:17:52:071 +0300 [INFO][%idt_n_0%vault-1][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_5 2023-05-08 20:17:52:071 +0300 [INFO][%idt_n_2%vault-0][ReplicatorGroupImpl] Fail to find the next candidate. 2023-05-08 20:17:52:071 +0300 [INFO][%idt_n_0%vault-1][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_6 2023-05-08 20:17:52:071 +0300 [INFO][%idt_n_2%JRaft-FSMCaller-Disruptor-_stripe_1-0][StateMachineAdapter] onLeaderStop: status=Status[ESHUTDOWN<1007>: Raft node is going to quit.]. 2023-05-08 20:17:52:071 +0300 [INFO][%idt_n_0%vault-1][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_7 2023-05-08 20:17:52:092 +0300 [INFO][%idt_n_1%vault-0][LocalRaftMetaStorage] Save raft meta, path=build/work/ItDmlTest/static_555993353560259/idt_n_1/f6b9512f-b735-446e-85a3-d6b8636c847c_part_12_idt_n_1_0/meta, term=1, votedFor=idt_n_1, cost time=102 ms 2023-05-08 20:17:52:092 +0300 [INFO][%idt_n_0%vault-1][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_8 2023-05-08 20:17:52:093 +0300 [INFO][%idt_n_1%vault-0][FSMCallerImpl] Shutting down FSMCaller... 2023-05-08 20:17:52:093 +0300 [INFO][%idt_n_0%vault-1][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_9 2023-05-08 20:17:52:093 +0300 [INFO][%idt_n_0%vault-1][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_10 2023-05-08 20:17:52:093 +0300 [INFO][%idt_n_1%vault-0][RaftGroupService] Stop the RaftGroupService successfully. 2023-05-08 20:17:52:093 +0300 [INFO][%idt_n_0%vault-1][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_11 2023-05-08 20:17:52:093 +0300 [INFO][%idt_n_1%vault-0][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_13 2023-05-08 20:17:52:094 +0300 [INFO][%idt_n_0%vault-1][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_12 2023-05-08 20:17:52:094 +0300 [INFO][%idt_n_1%vault-0][NodeImpl] Node shutdown, currTerm=1 state=STATE_LEADER. 2023-05-08 20:17:52:114 +0300 [INFO][%idt_n_0%vault-1][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_13 2023-05-08 20:17:52:115 +0300 [INFO][%idt_n_1%vault-0][ReplicatorGroupImpl] Fail to find the next candidate. 2023-05-08 20:17:52:115 +0300 [INFO][%idt_n_0%vault-1][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_14 2023-05-08 20:17:52:115 +0300 [INFO][%idt_n_1%JRaft-FSMCaller-Disruptor-_stripe_3-0][StateMachineAdapter] onLeaderStop: status=Status[ESHUTDOWN<1007>: Raft node is going to quit.]. 2023-05-08 20:17:52:115 +0300 [INFO][%idt_n_0%vault-1][NodeImpl] Node shutdown, currTerm=1 state=STATE_LEADER. 2023-05-08 20:17:52:135 +0300 [INFO][%idt_n_0%vault-1][ReplicatorGroupImpl] Fail to find the next candidate. 2023-05-08 20:17:52:136 +0300 [INFO][%idt_n_0%JRaft-FSMCaller-Disruptor-_stripe_3-0][StateMachineAdapter] onLeaderStop: status=Status[ESHUTDOWN<1007>: Raft node is going to quit.]. 2023-05-08 20:17:52:158 +0300 [INFO][%idt_n_2%vault-0][LocalRaftMetaStorage] Save raft meta, path=build/work/ItDmlTest/static_555993353560259/idt_n_2/f6b9512f-b735-446e-85a3-d6b8636c847c_part_18_idt_n_2_0/meta, term=1, votedFor=idt_n_2, cost time=87 ms 2023-05-08 20:17:52:158 +0300 [INFO][%idt_n_2%vault-0][FSMCallerImpl] Shutting down FSMCaller... 2023-05-08 20:17:52:159 +0300 [INFO][%idt_n_2%vault-0][RaftGroupService] Stop the RaftGroupService successfully. 2023-05-08 20:17:52:179 +0300 [INFO][%idt_n_2%vault-0][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_19 2023-05-08 20:17:52:179 +0300 [INFO][%idt_n_2%vault-0][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_20 2023-05-08 20:17:52:179 +0300 [INFO][%idt_n_2%vault-0][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_21 2023-05-08 20:17:52:179 +0300 [INFO][%idt_n_2%vault-0][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_22 2023-05-08 20:17:52:179 +0300 [INFO][%idt_n_2%vault-0][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_23 2023-05-08 20:17:52:201 +0300 [INFO][%idt_n_2%vault-0][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_24 2023-05-08 20:17:52:231 +0300 [INFO][%idt_n_2%vault-0][ConfigurationRegistry] Failed to notify configuration listener java.util.concurrent.CompletionException: org.apache.ignite.internal.storage.StorageException: IGN-STORAGE-1 TraceId:0c7cb209-b207-4db8-9c2a-1361579c63cb Error removing row version from version chain on garbage collection: [rowId=RowId [partitionId=8, uuid=9e13e0f0-e3d7-4389-a333-4d89e82344f5], rowTimestamp=HybridTimestamp [time=110334012513058818], table=T, partitionId=8] at java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:314) at java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:319) at java.base/java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:645) at java.base/java.util.concurrent.CompletableFuture$Completion.run(CompletableFuture.java:478) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base/java.lang.Thread.run(Thread.java:834) Caused by: org.apache.ignite.internal.storage.StorageException: IGN-STORAGE-1 TraceId:0c7cb209-b207-4db8-9c2a-1361579c63cb Error removing row version from version chain on garbage collection: [rowId=RowId [partitionId=8, uuid=9e13e0f0-e3d7-4389-a333-4d89e82344f5], rowTimestamp=HybridTimestamp [time=110334012513058818], table=T, partitionId=8] at org.apache.ignite.internal.storage.pagememory.mv.AbstractPageMemoryMvPartitionStorage.removeWriteOnGc(AbstractPageMemoryMvPartitionStorage.java:968) at org.apache.ignite.internal.storage.pagememory.mv.AbstractPageMemoryMvPartitionStorage.vacuum(AbstractPageMemoryMvPartitionStorage.java:952) at org.apache.ignite.internal.storage.MvPartitionStorage.lambda$pollForVacuum$0(MvPartitionStorage.java:292) at org.apache.ignite.internal.storage.pagememory.mv.PersistentPageMemoryMvPartitionStorage.runConsistently(PersistentPageMemoryMvPartitionStorage.java:143) at org.apache.ignite.internal.storage.MvPartitionStorage.pollForVacuum(MvPartitionStorage.java:282) at org.apache.ignite.internal.table.distributed.raft.snapshot.outgoing.SnapshotAwarePartitionDataStorage.pollForVacuum(SnapshotAwarePartitionDataStorage.java:141) at org.apache.ignite.internal.table.distributed.StorageUpdateHandler.internalVacuum(StorageUpdateHandler.java:345) at org.apache.ignite.internal.table.distributed.StorageUpdateHandler.lambda$vacuum$3(StorageUpdateHandler.java:320) at org.apache.ignite.internal.storage.pagememory.mv.PersistentPageMemoryMvPartitionStorage.lambda$runConsistently$0(PersistentPageMemoryMvPartitionStorage.java:155) at org.apache.ignite.internal.storage.pagememory.mv.AbstractPageMemoryMvPartitionStorage.busy(AbstractPageMemoryMvPartitionStorage.java:774) at org.apache.ignite.internal.storage.pagememory.mv.PersistentPageMemoryMvPartitionStorage.runConsistently(PersistentPageMemoryMvPartitionStorage.java:145) at org.apache.ignite.internal.table.distributed.raft.snapshot.outgoing.SnapshotAwarePartitionDataStorage.runConsistently(SnapshotAwarePartitionDataStorage.java:66) at org.apache.ignite.internal.table.distributed.StorageUpdateHandler.vacuum(StorageUpdateHandler.java:320) at org.apache.ignite.internal.table.distributed.gc.MvGc.lambda$scheduleGcForStorage$7(MvGc.java:251) at java.base/java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:642) ... 4 more Caused by: org.apache.ignite.internal.pagememory.tree.CorruptedTreeException: IGN-CMN-65535 TraceId:14461f24-5c2d-48cf-bf9f-a631fa740ac2 B+Tree is corrupted [groupId=1, pageIds=[562984313159684], groupName=T, msg=Runtime failure on search row: org.apache.ignite.internal.storage.pagememory.mv.VersionChainKey@56d63e2e] at org.apache.ignite.internal.pagememory.tree.BplusTree.corruptedTreeException(BplusTree.java:6724) at org.apache.ignite.internal.pagememory.tree.BplusTree.invoke(BplusTree.java:2135) at org.apache.ignite.internal.storage.pagememory.mv.AbstractPageMemoryMvPartitionStorage.removeWriteOnGc(AbstractPageMemoryMvPartitionStorage.java:961) ... 18 more Caused by: java.lang.AssertionError: rowId=RowId [partitionId=8, uuid=9e13e0f0-e3d7-4389-a333-4d89e82344f5], storage=table=T, partitionId=8 at org.apache.ignite.internal.storage.pagememory.mv.RemoveWriteOnGcInvokeClosure.call(RemoveWriteOnGcInvokeClosure.java:70) at org.apache.ignite.internal.storage.pagememory.mv.RemoveWriteOnGcInvokeClosure.call(RemoveWriteOnGcInvokeClosure.java:42) at org.apache.ignite.internal.pagememory.tree.BplusTree$Invoke.invokeClosure(BplusTree.java:4298) at org.apache.ignite.internal.pagememory.tree.BplusTree.invokeDown(BplusTree.java:2209) at org.apache.ignite.internal.pagememory.tree.BplusTree.invokeDown(BplusTree.java:2191) at org.apache.ignite.internal.pagememory.tree.BplusTree.invoke(BplusTree.java:2109) ... 19 more 2023-05-08 20:17:52:242 +0300 [INFO][%idt_n_2%vault-0][ConfigurationRegistry] Failed to notify configuration listener java.util.concurrent.CompletionException: org.apache.ignite.internal.storage.StorageException: IGN-STORAGE-1 TraceId:0c7cb209-b207-4db8-9c2a-1361579c63cb Error removing row version from version chain on garbage collection: [rowId=RowId [partitionId=8, uuid=9e13e0f0-e3d7-4389-a333-4d89e82344f5], rowTimestamp=HybridTimestamp [time=110334012513058818], table=T, partitionId=8] at java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:314) at java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:319) at java.base/java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:645) at java.base/java.util.concurrent.CompletableFuture$Completion.run(CompletableFuture.java:478) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base/java.lang.Thread.run(Thread.java:834) Caused by: org.apache.ignite.internal.storage.StorageException: IGN-STORAGE-1 TraceId:0c7cb209-b207-4db8-9c2a-1361579c63cb Error removing row version from version chain on garbage collection: [rowId=RowId [partitionId=8, uuid=9e13e0f0-e3d7-4389-a333-4d89e82344f5], rowTimestamp=HybridTimestamp [time=110334012513058818], table=T, partitionId=8] at org.apache.ignite.internal.storage.pagememory.mv.AbstractPageMemoryMvPartitionStorage.removeWriteOnGc(AbstractPageMemoryMvPartitionStorage.java:968) at org.apache.ignite.internal.storage.pagememory.mv.AbstractPageMemoryMvPartitionStorage.vacuum(AbstractPageMemoryMvPartitionStorage.java:952) at org.apache.ignite.internal.storage.MvPartitionStorage.lambda$pollForVacuum$0(MvPartitionStorage.java:292) at org.apache.ignite.internal.storage.pagememory.mv.PersistentPageMemoryMvPartitionStorage.runConsistently(PersistentPageMemoryMvPartitionStorage.java:143) at org.apache.ignite.internal.storage.MvPartitionStorage.pollForVacuum(MvPartitionStorage.java:282) at org.apache.ignite.internal.table.distributed.raft.snapshot.outgoing.SnapshotAwarePartitionDataStorage.pollForVacuum(SnapshotAwarePartitionDataStorage.java:141) at org.apache.ignite.internal.table.distributed.StorageUpdateHandler.internalVacuum(StorageUpdateHandler.java:345) at org.apache.ignite.internal.table.distributed.StorageUpdateHandler.lambda$vacuum$3(StorageUpdateHandler.java:320) at org.apache.ignite.internal.storage.pagememory.mv.PersistentPageMemoryMvPartitionStorage.lambda$runConsistently$0(PersistentPageMemoryMvPartitionStorage.java:155) at org.apache.ignite.internal.storage.pagememory.mv.AbstractPageMemoryMvPartitionStorage.busy(AbstractPageMemoryMvPartitionStorage.java:774) at org.apache.ignite.internal.storage.pagememory.mv.PersistentPageMemoryMvPartitionStorage.runConsistently(PersistentPageMemoryMvPartitionStorage.java:145) at org.apache.ignite.internal.table.distributed.raft.snapshot.outgoing.SnapshotAwarePartitionDataStorage.runConsistently(SnapshotAwarePartitionDataStorage.java:66) at org.apache.ignite.internal.table.distributed.StorageUpdateHandler.vacuum(StorageUpdateHandler.java:320) at org.apache.ignite.internal.table.distributed.gc.MvGc.lambda$scheduleGcForStorage$7(MvGc.java:251) at java.base/java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:642) ... 4 more Caused by: org.apache.ignite.internal.pagememory.tree.CorruptedTreeException: IGN-CMN-65535 TraceId:14461f24-5c2d-48cf-bf9f-a631fa740ac2 B+Tree is corrupted [groupId=1, pageIds=[562984313159684], groupName=T, msg=Runtime failure on search row: org.apache.ignite.internal.storage.pagememory.mv.VersionChainKey@56d63e2e] at org.apache.ignite.internal.pagememory.tree.BplusTree.corruptedTreeException(BplusTree.java:6724) at org.apache.ignite.internal.pagememory.tree.BplusTree.invoke(BplusTree.java:2135) at org.apache.ignite.internal.storage.pagememory.mv.AbstractPageMemoryMvPartitionStorage.removeWriteOnGc(AbstractPageMemoryMvPartitionStorage.java:961) ... 18 more Caused by: java.lang.AssertionError: rowId=RowId [partitionId=8, uuid=9e13e0f0-e3d7-4389-a333-4d89e82344f5], storage=table=T, partitionId=8 at org.apache.ignite.internal.storage.pagememory.mv.RemoveWriteOnGcInvokeClosure.call(RemoveWriteOnGcInvokeClosure.java:70) at org.apache.ignite.internal.storage.pagememory.mv.RemoveWriteOnGcInvokeClosure.call(RemoveWriteOnGcInvokeClosure.java:42) at org.apache.ignite.internal.pagememory.tree.BplusTree$Invoke.invokeClosure(BplusTree.java:4298) at org.apache.ignite.internal.pagememory.tree.BplusTree.invokeDown(BplusTree.java:2209) at org.apache.ignite.internal.pagememory.tree.BplusTree.invokeDown(BplusTree.java:2191) at org.apache.ignite.internal.pagememory.tree.BplusTree.invoke(BplusTree.java:2109) ... 19 more 2023-05-08 20:17:52:242 +0300 [INFO][%idt_n_1%vault-0][LocalRaftMetaStorage] Save raft meta, path=build/work/ItDmlTest/static_555993353560259/idt_n_1/f6b9512f-b735-446e-85a3-d6b8636c847c_part_13_idt_n_1_0/meta, term=1, votedFor=idt_n_1, cost time=127 ms 2023-05-08 20:17:52:243 +0300 [ERROR][%idt_n_2%vault-0][WatchProcessor] Error occurred when processing a watch event org.apache.ignite.internal.storage.StorageException: IGN-STORAGE-1 TraceId:0c7cb209-b207-4db8-9c2a-1361579c63cb Error removing row version from version chain on garbage collection: [rowId=RowId [partitionId=8, uuid=9e13e0f0-e3d7-4389-a333-4d89e82344f5], rowTimestamp=HybridTimestamp [time=110334012513058818], table=T, partitionId=8] at org.apache.ignite.internal.storage.pagememory.mv.AbstractPageMemoryMvPartitionStorage.removeWriteOnGc(AbstractPageMemoryMvPartitionStorage.java:968) at org.apache.ignite.internal.storage.pagememory.mv.AbstractPageMemoryMvPartitionStorage.vacuum(AbstractPageMemoryMvPartitionStorage.java:952) at org.apache.ignite.internal.storage.MvPartitionStorage.lambda$pollForVacuum$0(MvPartitionStorage.java:292) at org.apache.ignite.internal.storage.pagememory.mv.PersistentPageMemoryMvPartitionStorage.runConsistently(PersistentPageMemoryMvPartitionStorage.java:143) at org.apache.ignite.internal.storage.MvPartitionStorage.pollForVacuum(MvPartitionStorage.java:282) at org.apache.ignite.internal.table.distributed.raft.snapshot.outgoing.SnapshotAwarePartitionDataStorage.pollForVacuum(SnapshotAwarePartitionDataStorage.java:141) at org.apache.ignite.internal.table.distributed.StorageUpdateHandler.internalVacuum(StorageUpdateHandler.java:345) at org.apache.ignite.internal.table.distributed.StorageUpdateHandler.lambda$vacuum$3(StorageUpdateHandler.java:320) at org.apache.ignite.internal.storage.pagememory.mv.PersistentPageMemoryMvPartitionStorage.lambda$runConsistently$0(PersistentPageMemoryMvPartitionStorage.java:155) at org.apache.ignite.internal.storage.pagememory.mv.AbstractPageMemoryMvPartitionStorage.busy(AbstractPageMemoryMvPartitionStorage.java:774) at org.apache.ignite.internal.storage.pagememory.mv.PersistentPageMemoryMvPartitionStorage.runConsistently(PersistentPageMemoryMvPartitionStorage.java:145) at org.apache.ignite.internal.table.distributed.raft.snapshot.outgoing.SnapshotAwarePartitionDataStorage.runConsistently(SnapshotAwarePartitionDataStorage.java:66) at org.apache.ignite.internal.table.distributed.StorageUpdateHandler.vacuum(StorageUpdateHandler.java:320) at org.apache.ignite.internal.table.distributed.gc.MvGc.lambda$scheduleGcForStorage$7(MvGc.java:251) at java.base/java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:642) at java.base/java.util.concurrent.CompletableFuture$Completion.run(CompletableFuture.java:478) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base/java.lang.Thread.run(Thread.java:834) Caused by: org.apache.ignite.internal.pagememory.tree.CorruptedTreeException: IGN-CMN-65535 TraceId:14461f24-5c2d-48cf-bf9f-a631fa740ac2 B+Tree is corrupted [groupId=1, pageIds=[562984313159684], groupName=T, msg=Runtime failure on search row: org.apache.ignite.internal.storage.pagememory.mv.VersionChainKey@56d63e2e] at org.apache.ignite.internal.pagememory.tree.BplusTree.corruptedTreeException(BplusTree.java:6724) at org.apache.ignite.internal.pagememory.tree.BplusTree.invoke(BplusTree.java:2135) at org.apache.ignite.internal.storage.pagememory.mv.AbstractPageMemoryMvPartitionStorage.removeWriteOnGc(AbstractPageMemoryMvPartitionStorage.java:961) ... 18 more Caused by: java.lang.AssertionError: rowId=RowId [partitionId=8, uuid=9e13e0f0-e3d7-4389-a333-4d89e82344f5], storage=table=T, partitionId=8 at org.apache.ignite.internal.storage.pagememory.mv.RemoveWriteOnGcInvokeClosure.call(RemoveWriteOnGcInvokeClosure.java:70) at org.apache.ignite.internal.storage.pagememory.mv.RemoveWriteOnGcInvokeClosure.call(RemoveWriteOnGcInvokeClosure.java:42) at org.apache.ignite.internal.pagememory.tree.BplusTree$Invoke.invokeClosure(BplusTree.java:4298) at org.apache.ignite.internal.pagememory.tree.BplusTree.invokeDown(BplusTree.java:2209) at org.apache.ignite.internal.pagememory.tree.BplusTree.invokeDown(BplusTree.java:2191) at org.apache.ignite.internal.pagememory.tree.BplusTree.invoke(BplusTree.java:2109) ... 19 more 2023-05-08 20:17:52:243 +0300 [INFO][%idt_n_1%vault-0][FSMCallerImpl] Shutting down FSMCaller... 2023-05-08 20:17:52:266 +0300 [WARNING][%idt_n_2%vault-0][DistributedConfigurationStorage] Meta storage listener issue org.apache.ignite.internal.storage.StorageException: IGN-STORAGE-1 TraceId:0c7cb209-b207-4db8-9c2a-1361579c63cb Error removing row version from version chain on garbage collection: [rowId=RowId [partitionId=8, uuid=9e13e0f0-e3d7-4389-a333-4d89e82344f5], rowTimestamp=HybridTimestamp [time=110334012513058818], table=T, partitionId=8] at org.apache.ignite.internal.storage.pagememory.mv.AbstractPageMemoryMvPartitionStorage.removeWriteOnGc(AbstractPageMemoryMvPartitionStorage.java:968) at org.apache.ignite.internal.storage.pagememory.mv.AbstractPageMemoryMvPartitionStorage.vacuum(AbstractPageMemoryMvPartitionStorage.java:952) at org.apache.ignite.internal.storage.MvPartitionStorage.lambda$pollForVacuum$0(MvPartitionStorage.java:292) at org.apache.ignite.internal.storage.pagememory.mv.PersistentPageMemoryMvPartitionStorage.runConsistently(PersistentPageMemoryMvPartitionStorage.java:143) at org.apache.ignite.internal.storage.MvPartitionStorage.pollForVacuum(MvPartitionStorage.java:282) at org.apache.ignite.internal.table.distributed.raft.snapshot.outgoing.SnapshotAwarePartitionDataStorage.pollForVacuum(SnapshotAwarePartitionDataStorage.java:141) at org.apache.ignite.internal.table.distributed.StorageUpdateHandler.internalVacuum(StorageUpdateHandler.java:345) at org.apache.ignite.internal.table.distributed.StorageUpdateHandler.lambda$vacuum$3(StorageUpdateHandler.java:320) at org.apache.ignite.internal.storage.pagememory.mv.PersistentPageMemoryMvPartitionStorage.lambda$runConsistently$0(PersistentPageMemoryMvPartitionStorage.java:155) at org.apache.ignite.internal.storage.pagememory.mv.AbstractPageMemoryMvPartitionStorage.busy(AbstractPageMemoryMvPartitionStorage.java:774) at org.apache.ignite.internal.storage.pagememory.mv.PersistentPageMemoryMvPartitionStorage.runConsistently(PersistentPageMemoryMvPartitionStorage.java:145) at org.apache.ignite.internal.table.distributed.raft.snapshot.outgoing.SnapshotAwarePartitionDataStorage.runConsistently(SnapshotAwarePartitionDataStorage.java:66) at org.apache.ignite.internal.table.distributed.StorageUpdateHandler.vacuum(StorageUpdateHandler.java:320) at org.apache.ignite.internal.table.distributed.gc.MvGc.lambda$scheduleGcForStorage$7(MvGc.java:251) at java.base/java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:642) at java.base/java.util.concurrent.CompletableFuture$Completion.run(CompletableFuture.java:478) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base/java.lang.Thread.run(Thread.java:834) Caused by: org.apache.ignite.internal.pagememory.tree.CorruptedTreeException: IGN-CMN-65535 TraceId:14461f24-5c2d-48cf-bf9f-a631fa740ac2 B+Tree is corrupted [groupId=1, pageIds=[562984313159684], groupName=T, msg=Runtime failure on search row: org.apache.ignite.internal.storage.pagememory.mv.VersionChainKey@56d63e2e] at org.apache.ignite.internal.pagememory.tree.BplusTree.corruptedTreeException(BplusTree.java:6724) at org.apache.ignite.internal.pagememory.tree.BplusTree.invoke(BplusTree.java:2135) at org.apache.ignite.internal.storage.pagememory.mv.AbstractPageMemoryMvPartitionStorage.removeWriteOnGc(AbstractPageMemoryMvPartitionStorage.java:961) ... 18 more Caused by: java.lang.AssertionError: rowId=RowId [partitionId=8, uuid=9e13e0f0-e3d7-4389-a333-4d89e82344f5], storage=table=T, partitionId=8 at org.apache.ignite.internal.storage.pagememory.mv.RemoveWriteOnGcInvokeClosure.call(RemoveWriteOnGcInvokeClosure.java:70) at org.apache.ignite.internal.storage.pagememory.mv.RemoveWriteOnGcInvokeClosure.call(RemoveWriteOnGcInvokeClosure.java:42) at org.apache.ignite.internal.pagememory.tree.BplusTree$Invoke.invokeClosure(BplusTree.java:4298) at org.apache.ignite.internal.pagememory.tree.BplusTree.invokeDown(BplusTree.java:2209) at org.apache.ignite.internal.pagememory.tree.BplusTree.invokeDown(BplusTree.java:2191) at org.apache.ignite.internal.pagememory.tree.BplusTree.invoke(BplusTree.java:2109) ... 19 more 2023-05-08 20:17:52:288 +0300 [INFO][%idt_n_1%vault-0][RaftGroupService] Stop the RaftGroupService successfully. 2023-05-08 20:17:52:308 +0300 [INFO][%idt_n_0%vault-1][LocalRaftMetaStorage] Save raft meta, path=build/work/ItDmlTest/static_555993353560259/idt_n_0/f6b9512f-b735-446e-85a3-d6b8636c847c_part_14_idt_n_0_0/meta, term=1, votedFor=idt_n_0, cost time=151 ms 2023-05-08 20:17:52:309 +0300 [INFO][%idt_n_1%vault-0][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_14 2023-05-08 20:17:52:309 +0300 [INFO][%idt_n_0%vault-1][FSMCallerImpl] Shutting down FSMCaller... 2023-05-08 20:17:52:309 +0300 [INFO][%idt_n_1%vault-0][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_15 2023-05-08 20:17:52:309 +0300 [INFO][%idt_n_1%vault-0][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_16 2023-05-08 20:17:52:310 +0300 [INFO][%idt_n_1%vault-0][NodeImpl] Node shutdown, currTerm=1 state=STATE_LEADER. 2023-05-08 20:17:52:310 +0300 [INFO][%idt_n_0%vault-1][RaftGroupService] Stop the RaftGroupService successfully. 2023-05-08 20:17:52:310 +0300 [INFO][%idt_n_0%vault-1][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_15 2023-05-08 20:17:52:310 +0300 [INFO][%idt_n_1%vault-0][ReplicatorGroupImpl] Fail to find the next candidate. 2023-05-08 20:17:52:310 +0300 [INFO][%idt_n_0%vault-1][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_16 2023-05-08 20:17:52:310 +0300 [INFO][%idt_n_1%JRaft-FSMCaller-Disruptor-_stripe_0-0][StateMachineAdapter] onLeaderStop: status=Status[ESHUTDOWN<1007>: Raft node is going to quit.]. 2023-05-08 20:17:52:310 +0300 [INFO][%idt_n_0%vault-1][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_17 2023-05-08 20:17:52:311 +0300 [INFO][%idt_n_0%vault-1][NodeImpl] Node shutdown, currTerm=1 state=STATE_LEADER. 2023-05-08 20:17:52:311 +0300 [INFO][%idt_n_0%vault-1][ReplicatorGroupImpl] Fail to find the next candidate. 2023-05-08 20:17:52:311 +0300 [INFO][%idt_n_0%JRaft-FSMCaller-Disruptor-_stripe_0-0][StateMachineAdapter] onLeaderStop: status=Status[ESHUTDOWN<1007>: Raft node is going to quit.]. 2023-05-08 20:17:52:376 +0300 [INFO][%idt_n_1%vault-0][LocalRaftMetaStorage] Save raft meta, path=build/work/ItDmlTest/static_555993353560259/idt_n_1/f6b9512f-b735-446e-85a3-d6b8636c847c_part_16_idt_n_1_0/meta, term=1, votedFor=idt_n_1, cost time=66 ms 2023-05-08 20:17:52:376 +0300 [INFO][%idt_n_1%vault-0][FSMCallerImpl] Shutting down FSMCaller... 2023-05-08 20:17:52:377 +0300 [INFO][%idt_n_1%vault-0][RaftGroupService] Stop the RaftGroupService successfully. 2023-05-08 20:17:52:397 +0300 [INFO][%idt_n_0%vault-1][LocalRaftMetaStorage] Save raft meta, path=build/work/ItDmlTest/static_555993353560259/idt_n_0/f6b9512f-b735-446e-85a3-d6b8636c847c_part_17_idt_n_0_0/meta, term=1, votedFor=idt_n_0, cost time=86 ms 2023-05-08 20:17:52:397 +0300 [INFO][%idt_n_0%vault-1][FSMCallerImpl] Shutting down FSMCaller... 2023-05-08 20:17:52:397 +0300 [INFO][%idt_n_1%vault-0][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_17 2023-05-08 20:17:52:398 +0300 [INFO][%idt_n_1%vault-0][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_18 2023-05-08 20:17:52:398 +0300 [INFO][%idt_n_1%vault-0][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_19 2023-05-08 20:17:52:398 +0300 [INFO][%idt_n_1%vault-0][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_20 2023-05-08 20:17:52:398 +0300 [INFO][%idt_n_1%vault-0][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_21 2023-05-08 20:17:52:398 +0300 [INFO][%idt_n_0%vault-1][RaftGroupService] Stop the RaftGroupService successfully. 2023-05-08 20:17:52:402 +0300 [INFO][%idt_n_1%vault-0][NodeImpl] Node shutdown, currTerm=1 state=STATE_LEADER. 2023-05-08 20:17:52:402 +0300 [INFO][%idt_n_0%vault-1][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_18 2023-05-08 20:17:52:402 +0300 [INFO][%idt_n_0%vault-1][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_19 2023-05-08 20:17:52:402 +0300 [INFO][%idt_n_0%vault-1][NodeImpl] Node shutdown, currTerm=1 state=STATE_LEADER. 2023-05-08 20:17:52:402 +0300 [INFO][%idt_n_1%vault-0][ReplicatorGroupImpl] Fail to find the next candidate. 2023-05-08 20:17:52:402 +0300 [INFO][%idt_n_1%JRaft-FSMCaller-Disruptor-_stripe_2-0][StateMachineAdapter] onLeaderStop: status=Status[ESHUTDOWN<1007>: Raft node is going to quit.]. 2023-05-08 20:17:52:402 +0300 [INFO][%idt_n_0%vault-1][ReplicatorGroupImpl] Fail to find the next candidate. 2023-05-08 20:17:52:402 +0300 [INFO][%idt_n_0%JRaft-FSMCaller-Disruptor-_stripe_2-0][StateMachineAdapter] onLeaderStop: status=Status[ESHUTDOWN<1007>: Raft node is going to quit.]. 2023-05-08 20:17:52:445 +0300 [INFO][%idt_n_1%vault-0][LocalRaftMetaStorage] Save raft meta, path=build/work/ItDmlTest/static_555993353560259/idt_n_1/f6b9512f-b735-446e-85a3-d6b8636c847c_part_21_idt_n_1_0/meta, term=1, votedFor=idt_n_1, cost time=44 ms 2023-05-08 20:17:52:446 +0300 [INFO][%idt_n_1%vault-0][FSMCallerImpl] Shutting down FSMCaller... 2023-05-08 20:17:52:450 +0300 [INFO][%idt_n_1%vault-0][RaftGroupService] Stop the RaftGroupService successfully. 2023-05-08 20:17:52:467 +0300 [INFO][%idt_n_1%vault-0][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_22 2023-05-08 20:17:52:467 +0300 [INFO][%idt_n_1%vault-0][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_23 2023-05-08 20:17:52:467 +0300 [INFO][%idt_n_0%vault-1][LocalRaftMetaStorage] Save raft meta, path=build/work/ItDmlTest/static_555993353560259/idt_n_0/f6b9512f-b735-446e-85a3-d6b8636c847c_part_19_idt_n_0_0/meta, term=1, votedFor=idt_n_0, cost time=65 ms 2023-05-08 20:17:52:467 +0300 [INFO][%idt_n_1%vault-0][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_24 2023-05-08 20:17:52:467 +0300 [INFO][%idt_n_0%vault-1][FSMCallerImpl] Shutting down FSMCaller... 2023-05-08 20:17:52:468 +0300 [INFO][%idt_n_1%vault-0][NodeImpl] Node shutdown, currTerm=1 state=STATE_LEADER. 2023-05-08 20:17:52:468 +0300 [INFO][%idt_n_1%vault-0][ReplicatorGroupImpl] Fail to find the next candidate. 2023-05-08 20:17:52:468 +0300 [INFO][%idt_n_0%vault-1][RaftGroupService] Stop the RaftGroupService successfully. 2023-05-08 20:17:52:468 +0300 [INFO][%idt_n_1%JRaft-FSMCaller-Disruptor-_stripe_3-0][StateMachineAdapter] onLeaderStop: status=Status[ESHUTDOWN<1007>: Raft node is going to quit.]. 2023-05-08 20:17:52:468 +0300 [INFO][%idt_n_0%vault-1][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_20 2023-05-08 20:17:52:468 +0300 [INFO][%idt_n_0%vault-1][NodeImpl] Node shutdown, currTerm=1 state=STATE_LEADER. 2023-05-08 20:17:52:468 +0300 [INFO][%idt_n_0%vault-1][ReplicatorGroupImpl] Fail to find the next candidate. 2023-05-08 20:17:52:468 +0300 [INFO][%idt_n_0%JRaft-FSMCaller-Disruptor-_stripe_0-0][StateMachineAdapter] onLeaderStop: status=Status[ESHUTDOWN<1007>: Raft node is going to quit.]. 2023-05-08 20:17:52:533 +0300 [INFO][%idt_n_1%vault-0][LocalRaftMetaStorage] Save raft meta, path=build/work/ItDmlTest/static_555993353560259/idt_n_1/f6b9512f-b735-446e-85a3-d6b8636c847c_part_24_idt_n_1_0/meta, term=1, votedFor=idt_n_1, cost time=65 ms 2023-05-08 20:17:52:534 +0300 [INFO][%idt_n_1%vault-0][FSMCallerImpl] Shutting down FSMCaller... 2023-05-08 20:17:52:534 +0300 [INFO][%idt_n_1%vault-0][RaftGroupService] Stop the RaftGroupService successfully. 2023-05-08 20:17:52:554 +0300 [INFO][%idt_n_0%vault-1][LocalRaftMetaStorage] Save raft meta, path=build/work/ItDmlTest/static_555993353560259/idt_n_0/f6b9512f-b735-446e-85a3-d6b8636c847c_part_20_idt_n_0_0/meta, term=1, votedFor=idt_n_0, cost time=86 ms 2023-05-08 20:17:52:554 +0300 [INFO][%idt_n_0%vault-1][FSMCallerImpl] Shutting down FSMCaller... 2023-05-08 20:17:52:555 +0300 [INFO][%idt_n_0%vault-1][RaftGroupService] Stop the RaftGroupService successfully. 2023-05-08 20:17:52:555 +0300 [INFO][%idt_n_0%vault-1][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_21 2023-05-08 20:17:52:555 +0300 [INFO][%idt_n_0%vault-1][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_22 2023-05-08 20:17:52:555 +0300 [INFO][%idt_n_0%vault-1][NodeImpl] Node shutdown, currTerm=1 state=STATE_LEADER. 2023-05-08 20:17:52:555 +0300 [INFO][%idt_n_0%vault-1][ReplicatorGroupImpl] Fail to find the next candidate. 2023-05-08 20:17:52:555 +0300 [INFO][%idt_n_0%JRaft-FSMCaller-Disruptor-_stripe_2-0][StateMachineAdapter] onLeaderStop: status=Status[ESHUTDOWN<1007>: Raft node is going to quit.]. 2023-05-08 20:17:52:556 +0300 [INFO][%idt_n_1%vault-0][ConfigurationRegistry] Failed to notify configuration listener java.util.concurrent.CompletionException: java.lang.NullPointerException at java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:314) at java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:319) at java.base/java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:645) at java.base/java.util.concurrent.CompletableFuture$Completion.run(CompletableFuture.java:478) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base/java.lang.Thread.run(Thread.java:834) Caused by: java.lang.NullPointerException at org.apache.ignite.internal.configuration.DynamicProperty.value(DynamicProperty.java:93) at org.apache.ignite.internal.configuration.DynamicProperty.value(DynamicProperty.java:45) at org.apache.ignite.internal.storage.pagememory.AbstractPageMemoryTableStorage.getTableName(AbstractPageMemoryTableStorage.java:316) at org.apache.ignite.internal.storage.pagememory.mv.AbstractPageMemoryMvPartitionStorage.createStorageInfo(AbstractPageMemoryMvPartitionStorage.java:784) at org.apache.ignite.internal.storage.pagememory.mv.AbstractPageMemoryMvPartitionStorage.removeWriteOnGc(AbstractPageMemoryMvPartitionStorage.java:968) at org.apache.ignite.internal.storage.pagememory.mv.AbstractPageMemoryMvPartitionStorage.vacuum(AbstractPageMemoryMvPartitionStorage.java:952) at org.apache.ignite.internal.storage.MvPartitionStorage.lambda$pollForVacuum$0(MvPartitionStorage.java:292) at org.apache.ignite.internal.storage.pagememory.mv.PersistentPageMemoryMvPartitionStorage.runConsistently(PersistentPageMemoryMvPartitionStorage.java:143) at org.apache.ignite.internal.storage.MvPartitionStorage.pollForVacuum(MvPartitionStorage.java:282) at org.apache.ignite.internal.table.distributed.raft.snapshot.outgoing.SnapshotAwarePartitionDataStorage.pollForVacuum(SnapshotAwarePartitionDataStorage.java:141) at org.apache.ignite.internal.table.distributed.StorageUpdateHandler.internalVacuum(StorageUpdateHandler.java:345) at org.apache.ignite.internal.table.distributed.StorageUpdateHandler.lambda$vacuum$3(StorageUpdateHandler.java:320) at org.apache.ignite.internal.storage.pagememory.mv.PersistentPageMemoryMvPartitionStorage.lambda$runConsistently$0(PersistentPageMemoryMvPartitionStorage.java:155) at org.apache.ignite.internal.storage.pagememory.mv.AbstractPageMemoryMvPartitionStorage.busy(AbstractPageMemoryMvPartitionStorage.java:774) at org.apache.ignite.internal.storage.pagememory.mv.PersistentPageMemoryMvPartitionStorage.runConsistently(PersistentPageMemoryMvPartitionStorage.java:145) at org.apache.ignite.internal.table.distributed.raft.snapshot.outgoing.SnapshotAwarePartitionDataStorage.runConsistently(SnapshotAwarePartitionDataStorage.java:66) at org.apache.ignite.internal.table.distributed.StorageUpdateHandler.vacuum(StorageUpdateHandler.java:320) at org.apache.ignite.internal.table.distributed.gc.MvGc.lambda$scheduleGcForStorage$7(MvGc.java:251) at java.base/java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:642) ... 4 more 2023-05-08 20:17:52:576 +0300 [INFO][%idt_n_1%vault-0][ConfigurationRegistry] Failed to notify configuration listener java.util.concurrent.CompletionException: java.lang.NullPointerException at java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:314) at java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:319) at java.base/java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:645) at java.base/java.util.concurrent.CompletableFuture$Completion.run(CompletableFuture.java:478) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base/java.lang.Thread.run(Thread.java:834) Caused by: java.lang.NullPointerException at org.apache.ignite.internal.configuration.DynamicProperty.value(DynamicProperty.java:93) at org.apache.ignite.internal.configuration.DynamicProperty.value(DynamicProperty.java:45) at org.apache.ignite.internal.storage.pagememory.AbstractPageMemoryTableStorage.getTableName(AbstractPageMemoryTableStorage.java:316) at org.apache.ignite.internal.storage.pagememory.mv.AbstractPageMemoryMvPartitionStorage.createStorageInfo(AbstractPageMemoryMvPartitionStorage.java:784) at org.apache.ignite.internal.storage.pagememory.mv.AbstractPageMemoryMvPartitionStorage.removeWriteOnGc(AbstractPageMemoryMvPartitionStorage.java:968) at org.apache.ignite.internal.storage.pagememory.mv.AbstractPageMemoryMvPartitionStorage.vacuum(AbstractPageMemoryMvPartitionStorage.java:952) at org.apache.ignite.internal.storage.MvPartitionStorage.lambda$pollForVacuum$0(MvPartitionStorage.java:292) at org.apache.ignite.internal.storage.pagememory.mv.PersistentPageMemoryMvPartitionStorage.runConsistently(PersistentPageMemoryMvPartitionStorage.java:143) at org.apache.ignite.internal.storage.MvPartitionStorage.pollForVacuum(MvPartitionStorage.java:282) at org.apache.ignite.internal.table.distributed.raft.snapshot.outgoing.SnapshotAwarePartitionDataStorage.pollForVacuum(SnapshotAwarePartitionDataStorage.java:141) at org.apache.ignite.internal.table.distributed.StorageUpdateHandler.internalVacuum(StorageUpdateHandler.java:345) at org.apache.ignite.internal.table.distributed.StorageUpdateHandler.lambda$vacuum$3(StorageUpdateHandler.java:320) at org.apache.ignite.internal.storage.pagememory.mv.PersistentPageMemoryMvPartitionStorage.lambda$runConsistently$0(PersistentPageMemoryMvPartitionStorage.java:155) at org.apache.ignite.internal.storage.pagememory.mv.AbstractPageMemoryMvPartitionStorage.busy(AbstractPageMemoryMvPartitionStorage.java:774) at org.apache.ignite.internal.storage.pagememory.mv.PersistentPageMemoryMvPartitionStorage.runConsistently(PersistentPageMemoryMvPartitionStorage.java:145) at org.apache.ignite.internal.table.distributed.raft.snapshot.outgoing.SnapshotAwarePartitionDataStorage.runConsistently(SnapshotAwarePartitionDataStorage.java:66) at org.apache.ignite.internal.table.distributed.StorageUpdateHandler.vacuum(StorageUpdateHandler.java:320) at org.apache.ignite.internal.table.distributed.gc.MvGc.lambda$scheduleGcForStorage$7(MvGc.java:251) at java.base/java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:642) ... 4 more 2023-05-08 20:17:52:577 +0300 [ERROR][%idt_n_1%vault-0][WatchProcessor] Error occurred when processing a watch event java.lang.NullPointerException at org.apache.ignite.internal.configuration.DynamicProperty.value(DynamicProperty.java:93) at org.apache.ignite.internal.configuration.DynamicProperty.value(DynamicProperty.java:45) at org.apache.ignite.internal.storage.pagememory.AbstractPageMemoryTableStorage.getTableName(AbstractPageMemoryTableStorage.java:316) at org.apache.ignite.internal.storage.pagememory.mv.AbstractPageMemoryMvPartitionStorage.createStorageInfo(AbstractPageMemoryMvPartitionStorage.java:784) at org.apache.ignite.internal.storage.pagememory.mv.AbstractPageMemoryMvPartitionStorage.removeWriteOnGc(AbstractPageMemoryMvPartitionStorage.java:968) at org.apache.ignite.internal.storage.pagememory.mv.AbstractPageMemoryMvPartitionStorage.vacuum(AbstractPageMemoryMvPartitionStorage.java:952) at org.apache.ignite.internal.storage.MvPartitionStorage.lambda$pollForVacuum$0(MvPartitionStorage.java:292) at org.apache.ignite.internal.storage.pagememory.mv.PersistentPageMemoryMvPartitionStorage.runConsistently(PersistentPageMemoryMvPartitionStorage.java:143) at org.apache.ignite.internal.storage.MvPartitionStorage.pollForVacuum(MvPartitionStorage.java:282) at org.apache.ignite.internal.table.distributed.raft.snapshot.outgoing.SnapshotAwarePartitionDataStorage.pollForVacuum(SnapshotAwarePartitionDataStorage.java:141) at org.apache.ignite.internal.table.distributed.StorageUpdateHandler.internalVacuum(StorageUpdateHandler.java:345) at org.apache.ignite.internal.table.distributed.StorageUpdateHandler.lambda$vacuum$3(StorageUpdateHandler.java:320) at org.apache.ignite.internal.storage.pagememory.mv.PersistentPageMemoryMvPartitionStorage.lambda$runConsistently$0(PersistentPageMemoryMvPartitionStorage.java:155) at org.apache.ignite.internal.storage.pagememory.mv.AbstractPageMemoryMvPartitionStorage.busy(AbstractPageMemoryMvPartitionStorage.java:774) at org.apache.ignite.internal.storage.pagememory.mv.PersistentPageMemoryMvPartitionStorage.runConsistently(PersistentPageMemoryMvPartitionStorage.java:145) at org.apache.ignite.internal.table.distributed.raft.snapshot.outgoing.SnapshotAwarePartitionDataStorage.runConsistently(SnapshotAwarePartitionDataStorage.java:66) at org.apache.ignite.internal.table.distributed.StorageUpdateHandler.vacuum(StorageUpdateHandler.java:320) at org.apache.ignite.internal.table.distributed.gc.MvGc.lambda$scheduleGcForStorage$7(MvGc.java:251) at java.base/java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:642) at java.base/java.util.concurrent.CompletableFuture$Completion.run(CompletableFuture.java:478) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base/java.lang.Thread.run(Thread.java:834) 2023-05-08 20:17:52:577 +0300 [WARNING][%idt_n_1%vault-0][DistributedConfigurationStorage] Meta storage listener issue java.lang.NullPointerException at org.apache.ignite.internal.configuration.DynamicProperty.value(DynamicProperty.java:93) at org.apache.ignite.internal.configuration.DynamicProperty.value(DynamicProperty.java:45) at org.apache.ignite.internal.storage.pagememory.AbstractPageMemoryTableStorage.getTableName(AbstractPageMemoryTableStorage.java:316) at org.apache.ignite.internal.storage.pagememory.mv.AbstractPageMemoryMvPartitionStorage.createStorageInfo(AbstractPageMemoryMvPartitionStorage.java:784) at org.apache.ignite.internal.storage.pagememory.mv.AbstractPageMemoryMvPartitionStorage.removeWriteOnGc(AbstractPageMemoryMvPartitionStorage.java:968) at org.apache.ignite.internal.storage.pagememory.mv.AbstractPageMemoryMvPartitionStorage.vacuum(AbstractPageMemoryMvPartitionStorage.java:952) at org.apache.ignite.internal.storage.MvPartitionStorage.lambda$pollForVacuum$0(MvPartitionStorage.java:292) at org.apache.ignite.internal.storage.pagememory.mv.PersistentPageMemoryMvPartitionStorage.runConsistently(PersistentPageMemoryMvPartitionStorage.java:143) at org.apache.ignite.internal.storage.MvPartitionStorage.pollForVacuum(MvPartitionStorage.java:282) at org.apache.ignite.internal.table.distributed.raft.snapshot.outgoing.SnapshotAwarePartitionDataStorage.pollForVacuum(SnapshotAwarePartitionDataStorage.java:141) at org.apache.ignite.internal.table.distributed.StorageUpdateHandler.internalVacuum(StorageUpdateHandler.java:345) at org.apache.ignite.internal.table.distributed.StorageUpdateHandler.lambda$vacuum$3(StorageUpdateHandler.java:320) at org.apache.ignite.internal.storage.pagememory.mv.PersistentPageMemoryMvPartitionStorage.lambda$runConsistently$0(PersistentPageMemoryMvPartitionStorage.java:155) at org.apache.ignite.internal.storage.pagememory.mv.AbstractPageMemoryMvPartitionStorage.busy(AbstractPageMemoryMvPartitionStorage.java:774) at org.apache.ignite.internal.storage.pagememory.mv.PersistentPageMemoryMvPartitionStorage.runConsistently(PersistentPageMemoryMvPartitionStorage.java:145) at org.apache.ignite.internal.table.distributed.raft.snapshot.outgoing.SnapshotAwarePartitionDataStorage.runConsistently(SnapshotAwarePartitionDataStorage.java:66) at org.apache.ignite.internal.table.distributed.StorageUpdateHandler.vacuum(StorageUpdateHandler.java:320) at org.apache.ignite.internal.table.distributed.gc.MvGc.lambda$scheduleGcForStorage$7(MvGc.java:251) at java.base/java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:642) at java.base/java.util.concurrent.CompletableFuture$Completion.run(CompletableFuture.java:478) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base/java.lang.Thread.run(Thread.java:834) 2023-05-08 20:17:52:598 +0300 [INFO][%idt_n_0%vault-1][LocalRaftMetaStorage] Save raft meta, path=build/work/ItDmlTest/static_555993353560259/idt_n_0/f6b9512f-b735-446e-85a3-d6b8636c847c_part_22_idt_n_0_0/meta, term=1, votedFor=idt_n_0, cost time=43 ms 2023-05-08 20:17:52:598 +0300 [INFO][%idt_n_0%vault-1][FSMCallerImpl] Shutting down FSMCaller... 2023-05-08 20:17:52:599 +0300 [INFO][%idt_n_0%vault-1][RaftGroupService] Stop the RaftGroupService successfully. 2023-05-08 20:17:52:599 +0300 [INFO][%idt_n_0%vault-1][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_23 2023-05-08 20:17:52:599 +0300 [INFO][%idt_n_0%vault-1][NodeImpl] Node shutdown, currTerm=1 state=STATE_LEADER. 2023-05-08 20:17:52:599 +0300 [INFO][%idt_n_0%vault-1][ReplicatorGroupImpl] Fail to find the next candidate. 2023-05-08 20:17:52:599 +0300 [INFO][%idt_n_0%JRaft-FSMCaller-Disruptor-_stripe_1-0][StateMachineAdapter] onLeaderStop: status=Status[ESHUTDOWN<1007>: Raft node is going to quit.]. 2023-05-08 20:17:52:642 +0300 [INFO][%idt_n_0%vault-1][LocalRaftMetaStorage] Save raft meta, path=build/work/ItDmlTest/static_555993353560259/idt_n_0/f6b9512f-b735-446e-85a3-d6b8636c847c_part_23_idt_n_0_0/meta, term=1, votedFor=idt_n_0, cost time=43 ms 2023-05-08 20:17:52:642 +0300 [INFO][%idt_n_0%vault-1][FSMCallerImpl] Shutting down FSMCaller... 2023-05-08 20:17:52:643 +0300 [INFO][%idt_n_0%vault-1][RaftGroupService] Stop the RaftGroupService successfully. 2023-05-08 20:17:52:643 +0300 [INFO][%idt_n_0%vault-1][Loza] Stop raft group=f6b9512f-b735-446e-85a3-d6b8636c847c_part_24 2023-05-08 20:19:23:400 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Checkpoint started [checkpointId=9a38325f-efea-49db-ab6d-9cec04fe7d8b, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=178, reason='timeout'] 2023-05-08 20:19:23:541 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Checkpoint finished [checkpointId=9a38325f-efea-49db-ab6d-9cec04fe7d8b, pages=178, pagesWriteTime=10ms, fsyncTime=134ms, totalTime=144ms] 2023-05-08 20:19:44:553 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Checkpoint started [checkpointId=f8dd8011-261b-450b-89ba-b5f0a4ab5f61, checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, splitAndSortPagesDuration=0ms, pages=338, reason='timeout'] 2023-05-08 20:19:44:790 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Checkpoint finished [checkpointId=f8dd8011-261b-450b-89ba-b5f0a4ab5f61, pages=338, pagesWriteTime=12ms, fsyncTime=222ms, totalTime=234ms] 2023-05-08 20:22:08:534 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 20:22:26:561 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=11ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 20:22:50:474 +0300 [INFO][%idt_n_0%vault-2][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334041815384064] 2023-05-08 20:22:51:037 +0300 [INFO][%idt_n_2%vault-2][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334041852215296] 2023-05-08 20:22:51:215 +0300 [INFO][%idt_n_1%vault-2][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334041863946240] 2023-05-08 20:24:57:992 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 20:25:22:418 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 20:27:50:482 +0300 [INFO][%idt_n_0%vault-3][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334061476708352] 2023-05-08 20:27:51:046 +0300 [INFO][%idt_n_2%vault-3][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334061513670656] 2023-05-08 20:27:51:230 +0300 [INFO][%idt_n_1%vault-3][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334061525663744] 2023-05-08 20:28:15:647 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 20:28:40:147 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=14ms, checkpointWriteLockHoldTime=14ms, reason='timeout'] 2023-05-08 20:31:16:263 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 20:31:28:157 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 20:32:50:492 +0300 [INFO][%idt_n_0%vault-0][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334081138163712] 2023-05-08 20:32:51:059 +0300 [INFO][%idt_n_2%vault-1][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334081175257088] 2023-05-08 20:32:51:242 +0300 [INFO][%idt_n_1%vault-1][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334081187315712] 2023-05-08 20:33:40:970 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 20:34:52:607 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 20:36:58:324 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 20:37:21:834 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=14ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 20:37:50:508 +0300 [INFO][%idt_n_0%vault-1][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334100800012288] 2023-05-08 20:37:51:070 +0300 [INFO][%idt_n_2%vault-0][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334100836843520] 2023-05-08 20:37:51:255 +0300 [INFO][%idt_n_1%vault-0][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334100848902144] 2023-05-08 20:39:57:686 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 20:40:08:058 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=11ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 20:42:50:488 +0300 [INFO][%idt_n_0%vault-2][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334120459501568] 2023-05-08 20:42:51:049 +0300 [INFO][%idt_n_2%vault-2][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334120496201728] 2023-05-08 20:42:51:238 +0300 [INFO][%idt_n_1%vault-2][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334120508653568] 2023-05-08 20:43:07:089 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=11ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 20:43:40:340 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 20:46:23:249 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 20:46:39:193 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 20:47:50:499 +0300 [INFO][%idt_n_0%vault-3][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334140121022464] 2023-05-08 20:47:51:059 +0300 [INFO][%idt_n_2%vault-3][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334140157657088] 2023-05-08 20:47:51:249 +0300 [INFO][%idt_n_1%vault-3][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334140170174464] 2023-05-08 20:48:38:002 +0300 [INFO][%idt_n_2%JRaft-Common-Executor-0][LocalSnapshotStorage] Deleting snapshot build/work/ItDmlTest/static_555993353560259/idt_n_2/metastorage_group_idt_n_2_0/snapshot/snapshot_22. 2023-05-08 20:48:38:003 +0300 [INFO][%idt_n_2%JRaft-Common-Executor-0][LocalSnapshotStorage] Renaming build/work/ItDmlTest/static_555993353560259/idt_n_2/metastorage_group_idt_n_2_0/snapshot/temp to build/work/ItDmlTest/static_555993353560259/idt_n_2/metastorage_group_idt_n_2_0/snapshot/snapshot_22. 2023-05-08 20:48:38:003 +0300 [INFO][%idt_n_2%JRaft-Common-Executor-0][LocalSnapshotStorage] Deleting snapshot build/work/ItDmlTest/static_555993353560259/idt_n_2/metastorage_group_idt_n_2_0/snapshot/snapshot_21. 2023-05-08 20:49:03:987 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 20:49:47:805 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 20:51:59:235 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 20:52:50:517 +0300 [INFO][%idt_n_0%vault-0][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334159782936576] 2023-05-08 20:52:51:077 +0300 [INFO][%idt_n_2%vault-1][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334159819636736] 2023-05-08 20:52:51:261 +0300 [INFO][%idt_n_1%vault-1][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334159831695360] 2023-05-08 20:53:09:533 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 20:55:24:580 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=14ms, reason='timeout'] 2023-05-08 20:56:07:804 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 20:57:50:470 +0300 [INFO][%idt_n_0%vault-1][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334179440721920] 2023-05-08 20:57:51:031 +0300 [INFO][%idt_n_2%vault-0][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334179477487616] 2023-05-08 20:57:51:208 +0300 [INFO][%idt_n_1%vault-0][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334179489087488] 2023-05-08 20:58:22:242 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 20:58:54:724 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 21:00:25:400 +0300 [INFO][%idt_n_0%JRaft-Common-Executor-1][LocalSnapshotStorage] Deleting snapshot build/work/ItDmlTest/static_555993353560259/idt_n_0/metastorage_group_idt_n_0_0/snapshot/snapshot_22. 2023-05-08 21:00:25:400 +0300 [INFO][%idt_n_0%JRaft-Common-Executor-1][LocalSnapshotStorage] Renaming build/work/ItDmlTest/static_555993353560259/idt_n_0/metastorage_group_idt_n_0_0/snapshot/temp to build/work/ItDmlTest/static_555993353560259/idt_n_0/metastorage_group_idt_n_0_0/snapshot/snapshot_22. 2023-05-08 21:00:25:400 +0300 [INFO][%idt_n_0%JRaft-Common-Executor-1][LocalSnapshotStorage] Deleting snapshot build/work/ItDmlTest/static_555993353560259/idt_n_0/metastorage_group_idt_n_0_0/snapshot/snapshot_21. 2023-05-08 21:01:28:833 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=11ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 21:01:45:306 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 21:02:50:478 +0300 [INFO][%idt_n_0%vault-2][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334199102046208] 2023-05-08 21:02:51:036 +0300 [INFO][%idt_n_2%vault-2][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334199138549760] 2023-05-08 21:02:51:217 +0300 [INFO][%idt_n_1%vault-2][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334199150411776] 2023-05-08 21:04:51:624 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=13ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 21:05:10:665 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 21:07:51:044 +0300 [INFO][%idt_n_2%vault-3][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334218799939584] 2023-05-08 21:07:51:221 +0300 [INFO][%idt_n_1%vault-3][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334218811539456] 2023-05-08 21:07:53:772 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 21:08:33:544 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=13ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 21:10:39:788 +0300 [INFO][%idt_n_1%JRaft-Common-Executor-1][LocalSnapshotStorage] Deleting snapshot build/work/ItDmlTest/static_555993353560259/idt_n_1/metastorage_group_idt_n_1_0/snapshot/snapshot_22. 2023-05-08 21:10:39:788 +0300 [INFO][%idt_n_1%JRaft-Common-Executor-1][LocalSnapshotStorage] Renaming build/work/ItDmlTest/static_555993353560259/idt_n_1/metastorage_group_idt_n_1_0/snapshot/temp to build/work/ItDmlTest/static_555993353560259/idt_n_1/metastorage_group_idt_n_1_0/snapshot/snapshot_22. 2023-05-08 21:10:39:788 +0300 [INFO][%idt_n_1%JRaft-Common-Executor-1][LocalSnapshotStorage] Deleting snapshot build/work/ItDmlTest/static_555993353560259/idt_n_1/metastorage_group_idt_n_1_0/snapshot/snapshot_21. 2023-05-08 21:11:09:914 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 21:12:02:771 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 21:12:51:030 +0300 [INFO][%idt_n_2%vault-1][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334238459822080] 2023-05-08 21:12:51:205 +0300 [INFO][%idt_n_1%vault-1][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334238471225344] 2023-05-08 21:14:26:741 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=11ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 21:15:01:914 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 21:16:51:451 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 21:17:51:038 +0300 [INFO][%idt_n_2%vault-0][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334258121080832] 2023-05-08 21:17:51:214 +0300 [INFO][%idt_n_1%vault-0][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334258132680704] 2023-05-08 21:18:33:137 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 21:19:59:519 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 21:21:21:918 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 21:22:51:051 +0300 [INFO][%idt_n_2%vault-2][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334277782798336] 2023-05-08 21:22:51:219 +0300 [INFO][%idt_n_1%vault-2][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334277793742848] 2023-05-08 21:23:23:961 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 21:23:46:137 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 21:26:05:335 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 21:26:33:969 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 21:27:51:059 +0300 [INFO][%idt_n_2%vault-3][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334297444122624] 2023-05-08 21:27:51:227 +0300 [INFO][%idt_n_1%vault-3][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334297455132672] 2023-05-08 21:29:40:180 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 21:30:03:636 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 21:32:46:470 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 21:32:47:837 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 21:32:51:069 +0300 [INFO][%idt_n_2%vault-1][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334317105577984] 2023-05-08 21:32:51:237 +0300 [INFO][%idt_n_1%vault-1][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334317116522496] 2023-05-08 21:35:13:777 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 21:36:04:510 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=11ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 21:37:51:073 +0300 [INFO][%idt_n_2%vault-0][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334336766574592] 2023-05-08 21:37:51:241 +0300 [INFO][%idt_n_1%vault-0][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334336777650176] 2023-05-08 21:38:38:073 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 21:39:04:239 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 21:41:19:620 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 21:42:22:701 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 21:42:51:081 +0300 [INFO][%idt_n_2%vault-2][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334356427898880] 2023-05-08 21:42:51:244 +0300 [INFO][%idt_n_1%vault-2][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334356438646784] 2023-05-08 21:43:53:126 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 21:45:02:787 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 21:46:25:711 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=12ms, reason='timeout'] 2023-05-08 21:47:51:088 +0300 [INFO][%idt_n_2%vault-3][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334376089223168] 2023-05-08 21:47:51:246 +0300 [INFO][%idt_n_1%vault-3][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334376099577856] 2023-05-08 21:48:20:872 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=11ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 21:49:10:764 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 21:51:44:050 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 21:52:26:053 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 21:52:51:092 +0300 [INFO][%idt_n_2%vault-1][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334395750219776] 2023-05-08 21:52:51:252 +0300 [INFO][%idt_n_1%vault-1][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334395760771072] 2023-05-08 21:55:02:464 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 21:55:12:469 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 21:57:39:991 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 21:57:49:085 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 21:57:51:115 +0300 [INFO][%idt_n_2%vault-0][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334415412592640] 2023-05-08 21:57:51:271 +0300 [INFO][%idt_n_1%vault-0][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334415422816256] 2023-05-08 22:00:10:596 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=10ms, reason='timeout'] 2023-05-08 22:00:39:808 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 22:02:51:119 +0300 [INFO][%idt_n_2%vault-2][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334435073589248] 2023-05-08 22:02:51:284 +0300 [INFO][%idt_n_1%vault-2][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334435084468224] 2023-05-08 22:02:59:844 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=11ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 22:03:19:169 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 22:06:19:016 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 22:06:20:580 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 22:07:51:125 +0300 [INFO][%idt_n_2%vault-3][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334454734782464] 2023-05-08 22:07:51:295 +0300 [INFO][%idt_n_1%vault-3][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334454745989120] 2023-05-08 22:08:52:347 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 22:09:12:534 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 22:11:47:501 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 22:12:08:185 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 22:12:51:099 +0300 [INFO][%idt_n_2%vault-1][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334474393878528] 2023-05-08 22:12:51:268 +0300 [INFO][%idt_n_1%vault-1][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334474405019648] 2023-05-08 22:14:40:679 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 22:15:29:209 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 22:17:37:169 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 22:17:51:101 +0300 [INFO][%idt_n_2%vault-0][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334494054875136] 2023-05-08 22:17:51:273 +0300 [INFO][%idt_n_1%vault-0][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334494066147328] 2023-05-08 22:18:45:955 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=13ms, checkpointWriteLockHoldTime=13ms, reason='timeout'] 2023-05-08 22:21:03:364 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 22:21:54:820 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 22:22:51:102 +0300 [INFO][%idt_n_2%vault-2][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334513715740672] 2023-05-08 22:22:51:281 +0300 [INFO][%idt_n_1%vault-2][LowWatermark] Successful low watermark update: HybridTimestamp [time=110334513727471616] 2023-05-08 22:24:03:055 +0300 [INFO][%idt_n_1%checkpoint-thread-5][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 22:24:28:093 +0300 [INFO][%idt_n_2%checkpoint-thread-3][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeWriteLockTime=0ms, checkpointWriteLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms, reason='timeout'] 2023-05-08 22:25:59:483 +0300 [INFO][Thread-1][Micronaut] Embedded Application shutting down Profiling started Profiling started Profiling started Process finished with exit code 130 (interrupted by signal 2: SIGINT)