[2021/08/19 20:24:18.086] INFO [disco-event-worker-#60] [] - Added new node to topology: TcpDiscoveryNode [id=b588bb65-6fe8-4aff-8f17-4a9e8733369b, consistentId=b588bb65-6fe8-4aff-8f17-4a9e8733369b, addrs=ArrayList [10.211.80.15, 127.0.0.1], sockAddrs=HashSet [rhdpg01/10.211.80.15:0, /127.0.0.1:0], discPort=0, order=76, intOrder=42, lastExchangeTime=1629375858067, loc=false, ver=8.8.5#20210519-sha1:067284c6, isClient=true] [2021/08/19 20:24:18.087] INFO [disco-event-worker-#60] [] - Topology snapshot [ver=76, locNode=c791881c, servers=2, clients=6, state=ACTIVE, CPUs=48, offheap=11.0GB, heap=46.0GB, aliveNodes=[TcpDiscoveryNode [id=c791881c-983f-44c9-a30b-c9b12e9cb7f6, consistentId=rhdpg03, isClient=false, ver=8.8.5#20210519-sha1:067284c6], TcpDiscoveryNode [id=1dba00ff-bcdf-4b5e-877c-78012f93a080, consistentId=rhdpg04, isClient=false, ver=8.8.5#20210519-sha1:067284c6], TcpDiscoveryNode [id=2e8039fe-6c7e-455f-9774-1879aaa67564, consistentId=2e8039fe-6c7e-455f-9774-1879aaa67564, isClient=true, ver=8.8.5#20210519-sha1:067284c6], TcpDiscoveryNode [id=7d483a80-4ada-4c10-b2e2-3b85a47b2d26, consistentId=7d483a80-4ada-4c10-b2e2-3b85a47b2d26, isClient=true, ver=8.8.5#20210519-sha1:067284c6], TcpDiscoveryNode [id=eceae49c-0325-4f96-878f-9ef6c62e03e6, consistentId=eceae49c-0325-4f96-878f-9ef6c62e03e6, isClient=true, ver=8.8.5#20210519-sha1:067284c6], TcpDiscoveryNode [id=a390ed29-4892-4de5-a58b-a1c8b26631df, consistentId=a390ed29-4892-4de5-a58b-a1c8b26631df, isClient=true, ver=8.8.5#20210519-sha1:067284c6], TcpDiscoveryNode [id=ed4da489-a29e-460c-83d7-751072a99a5a, consistentId=ed4da489-a29e-460c-83d7-751072a99a5a, isClient=true, ver=8.8.5#20210519-sha1:067284c6], TcpDiscoveryNode [id=b588bb65-6fe8-4aff-8f17-4a9e8733369b, consistentId=b588bb65-6fe8-4aff-8f17-4a9e8733369b, isClient=true, ver=8.8.5#20210519-sha1:067284c6]]] [2021/08/19 20:24:18.087] INFO [disco-event-worker-#60] [] - ^-- Baseline [id=0, size=2, online=2, offline=0] [2021/08/19 20:24:18.087] INFO [exchange-worker-#61] [] - Started exchange init [topVer=AffinityTopologyVersion [topVer=76, minorTopVer=0], crd=true, evt=NODE_JOINED, evtNode=b588bb65-6fe8-4aff-8f17-4a9e8733369b, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [2021/08/19 20:24:18.088] INFO [exchange-worker-#61] [] - Finish exchange future [startVer=AffinityTopologyVersion [topVer=76, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=76, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [2021/08/19 20:24:18.088] INFO [exchange-worker-#61] [] - Completed partition exchange [localNode=c791881c-983f-44c9-a30b-c9b12e9cb7f6, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=76, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=b588bb65-6fe8-4aff-8f17-4a9e8733369b, consistentId=b588bb65-6fe8-4aff-8f17-4a9e8733369b, addrs=ArrayList [10.211.80.15, 127.0.0.1], sockAddrs=HashSet [rhdpg01/10.211.80.15:0, /127.0.0.1:0], discPort=0, order=76, intOrder=42, lastExchangeTime=1629375858067, loc=false, ver=8.8.5#20210519-sha1:067284c6, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=76, minorTopVer=0]] [2021/08/19 20:24:18.088] INFO [exchange-worker-#61] [] - Exchange timings [startVer=AffinityTopologyVersion [topVer=76, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=76, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (0 ms), stage="Exchange done" (0 ms), stage="Total time" (0 ms)] [2021/08/19 20:24:18.088] INFO [exchange-worker-#61] [] - Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=76, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=76, minorTopVer=0]] [2021/08/19 20:24:18.088] INFO [exchange-worker-#61] [] - Finished exchange init [topVer=AffinityTopologyVersion [topVer=76, minorTopVer=0], crd=true] [2021/08/19 20:24:18.089] INFO [exchange-worker-#61] [] - Skipping rebalancing (no affinity changes) [top=AffinityTopologyVersion [topVer=76, minorTopVer=0], evt=NODE_JOINED, evtNode=b588bb65-6fe8-4aff-8f17-4a9e8733369b, client=false] [2021/08/19 20:24:38.180] INFO [tcp-disco-srvr-[:6200]-#3-#59] [] - TCP discovery accepted incoming connection [rmtAddr=/10.211.80.15, rmtPort=40577] [2021/08/19 20:24:38.180] INFO [tcp-disco-srvr-[:6200]-#3-#59] [] - TCP discovery spawning a new thread for connection [rmtAddr=/10.211.80.15, rmtPort=40577] [2021/08/19 20:24:38.181] INFO [tcp-disco-sock-reader-[]-#86-#353] [] - Started serving remote node connection [rmtAddr=/10.211.80.15:40577, rmtPort=40577] [2021/08/19 20:24:38.181] INFO [tcp-disco-sock-reader-[b588bb65 10.211.80.15:40577 client]-#86-#353] [] - Initialized connection with remote client node [nodeId=b588bb65-6fe8-4aff-8f17-4a9e8733369b, rmtAddr=/10.211.80.15:40577] [2021/08/19 20:24:54.021] INFO [db-checkpoint-thread-#73] [] - Checkpoint started [checkpointId=2f964252-cdb9-4f34-bfaf-e04bb28e247d, startPtr=FileWALPointer [idx=10400, fileOff=51368709, len=40877], checkpointBeforeLockTime=4ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=4ms, checkpointLockHoldTime=5ms, walCpRecordFsyncDuration=13ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=740, reason='timeout'] [2021/08/19 20:24:54.120] INFO [db-checkpoint-thread-#73] [] - Checkpoint finished [cpId=2f964252-cdb9-4f34-bfaf-e04bb28e247d, pages=740, markPos=FileWALPointer [idx=10400, fileOff=51368709, len=40877], walSegmentsCovered=[], markDuration=20ms, pagesWrite=90ms, fsync=9ms, total=123ms] [2021/08/19 20:25:23.157] WARN [tcp-disco-client-message-worker-[b588bb65 10.211.80.15:40577]-#87-#354] [] - Client node considered as unreachable and will be dropped from cluster, because no metrics update messages received in interval: TcpDiscoverySpi.clientFailureDetectionTimeout() ms. It may be caused by network problems or long GC pause on client node, try to increase this parameter. [nodeId=b588bb65-6fe8-4aff-8f17-4a9e8733369b, clientFailureDetectionTimeout=30000] [2021/08/19 20:25:23.159] WARN [disco-event-worker-#60] [] - Node FAILED: TcpDiscoveryNode [id=b588bb65-6fe8-4aff-8f17-4a9e8733369b, consistentId=b588bb65-6fe8-4aff-8f17-4a9e8733369b, addrs=ArrayList [10.211.80.15, 127.0.0.1], sockAddrs=HashSet [rhdpg01/10.211.80.15:0, /127.0.0.1:0], discPort=0, order=76, intOrder=42, lastExchangeTime=1629375858067, loc=false, ver=8.8.5#20210519-sha1:067284c6, isClient=true] [2021/08/19 20:25:23.159] INFO [tcp-disco-sock-reader-[b588bb65 10.211.80.15:40577 client]-#86-#353] [] - Finished serving remote node connection [rmtAddr=/10.211.80.15:40577, rmtPort=40577, rmtNodeId=b588bb65-6fe8-4aff-8f17-4a9e8733369b] [2021/08/19 20:25:23.159] INFO [disco-event-worker-#60] [] - Topology snapshot [ver=77, locNode=c791881c, servers=2, clients=5, state=ACTIVE, CPUs=48, offheap=11.0GB, heap=42.0GB, aliveNodes=[TcpDiscoveryNode [id=c791881c-983f-44c9-a30b-c9b12e9cb7f6, consistentId=rhdpg03, isClient=false, ver=8.8.5#20210519-sha1:067284c6], TcpDiscoveryNode [id=1dba00ff-bcdf-4b5e-877c-78012f93a080, consistentId=rhdpg04, isClient=false, ver=8.8.5#20210519-sha1:067284c6], TcpDiscoveryNode [id=2e8039fe-6c7e-455f-9774-1879aaa67564, consistentId=2e8039fe-6c7e-455f-9774-1879aaa67564, isClient=true, ver=8.8.5#20210519-sha1:067284c6], TcpDiscoveryNode [id=7d483a80-4ada-4c10-b2e2-3b85a47b2d26, consistentId=7d483a80-4ada-4c10-b2e2-3b85a47b2d26, isClient=true, ver=8.8.5#20210519-sha1:067284c6], TcpDiscoveryNode [id=eceae49c-0325-4f96-878f-9ef6c62e03e6, consistentId=eceae49c-0325-4f96-878f-9ef6c62e03e6, isClient=true, ver=8.8.5#20210519-sha1:067284c6], TcpDiscoveryNode [id=a390ed29-4892-4de5-a58b-a1c8b26631df, consistentId=a390ed29-4892-4de5-a58b-a1c8b26631df, isClient=true, ver=8.8.5#20210519-sha1:067284c6], TcpDiscoveryNode [id=ed4da489-a29e-460c-83d7-751072a99a5a, consistentId=ed4da489-a29e-460c-83d7-751072a99a5a, isClient=true, ver=8.8.5#20210519-sha1:067284c6]]] [2021/08/19 20:25:23.159] INFO [disco-event-worker-#60] [] - ^-- Baseline [id=0, size=2, online=2, offline=0] [2021/08/19 20:25:23.161] INFO [exchange-worker-#61] [] - Started exchange init [topVer=AffinityTopologyVersion [topVer=77, minorTopVer=0], crd=true, evt=NODE_FAILED, evtNode=b588bb65-6fe8-4aff-8f17-4a9e8733369b, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [2021/08/19 20:25:23.161] INFO [exchange-worker-#61] [] - Finish exchange future [startVer=AffinityTopologyVersion [topVer=77, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=77, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [2021/08/19 20:25:23.161] INFO [exchange-worker-#61] [] - Completed partition exchange [localNode=c791881c-983f-44c9-a30b-c9b12e9cb7f6, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=77, minorTopVer=0], evt=NODE_FAILED, evtNode=TcpDiscoveryNode [id=b588bb65-6fe8-4aff-8f17-4a9e8733369b, consistentId=b588bb65-6fe8-4aff-8f17-4a9e8733369b, addrs=ArrayList [10.211.80.15, 127.0.0.1], sockAddrs=HashSet [rhdpg01/10.211.80.15:0, /127.0.0.1:0], discPort=0, order=76, intOrder=42, lastExchangeTime=1629375858067, loc=false, ver=8.8.5#20210519-sha1:067284c6, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=77, minorTopVer=0]] [2021/08/19 20:25:23.162] INFO [exchange-worker-#61] [] - Exchange timings [startVer=AffinityTopologyVersion [topVer=77, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=77, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (0 ms), stage="Exchange done" (0 ms), stage="Total time" (0 ms)] [2021/08/19 20:25:23.162] INFO [exchange-worker-#61] [] - Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=77, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=77, minorTopVer=0]] [2021/08/19 20:25:23.162] INFO [exchange-worker-#61] [] - Finished exchange init [topVer=AffinityTopologyVersion [topVer=77, minorTopVer=0], crd=true] [2021/08/19 20:25:23.162] INFO [exchange-worker-#61] [] - Skipping rebalancing (no affinity changes) [top=AffinityTopologyVersion [topVer=77, minorTopVer=0], evt=NODE_FAILED, evtNode=b588bb65-6fe8-4aff-8f17-4a9e8733369b, client=false] [2021/08/19 20:25:48.546] INFO [tcp-disco-srvr-[:6200]-#3-#59] [] - TCP discovery accepted incoming connection [rmtAddr=/10.211.80.15, rmtPort=35499] [2021/08/19 20:25:48.546] INFO [tcp-disco-srvr-[:6200]-#3-#59] [] - TCP discovery spawning a new thread for connection [rmtAddr=/10.211.80.15, rmtPort=35499] [2021/08/19 20:25:48.547] INFO [tcp-disco-sock-reader-[]-#88-#358] [] - Started serving remote node connection [rmtAddr=/10.211.80.15:35499, rmtPort=35499] [2021/08/19 20:25:48.548] INFO [tcp-disco-sock-reader-[49b9fd2e 10.211.80.15:35499 client]-#88-#358] [] - Initialized connection with remote client node [nodeId=49b9fd2e-5f53-402e-a07c-3a49d3fa7b18, rmtAddr=/10.211.80.15:35499] [2021/08/19 20:25:48.572] INFO [disco-event-worker-#60] [] - Added new node to topology: TcpDiscoveryNode [id=49b9fd2e-5f53-402e-a07c-3a49d3fa7b18, consistentId=49b9fd2e-5f53-402e-a07c-3a49d3fa7b18, addrs=ArrayList [10.211.80.15, 127.0.0.1], sockAddrs=HashSet [rhdpg01/10.211.80.15:0, /127.0.0.1:0], discPort=0, order=78, intOrder=43, lastExchangeTime=1629375948555, loc=false, ver=8.8.5#20210519-sha1:067284c6, isClient=true] [2021/08/19 20:25:48.572] INFO [disco-event-worker-#60] [] - Topology snapshot [ver=78, locNode=c791881c, servers=2, clients=6, state=ACTIVE, CPUs=48, offheap=11.0GB, heap=46.0GB, aliveNodes=[TcpDiscoveryNode [id=c791881c-983f-44c9-a30b-c9b12e9cb7f6, consistentId=rhdpg03, isClient=false, ver=8.8.5#20210519-sha1:067284c6], TcpDiscoveryNode [id=1dba00ff-bcdf-4b5e-877c-78012f93a080, consistentId=rhdpg04, isClient=false, ver=8.8.5#20210519-sha1:067284c6], TcpDiscoveryNode [id=2e8039fe-6c7e-455f-9774-1879aaa67564, consistentId=2e8039fe-6c7e-455f-9774-1879aaa67564, isClient=true, ver=8.8.5#20210519-sha1:067284c6], TcpDiscoveryNode [id=7d483a80-4ada-4c10-b2e2-3b85a47b2d26, consistentId=7d483a80-4ada-4c10-b2e2-3b85a47b2d26, isClient=true, ver=8.8.5#20210519-sha1:067284c6], TcpDiscoveryNode [id=eceae49c-0325-4f96-878f-9ef6c62e03e6, consistentId=eceae49c-0325-4f96-878f-9ef6c62e03e6, isClient=true, ver=8.8.5#20210519-sha1:067284c6], TcpDiscoveryNode [id=a390ed29-4892-4de5-a58b-a1c8b26631df, consistentId=a390ed29-4892-4de5-a58b-a1c8b26631df, isClient=true, ver=8.8.5#20210519-sha1:067284c6], TcpDiscoveryNode [id=ed4da489-a29e-460c-83d7-751072a99a5a, consistentId=ed4da489-a29e-460c-83d7-751072a99a5a, isClient=true, ver=8.8.5#20210519-sha1:067284c6], TcpDiscoveryNode [id=49b9fd2e-5f53-402e-a07c-3a49d3fa7b18, consistentId=49b9fd2e-5f53-402e-a07c-3a49d3fa7b18, isClient=true, ver=8.8.5#20210519-sha1:067284c6]]] [2021/08/19 20:25:48.572] INFO [disco-event-worker-#60] [] - ^-- Baseline [id=0, size=2, online=2, offline=0] [2021/08/19 20:25:48.573] INFO [exchange-worker-#61] [] - Started exchange init [topVer=AffinityTopologyVersion [topVer=78, minorTopVer=0], crd=true, evt=NODE_JOINED, evtNode=49b9fd2e-5f53-402e-a07c-3a49d3fa7b18, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [2021/08/19 20:25:48.573] INFO [exchange-worker-#61] [] - Finish exchange future [startVer=AffinityTopologyVersion [topVer=78, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=78, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [2021/08/19 20:25:48.573] INFO [exchange-worker-#61] [] - Completed partition exchange [localNode=c791881c-983f-44c9-a30b-c9b12e9cb7f6, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=78, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=49b9fd2e-5f53-402e-a07c-3a49d3fa7b18, consistentId=49b9fd2e-5f53-402e-a07c-3a49d3fa7b18, addrs=ArrayList [10.211.80.15, 127.0.0.1], sockAddrs=HashSet [rhdpg01/10.211.80.15:0, /127.0.0.1:0], discPort=0, order=78, intOrder=43, lastExchangeTime=1629375948555, loc=false, ver=8.8.5#20210519-sha1:067284c6, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=78, minorTopVer=0]] [2021/08/19 20:25:48.573] INFO [exchange-worker-#61] [] - Exchange timings [startVer=AffinityTopologyVersion [topVer=78, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=78, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (0 ms), stage="Exchange done" (0 ms), stage="Total time" (0 ms)] [2021/08/19 20:25:48.574] INFO [exchange-worker-#61] [] - Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=78, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=78, minorTopVer=0]] [2021/08/19 20:25:48.574] INFO [exchange-worker-#61] [] - Finished exchange init [topVer=AffinityTopologyVersion [topVer=78, minorTopVer=0], crd=true] [2021/08/19 20:25:48.574] INFO [exchange-worker-#61] [] - Skipping rebalancing (no affinity changes) [top=AffinityTopologyVersion [topVer=78, minorTopVer=0], evt=NODE_JOINED, evtNode=49b9fd2e-5f53-402e-a07c-3a49d3fa7b18, client=false] [2021/08/19 20:26:02.034] INFO [tcp-disco-sock-reader-[49b9fd2e 10.211.80.15:35499 client]-#88-#358] [] - Finished serving remote node connection [rmtAddr=/10.211.80.15:35499, rmtPort=35499, rmtNodeId=49b9fd2e-5f53-402e-a07c-3a49d3fa7b18] [2021/08/19 20:26:02.034] INFO [tcp-disco-sock-reader-[49b9fd2e 10.211.80.15:35499 client]-#88-#358] [] - Finished serving remote node connection [rmtAddr=/10.211.80.15:35499, rmtPort=35499, rmtNodeId=49b9fd2e-5f53-402e-a07c-3a49d3fa7b18] [2021/08/19 20:26:41.220] WARN [tcp-disco-msg-worker-[1dba00ff 10.211.80.18:6200 crd]-#2-#58] [] - Received EVT_NODE_FAILED event with warning [nodeInitiatedEvt=TcpDiscoveryNode [id=1dba00ff-bcdf-4b5e-877c-78012f93a080, consistentId=rhdpg04, addrs=ArrayList [10.211.80.18, 127.0.0.1], sockAddrs=HashSet [rhdpg04/10.211.80.18:6200, /127.0.0.1:6200], discPort=6200, order=2, intOrder=2, lastExchangeTime=1624473155061, loc=false, ver=8.8.5#20210519-sha1:067284c6, isClient=false], msg=Client node considered as unreachable and will be dropped from cluster, because no metrics update messages received in interval: TcpDiscoverySpi.clientFailureDetectionTimeout() ms. It may be caused by network problems or long GC pause on client node, try to increase this parameter. [nodeId=49b9fd2e-5f53-402e-a07c-3a49d3fa7b18, clientFailureDetectionTimeout=30000]] [2021/08/19 20:26:41.221] WARN [disco-event-worker-#60] [] - Node FAILED: TcpDiscoveryNode [id=49b9fd2e-5f53-402e-a07c-3a49d3fa7b18, consistentId=49b9fd2e-5f53-402e-a07c-3a49d3fa7b18, addrs=ArrayList [10.211.80.15, 127.0.0.1], sockAddrs=HashSet [rhdpg01/10.211.80.15:0, /127.0.0.1:0], discPort=0, order=78, intOrder=43, lastExchangeTime=1629375948555, loc=false, ver=8.8.5#20210519-sha1:067284c6, isClient=true] [2021/08/19 20:26:41.221] INFO [disco-event-worker-#60] [] - Topology snapshot [ver=79, locNode=c791881c, servers=2, clients=5, state=ACTIVE, CPUs=48, offheap=11.0GB, heap=42.0GB, aliveNodes=[TcpDiscoveryNode [id=c791881c-983f-44c9-a30b-c9b12e9cb7f6, consistentId=rhdpg03, isClient=false, ver=8.8.5#20210519-sha1:067284c6], TcpDiscoveryNode [id=1dba00ff-bcdf-4b5e-877c-78012f93a080, consistentId=rhdpg04, isClient=false, ver=8.8.5#20210519-sha1:067284c6], TcpDiscoveryNode [id=2e8039fe-6c7e-455f-9774-1879aaa67564, consistentId=2e8039fe-6c7e-455f-9774-1879aaa67564, isClient=true, ver=8.8.5#20210519-sha1:067284c6], TcpDiscoveryNode [id=7d483a80-4ada-4c10-b2e2-3b85a47b2d26, consistentId=7d483a80-4ada-4c10-b2e2-3b85a47b2d26, isClient=true, ver=8.8.5#20210519-sha1:067284c6], TcpDiscoveryNode [id=eceae49c-0325-4f96-878f-9ef6c62e03e6, consistentId=eceae49c-0325-4f96-878f-9ef6c62e03e6, isClient=true, ver=8.8.5#20210519-sha1:067284c6], TcpDiscoveryNode [id=a390ed29-4892-4de5-a58b-a1c8b26631df, consistentId=a390ed29-4892-4de5-a58b-a1c8b26631df, isClient=true, ver=8.8.5#20210519-sha1:067284c6], TcpDiscoveryNode [id=ed4da489-a29e-460c-83d7-751072a99a5a, consistentId=ed4da489-a29e-460c-83d7-751072a99a5a, isClient=true, ver=8.8.5#20210519-sha1:067284c6]]] [2021/08/19 20:26:41.221] INFO [disco-event-worker-#60] [] - ^-- Baseline [id=0, size=2, online=2, offline=0] [2021/08/19 20:26:41.222] INFO [exchange-worker-#61] [] - Started exchange init [topVer=AffinityTopologyVersion [topVer=79, minorTopVer=0], crd=true, evt=NODE_FAILED, evtNode=49b9fd2e-5f53-402e-a07c-3a49d3fa7b18, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [2021/08/19 20:26:41.223] INFO [exchange-worker-#61] [] - Finish exchange future [startVer=AffinityTopologyVersion [topVer=79, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=79, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [2021/08/19 20:26:41.223] INFO [exchange-worker-#61] [] - Completed partition exchange [localNode=c791881c-983f-44c9-a30b-c9b12e9cb7f6, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=79, minorTopVer=0], evt=NODE_FAILED, evtNode=TcpDiscoveryNode [id=49b9fd2e-5f53-402e-a07c-3a49d3fa7b18, consistentId=49b9fd2e-5f53-402e-a07c-3a49d3fa7b18, addrs=ArrayList [10.211.80.15, 127.0.0.1], sockAddrs=HashSet [rhdpg01/10.211.80.15:0, /127.0.0.1:0], discPort=0, order=78, intOrder=43, lastExchangeTime=1629375948555, loc=false, ver=8.8.5#20210519-sha1:067284c6, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=79, minorTopVer=0]] [2021/08/19 20:26:41.223] INFO [exchange-worker-#61] [] - Exchange timings [startVer=AffinityTopologyVersion [topVer=79, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=79, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (0 ms), stage="Exchange done" (0 ms), stage="Total time" (0 ms)] [2021/08/19 20:26:41.223] INFO [exchange-worker-#61] [] - Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=79, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=79, minorTopVer=0]] [2021/08/19 20:26:41.223] INFO [exchange-worker-#61] [] - Finished exchange init [topVer=AffinityTopologyVersion [topVer=79, minorTopVer=0], crd=true] [2021/08/19 20:26:41.224] INFO [exchange-worker-#61] [] - Skipping rebalancing (no affinity changes) [top=AffinityTopologyVersion [topVer=79, minorTopVer=0], evt=NODE_FAILED, evtNode=49b9fd2e-5f53-402e-a07c-3a49d3fa7b18, client=false] [2021/08/19 20:27:54.023] INFO [db-checkpoint-thread-#73] [] - Checkpoint started [checkpointId=5139e450-1bd9-419e-bc4b-c975604f0d9c, startPtr=FileWALPointer [idx=10400, fileOff=55809101, len=40877], checkpointBeforeLockTime=4ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=4ms, checkpointLockHoldTime=4ms, walCpRecordFsyncDuration=15ms, writeCheckpointEntryDuration=3ms, splitAndSortCpPagesDuration=0ms, pages=1037, reason='timeout'] [2021/08/19 20:27:54.163] INFO [db-checkpoint-thread-#73] [] - Checkpoint finished [cpId=5139e450-1bd9-419e-bc4b-c975604f0d9c, pages=1037, markPos=FileWALPointer [idx=10400, fileOff=55809101, len=40877], walSegmentsCovered=[], markDuration=22ms, pagesWrite=131ms, fsync=9ms, total=166ms]