[2021/08/19 20:24:18.035] INFO [tcp-disco-srvr-[:6200]-#3-#59] [] - TCP discovery accepted incoming connection [rmtAddr=/10.211.80.15, rmtPort=54433] [2021/08/19 20:24:18.035] INFO [tcp-disco-srvr-[:6200]-#3-#59] [] - TCP discovery spawning a new thread for connection [rmtAddr=/10.211.80.15, rmtPort=54433] [2021/08/19 20:24:18.035] INFO [tcp-disco-sock-reader-[]-#89-#323] [] - Started serving remote node connection [rmtAddr=/10.211.80.15:54433, rmtPort=54433] [2021/08/19 20:24:18.038] INFO [tcp-disco-sock-reader-[b588bb65 10.211.80.15:54433 client]-#89-#323] [] - Initialized connection with remote client node [nodeId=b588bb65-6fe8-4aff-8f17-4a9e8733369b, rmtAddr=/10.211.80.15:54433] [2021/08/19 20:24:18.088] INFO [disco-event-worker-#62] [] - Added new node to topology: TcpDiscoveryNode [id=b588bb65-6fe8-4aff-8f17-4a9e8733369b, consistentId=b588bb65-6fe8-4aff-8f17-4a9e8733369b, addrs=ArrayList [10.211.80.15, 127.0.0.1], sockAddrs=HashSet [rhdpg01/10.211.80.15:0, /127.0.0.1:0], discPort=0, order=76, intOrder=42, lastExchangeTime=1629375858082, loc=false, ver=8.8.5#20210519-sha1:067284c6, isClient=true] [2021/08/19 20:24:18.088] INFO [disco-event-worker-#62] [] - Topology snapshot [ver=76, locNode=1dba00ff, servers=2, clients=6, state=ACTIVE, CPUs=48, offheap=11.0GB, heap=46.0GB, aliveNodes=[TcpDiscoveryNode [id=c791881c-983f-44c9-a30b-c9b12e9cb7f6, consistentId=rhdpg03, isClient=false, ver=8.8.5#20210519-sha1:067284c6], TcpDiscoveryNode [id=1dba00ff-bcdf-4b5e-877c-78012f93a080, consistentId=rhdpg04, isClient=false, ver=8.8.5#20210519-sha1:067284c6], TcpDiscoveryNode [id=2e8039fe-6c7e-455f-9774-1879aaa67564, consistentId=2e8039fe-6c7e-455f-9774-1879aaa67564, isClient=true, ver=8.8.5#20210519-sha1:067284c6], TcpDiscoveryNode [id=7d483a80-4ada-4c10-b2e2-3b85a47b2d26, consistentId=7d483a80-4ada-4c10-b2e2-3b85a47b2d26, isClient=true, ver=8.8.5#20210519-sha1:067284c6], TcpDiscoveryNode [id=eceae49c-0325-4f96-878f-9ef6c62e03e6, consistentId=eceae49c-0325-4f96-878f-9ef6c62e03e6, isClient=true, ver=8.8.5#20210519-sha1:067284c6], TcpDiscoveryNode [id=a390ed29-4892-4de5-a58b-a1c8b26631df, consistentId=a390ed29-4892-4de5-a58b-a1c8b26631df, isClient=true, ver=8.8.5#20210519-sha1:067284c6], TcpDiscoveryNode [id=ed4da489-a29e-460c-83d7-751072a99a5a, consistentId=ed4da489-a29e-460c-83d7-751072a99a5a, isClient=true, ver=8.8.5#20210519-sha1:067284c6], TcpDiscoveryNode [id=b588bb65-6fe8-4aff-8f17-4a9e8733369b, consistentId=b588bb65-6fe8-4aff-8f17-4a9e8733369b, isClient=true, ver=8.8.5#20210519-sha1:067284c6]]] [2021/08/19 20:24:18.088] INFO [disco-event-worker-#62] [] - ^-- Baseline [id=0, size=2, online=2, offline=0] [2021/08/19 20:24:18.089] INFO [exchange-worker-#63] [] - Started exchange init [topVer=AffinityTopologyVersion [topVer=76, minorTopVer=0], crd=false, evt=NODE_JOINED, evtNode=b588bb65-6fe8-4aff-8f17-4a9e8733369b, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [2021/08/19 20:24:18.089] INFO [exchange-worker-#63] [] - Finish exchange future [startVer=AffinityTopologyVersion [topVer=76, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=76, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [2021/08/19 20:24:18.089] INFO [exchange-worker-#63] [] - Completed partition exchange [localNode=1dba00ff-bcdf-4b5e-877c-78012f93a080, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=76, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=b588bb65-6fe8-4aff-8f17-4a9e8733369b, consistentId=b588bb65-6fe8-4aff-8f17-4a9e8733369b, addrs=ArrayList [10.211.80.15, 127.0.0.1], sockAddrs=HashSet [rhdpg01/10.211.80.15:0, /127.0.0.1:0], discPort=0, order=76, intOrder=42, lastExchangeTime=1629375858082, loc=false, ver=8.8.5#20210519-sha1:067284c6, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=76, minorTopVer=0]] [2021/08/19 20:24:18.089] INFO [exchange-worker-#63] [] - Exchange timings [startVer=AffinityTopologyVersion [topVer=76, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=76, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (0 ms), stage="Exchange done" (0 ms), stage="Total time" (0 ms)] [2021/08/19 20:24:18.089] INFO [exchange-worker-#63] [] - Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=76, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=76, minorTopVer=0]] [2021/08/19 20:24:18.090] INFO [exchange-worker-#63] [] - Finished exchange init [topVer=AffinityTopologyVersion [topVer=76, minorTopVer=0], crd=false] [2021/08/19 20:24:18.090] INFO [exchange-worker-#63] [] - Skipping rebalancing (no affinity changes) [top=AffinityTopologyVersion [topVer=76, minorTopVer=0], evt=NODE_JOINED, evtNode=b588bb65-6fe8-4aff-8f17-4a9e8733369b, client=false] [2021/08/19 20:24:32.043] INFO [tcp-disco-sock-reader-[b588bb65 10.211.80.15:54433 client]-#89-#323] [] - Finished serving remote node connection [rmtAddr=/10.211.80.15:54433, rmtPort=54433, rmtNodeId=b588bb65-6fe8-4aff-8f17-4a9e8733369b] [2021/08/19 20:25:23.159] WARN [tcp-disco-msg-worker-[c791881c 10.211.80.17:6200]-#2-#58] [] - Received EVT_NODE_FAILED event with warning [nodeInitiatedEvt=TcpDiscoveryNode [id=c791881c-983f-44c9-a30b-c9b12e9cb7f6, consistentId=rhdpg03, addrs=ArrayList [10.211.80.17, 127.0.0.1], sockAddrs=HashSet [/127.0.0.1:6200, rhdpg03/10.211.80.17:6200], discPort=6200, order=1, intOrder=1, lastExchangeTime=1624473155109, loc=false, ver=8.8.5#20210519-sha1:067284c6, isClient=false], msg=Client node considered as unreachable and will be dropped from cluster, because no metrics update messages received in interval: TcpDiscoverySpi.clientFailureDetectionTimeout() ms. It may be caused by network problems or long GC pause on client node, try to increase this parameter. [nodeId=b588bb65-6fe8-4aff-8f17-4a9e8733369b, clientFailureDetectionTimeout=30000]] [2021/08/19 20:25:23.160] WARN [disco-event-worker-#62] [] - Node FAILED: TcpDiscoveryNode [id=b588bb65-6fe8-4aff-8f17-4a9e8733369b, consistentId=b588bb65-6fe8-4aff-8f17-4a9e8733369b, addrs=ArrayList [10.211.80.15, 127.0.0.1], sockAddrs=HashSet [rhdpg01/10.211.80.15:0, /127.0.0.1:0], discPort=0, order=76, intOrder=42, lastExchangeTime=1629375858082, loc=false, ver=8.8.5#20210519-sha1:067284c6, isClient=true] [2021/08/19 20:25:23.160] INFO [disco-event-worker-#62] [] - Topology snapshot [ver=77, locNode=1dba00ff, servers=2, clients=5, state=ACTIVE, CPUs=48, offheap=11.0GB, heap=42.0GB, aliveNodes=[TcpDiscoveryNode [id=c791881c-983f-44c9-a30b-c9b12e9cb7f6, consistentId=rhdpg03, isClient=false, ver=8.8.5#20210519-sha1:067284c6], TcpDiscoveryNode [id=1dba00ff-bcdf-4b5e-877c-78012f93a080, consistentId=rhdpg04, isClient=false, ver=8.8.5#20210519-sha1:067284c6], TcpDiscoveryNode [id=2e8039fe-6c7e-455f-9774-1879aaa67564, consistentId=2e8039fe-6c7e-455f-9774-1879aaa67564, isClient=true, ver=8.8.5#20210519-sha1:067284c6], TcpDiscoveryNode [id=7d483a80-4ada-4c10-b2e2-3b85a47b2d26, consistentId=7d483a80-4ada-4c10-b2e2-3b85a47b2d26, isClient=true, ver=8.8.5#20210519-sha1:067284c6], TcpDiscoveryNode [id=eceae49c-0325-4f96-878f-9ef6c62e03e6, consistentId=eceae49c-0325-4f96-878f-9ef6c62e03e6, isClient=true, ver=8.8.5#20210519-sha1:067284c6], TcpDiscoveryNode [id=a390ed29-4892-4de5-a58b-a1c8b26631df, consistentId=a390ed29-4892-4de5-a58b-a1c8b26631df, isClient=true, ver=8.8.5#20210519-sha1:067284c6], TcpDiscoveryNode [id=ed4da489-a29e-460c-83d7-751072a99a5a, consistentId=ed4da489-a29e-460c-83d7-751072a99a5a, isClient=true, ver=8.8.5#20210519-sha1:067284c6]]] [2021/08/19 20:25:23.160] INFO [disco-event-worker-#62] [] - ^-- Baseline [id=0, size=2, online=2, offline=0] [2021/08/19 20:25:23.162] INFO [exchange-worker-#63] [] - Started exchange init [topVer=AffinityTopologyVersion [topVer=77, minorTopVer=0], crd=false, evt=NODE_FAILED, evtNode=b588bb65-6fe8-4aff-8f17-4a9e8733369b, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [2021/08/19 20:25:23.162] INFO [exchange-worker-#63] [] - Finish exchange future [startVer=AffinityTopologyVersion [topVer=77, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=77, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [2021/08/19 20:25:23.162] INFO [exchange-worker-#63] [] - Completed partition exchange [localNode=1dba00ff-bcdf-4b5e-877c-78012f93a080, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=77, minorTopVer=0], evt=NODE_FAILED, evtNode=TcpDiscoveryNode [id=b588bb65-6fe8-4aff-8f17-4a9e8733369b, consistentId=b588bb65-6fe8-4aff-8f17-4a9e8733369b, addrs=ArrayList [10.211.80.15, 127.0.0.1], sockAddrs=HashSet [rhdpg01/10.211.80.15:0, /127.0.0.1:0], discPort=0, order=76, intOrder=42, lastExchangeTime=1629375858082, loc=false, ver=8.8.5#20210519-sha1:067284c6, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=77, minorTopVer=0]] [2021/08/19 20:25:23.162] INFO [exchange-worker-#63] [] - Exchange timings [startVer=AffinityTopologyVersion [topVer=77, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=77, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (0 ms), stage="Exchange done" (0 ms), stage="Total time" (0 ms)] [2021/08/19 20:25:23.162] INFO [exchange-worker-#63] [] - Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=77, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=77, minorTopVer=0]] [2021/08/19 20:25:23.162] INFO [exchange-worker-#63] [] - Finished exchange init [topVer=AffinityTopologyVersion [topVer=77, minorTopVer=0], crd=false] [2021/08/19 20:25:23.163] INFO [exchange-worker-#63] [] - Skipping rebalancing (no affinity changes) [top=AffinityTopologyVersion [topVer=77, minorTopVer=0], evt=NODE_FAILED, evtNode=b588bb65-6fe8-4aff-8f17-4a9e8733369b, client=false] [2021/08/19 20:25:48.573] INFO [disco-event-worker-#62] [] - Added new node to topology: TcpDiscoveryNode [id=49b9fd2e-5f53-402e-a07c-3a49d3fa7b18, consistentId=49b9fd2e-5f53-402e-a07c-3a49d3fa7b18, addrs=ArrayList [10.211.80.15, 127.0.0.1], sockAddrs=HashSet [rhdpg01/10.211.80.15:0, /127.0.0.1:0], discPort=0, order=78, intOrder=43, lastExchangeTime=1629375948565, loc=false, ver=8.8.5#20210519-sha1:067284c6, isClient=true] [2021/08/19 20:25:48.574] INFO [disco-event-worker-#62] [] - Topology snapshot [ver=78, locNode=1dba00ff, servers=2, clients=6, state=ACTIVE, CPUs=48, offheap=11.0GB, heap=46.0GB, aliveNodes=[TcpDiscoveryNode [id=c791881c-983f-44c9-a30b-c9b12e9cb7f6, consistentId=rhdpg03, isClient=false, ver=8.8.5#20210519-sha1:067284c6], TcpDiscoveryNode [id=1dba00ff-bcdf-4b5e-877c-78012f93a080, consistentId=rhdpg04, isClient=false, ver=8.8.5#20210519-sha1:067284c6], TcpDiscoveryNode [id=2e8039fe-6c7e-455f-9774-1879aaa67564, consistentId=2e8039fe-6c7e-455f-9774-1879aaa67564, isClient=true, ver=8.8.5#20210519-sha1:067284c6], TcpDiscoveryNode [id=7d483a80-4ada-4c10-b2e2-3b85a47b2d26, consistentId=7d483a80-4ada-4c10-b2e2-3b85a47b2d26, isClient=true, ver=8.8.5#20210519-sha1:067284c6], TcpDiscoveryNode [id=eceae49c-0325-4f96-878f-9ef6c62e03e6, consistentId=eceae49c-0325-4f96-878f-9ef6c62e03e6, isClient=true, ver=8.8.5#20210519-sha1:067284c6], TcpDiscoveryNode [id=a390ed29-4892-4de5-a58b-a1c8b26631df, consistentId=a390ed29-4892-4de5-a58b-a1c8b26631df, isClient=true, ver=8.8.5#20210519-sha1:067284c6], TcpDiscoveryNode [id=ed4da489-a29e-460c-83d7-751072a99a5a, consistentId=ed4da489-a29e-460c-83d7-751072a99a5a, isClient=true, ver=8.8.5#20210519-sha1:067284c6], TcpDiscoveryNode [id=49b9fd2e-5f53-402e-a07c-3a49d3fa7b18, consistentId=49b9fd2e-5f53-402e-a07c-3a49d3fa7b18, isClient=true, ver=8.8.5#20210519-sha1:067284c6]]] [2021/08/19 20:25:48.574] INFO [disco-event-worker-#62] [] - ^-- Baseline [id=0, size=2, online=2, offline=0] [2021/08/19 20:25:48.574] INFO [exchange-worker-#63] [] - Started exchange init [topVer=AffinityTopologyVersion [topVer=78, minorTopVer=0], crd=false, evt=NODE_JOINED, evtNode=49b9fd2e-5f53-402e-a07c-3a49d3fa7b18, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [2021/08/19 20:25:48.574] INFO [exchange-worker-#63] [] - Finish exchange future [startVer=AffinityTopologyVersion [topVer=78, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=78, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [2021/08/19 20:25:48.575] INFO [exchange-worker-#63] [] - Completed partition exchange [localNode=1dba00ff-bcdf-4b5e-877c-78012f93a080, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=78, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=49b9fd2e-5f53-402e-a07c-3a49d3fa7b18, consistentId=49b9fd2e-5f53-402e-a07c-3a49d3fa7b18, addrs=ArrayList [10.211.80.15, 127.0.0.1], sockAddrs=HashSet [rhdpg01/10.211.80.15:0, /127.0.0.1:0], discPort=0, order=78, intOrder=43, lastExchangeTime=1629375948565, loc=false, ver=8.8.5#20210519-sha1:067284c6, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=78, minorTopVer=0]] [2021/08/19 20:25:48.575] INFO [exchange-worker-#63] [] - Exchange timings [startVer=AffinityTopologyVersion [topVer=78, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=78, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (0 ms), stage="Exchange done" (0 ms), stage="Total time" (0 ms)] [2021/08/19 20:25:48.575] INFO [exchange-worker-#63] [] - Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=78, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=78, minorTopVer=0]] [2021/08/19 20:25:48.575] INFO [exchange-worker-#63] [] - Finished exchange init [topVer=AffinityTopologyVersion [topVer=78, minorTopVer=0], crd=false] [2021/08/19 20:25:48.575] INFO [exchange-worker-#63] [] - Skipping rebalancing (no affinity changes) [top=AffinityTopologyVersion [topVer=78, minorTopVer=0], evt=NODE_JOINED, evtNode=49b9fd2e-5f53-402e-a07c-3a49d3fa7b18, client=false] [2021/08/19 20:26:08.616] INFO [tcp-disco-srvr-[:6200]-#3-#59] [] - TCP discovery accepted incoming connection [rmtAddr=/10.211.80.15, rmtPort=50297] [2021/08/19 20:26:08.616] INFO [tcp-disco-srvr-[:6200]-#3-#59] [] - TCP discovery spawning a new thread for connection [rmtAddr=/10.211.80.15, rmtPort=50297] [2021/08/19 20:26:08.616] INFO [tcp-disco-sock-reader-[]-#91-#330] [] - Started serving remote node connection [rmtAddr=/10.211.80.15:50297, rmtPort=50297] [2021/08/19 20:26:08.617] INFO [tcp-disco-sock-reader-[49b9fd2e 10.211.80.15:50297 client]-#91-#330] [] - Initialized connection with remote client node [nodeId=49b9fd2e-5f53-402e-a07c-3a49d3fa7b18, rmtAddr=/10.211.80.15:50297] [2021/08/19 20:26:24.467] INFO [db-checkpoint-thread-#68] [] - Checkpoint started [checkpointId=0056370b-ccfa-49f7-b8ac-e76a6c0a4c85, startPtr=FileWALPointer [idx=11579, fileOff=35859738, len=40877], checkpointBeforeLockTime=5ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=3ms, checkpointLockHoldTime=4ms, walCpRecordFsyncDuration=12ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=879, reason='timeout'] [2021/08/19 20:26:24.589] INFO [db-checkpoint-thread-#68] [] - Checkpoint finished [cpId=0056370b-ccfa-49f7-b8ac-e76a6c0a4c85, pages=879, markPos=FileWALPointer [idx=11579, fileOff=35859738, len=40877], walSegmentsCovered=[], markDuration=18ms, pagesWrite=114ms, fsync=8ms, total=145ms] [2021/08/19 20:26:41.219] WARN [tcp-disco-client-message-worker-[49b9fd2e 10.211.80.15:50297]-#92-#331] [] - Client node considered as unreachable and will be dropped from cluster, because no metrics update messages received in interval: TcpDiscoverySpi.clientFailureDetectionTimeout() ms. It may be caused by network problems or long GC pause on client node, try to increase this parameter. [nodeId=49b9fd2e-5f53-402e-a07c-3a49d3fa7b18, clientFailureDetectionTimeout=30000] [2021/08/19 20:26:41.222] WARN [disco-event-worker-#62] [] - Node FAILED: TcpDiscoveryNode [id=49b9fd2e-5f53-402e-a07c-3a49d3fa7b18, consistentId=49b9fd2e-5f53-402e-a07c-3a49d3fa7b18, addrs=ArrayList [10.211.80.15, 127.0.0.1], sockAddrs=HashSet [rhdpg01/10.211.80.15:0, /127.0.0.1:0], discPort=0, order=78, intOrder=43, lastExchangeTime=1629375948565, loc=false, ver=8.8.5#20210519-sha1:067284c6, isClient=true] [2021/08/19 20:26:41.222] INFO [disco-event-worker-#62] [] - Topology snapshot [ver=79, locNode=1dba00ff, servers=2, clients=5, state=ACTIVE, CPUs=48, offheap=11.0GB, heap=42.0GB, aliveNodes=[TcpDiscoveryNode [id=c791881c-983f-44c9-a30b-c9b12e9cb7f6, consistentId=rhdpg03, isClient=false, ver=8.8.5#20210519-sha1:067284c6], TcpDiscoveryNode [id=1dba00ff-bcdf-4b5e-877c-78012f93a080, consistentId=rhdpg04, isClient=false, ver=8.8.5#20210519-sha1:067284c6], TcpDiscoveryNode [id=2e8039fe-6c7e-455f-9774-1879aaa67564, consistentId=2e8039fe-6c7e-455f-9774-1879aaa67564, isClient=true, ver=8.8.5#20210519-sha1:067284c6], TcpDiscoveryNode [id=7d483a80-4ada-4c10-b2e2-3b85a47b2d26, consistentId=7d483a80-4ada-4c10-b2e2-3b85a47b2d26, isClient=true, ver=8.8.5#20210519-sha1:067284c6], TcpDiscoveryNode [id=eceae49c-0325-4f96-878f-9ef6c62e03e6, consistentId=eceae49c-0325-4f96-878f-9ef6c62e03e6, isClient=true, ver=8.8.5#20210519-sha1:067284c6], TcpDiscoveryNode [id=a390ed29-4892-4de5-a58b-a1c8b26631df, consistentId=a390ed29-4892-4de5-a58b-a1c8b26631df, isClient=true, ver=8.8.5#20210519-sha1:067284c6], TcpDiscoveryNode [id=ed4da489-a29e-460c-83d7-751072a99a5a, consistentId=ed4da489-a29e-460c-83d7-751072a99a5a, isClient=true, ver=8.8.5#20210519-sha1:067284c6]]] [2021/08/19 20:26:41.222] INFO [disco-event-worker-#62] [] - ^-- Baseline [id=0, size=2, online=2, offline=0] [2021/08/19 20:26:41.224] INFO [exchange-worker-#63] [] - Started exchange init [topVer=AffinityTopologyVersion [topVer=79, minorTopVer=0], crd=false, evt=NODE_FAILED, evtNode=49b9fd2e-5f53-402e-a07c-3a49d3fa7b18, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [2021/08/19 20:26:41.224] INFO [tcp-disco-sock-reader-[49b9fd2e 10.211.80.15:50297 client]-#91-#330] [] - Finished serving remote node connection [rmtAddr=/10.211.80.15:50297, rmtPort=50297, rmtNodeId=49b9fd2e-5f53-402e-a07c-3a49d3fa7b18] [2021/08/19 20:26:41.224] INFO [exchange-worker-#63] [] - Finish exchange future [startVer=AffinityTopologyVersion [topVer=79, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=79, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [2021/08/19 20:26:41.224] INFO [exchange-worker-#63] [] - Completed partition exchange [localNode=1dba00ff-bcdf-4b5e-877c-78012f93a080, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=79, minorTopVer=0], evt=NODE_FAILED, evtNode=TcpDiscoveryNode [id=49b9fd2e-5f53-402e-a07c-3a49d3fa7b18, consistentId=49b9fd2e-5f53-402e-a07c-3a49d3fa7b18, addrs=ArrayList [10.211.80.15, 127.0.0.1], sockAddrs=HashSet [rhdpg01/10.211.80.15:0, /127.0.0.1:0], discPort=0, order=78, intOrder=43, lastExchangeTime=1629375948565, loc=false, ver=8.8.5#20210519-sha1:067284c6, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=79, minorTopVer=0]] [2021/08/19 20:26:41.224] INFO [exchange-worker-#63] [] - Exchange timings [startVer=AffinityTopologyVersion [topVer=79, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=79, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (0 ms), stage="Exchange done" (0 ms), stage="Total time" (0 ms)] [2021/08/19 20:26:41.224] INFO [exchange-worker-#63] [] - Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=79, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=79, minorTopVer=0]] [2021/08/19 20:26:41.225] INFO [exchange-worker-#63] [] - Finished exchange init [topVer=AffinityTopologyVersion [topVer=79, minorTopVer=0], crd=false] [2021/08/19 20:26:41.225] INFO [exchange-worker-#63] [] - Skipping rebalancing (no affinity changes) [top=AffinityTopologyVersion [topVer=79, minorTopVer=0], evt=NODE_FAILED, evtNode=49b9fd2e-5f53-402e-a07c-3a49d3fa7b18, client=false]