[09:50:58] __________ ________________ [09:50:58] / _/ ___/ |/ / _/_ __/ __/ [09:50:58] _/ // (7 7 // / / / / _/ [09:50:58] /___/\___/_/|_/___/ /_/ /___/ [09:50:58] [09:50:58] ver. 2.7.5#20190603-sha1:be4f2a15 [09:50:58] 2018 Copyright(C) Apache Software Foundation [09:50:58] [09:50:58] Ignite documentation: http://ignite.apache.org [09:50:58] [09:50:58] Quiet mode. [09:50:58] ^-- Logging to file 'C:\Users\ad\AppData\Local\Temp\ignite\work\log\ignite-d67eb547.0.log' [09:50:58] ^-- Logging by 'JavaLogger [quiet=true, config=null]' [09:50:58] ^-- To see **FULL** console log here add -DIGNITE_QUIET=false or "-v" to ignite.{sh|bat} [09:50:58] [09:50:58] OS: Windows 10 10.0 amd64 [09:50:58] VM information: Java(TM) SE Runtime Environment 1.8.0_151-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.151-b12 [09:50:58] Please set system property '-Djava.net.preferIPv4Stack=true' to avoid possible problems in mixed environments. [09:50:58] Initial heap size is 128MB (should be no less than 512MB, use -Xms512m -Xmx512m). [09:50:58] Configured plugins: [09:50:58] ^-- None [09:50:58] [09:50:58] Configured failure handler: [hnd=StopNodeOrHaltFailureHandler [tryStop=false, timeout=0, super=AbstractFailureHandler [ignoredFailureTypes=[SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [09:50:58] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [09:50:59] Security status [authentication=off, tls/ssl=off] [09:51:04] Nodes started on local machine require more than 80% of physical RAM what can lead to significant slowdown due to swapping (please decrease JVM heap size, data region size or checkpoint buffer size) [required=12330MB, available=8077MB] [09:51:07] Performance suggestions for grid '1568080257377' (fix if possible) [09:51:07] To disable, set -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true [09:51:07] ^-- Enable G1 Garbage Collector (add '-XX:+UseG1GC' to JVM options) [09:51:07] ^-- Specify JVM heap max size (add '-Xmx[g|G|m|M|k|K]' to JVM options) [09:51:07] ^-- Set max direct memory size if getting 'OOME: Direct buffer memory' (add '-XX:MaxDirectMemorySize=[g|G|m|M|k|K]' to JVM options) [09:51:07] ^-- Disable processing of calls to System.gc() (add '-XX:+DisableExplicitGC' to JVM options) [09:51:07] ^-- Decrease number of backups (set 'backups' to 0) [09:51:07] Refer to this page for more performance suggestions: https://apacheignite.readme.io/docs/jvm-and-system-tuning [09:51:07] [09:51:07] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [09:51:07] Data Regions Configured: [09:51:07] ^-- default [initSize=256.0 MiB, maxSize=1.6 GiB, persistence=false] [09:51:07] [09:51:07] Ignite node started OK (id=d67eb547, instance name=1568080257377) [09:51:07] Topology snapshot [ver=4, locNode=d67eb547, servers=3, clients=1, state=ACTIVE, CPUs=4, offheap=3.2GB, heap=3.5GB] =======active=true ---------- [09:51:07] __________ ________________ [09:51:07] / _/ ___/ |/ / _/_ __/ __/ [09:51:07] _/ // (7 7 // / / / / _/ [09:51:07] /___/\___/_/|_/___/ /_/ /___/ [09:51:07] [09:51:07] ver. 2.7.5#20190603-sha1:be4f2a15 [09:51:07] 2018 Copyright(C) Apache Software Foundation [09:51:07] [09:51:07] Ignite documentation: http://ignite.apache.org [09:51:07] [09:51:07] Quiet mode. [09:51:07] ^-- Logging to file 'C:\Users\ad\AppData\Local\Temp\ignite\work\log\ignite-d67eb547.0.log' [09:51:07] ^-- Logging by 'JavaLogger [quiet=true, config=null]' [09:51:07] ^-- To see **FULL** console log here add -DIGNITE_QUIET=false or "-v" to ignite.{sh|bat} [09:51:07] [09:51:07] OS: Windows 10 10.0 amd64 [09:51:07] VM information: Java(TM) SE Runtime Environment 1.8.0_151-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.151-b12 [09:51:07] Please set system property '-Djava.net.preferIPv4Stack=true' to avoid possible problems in mixed environments. [09:51:07] Configured plugins: [09:51:07] ^-- None [09:51:07] [09:51:07] Configured failure handler: [hnd=StopNodeOrHaltFailureHandler [tryStop=false, timeout=0, super=AbstractFailureHandler [ignoredFailureTypes=[SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [09:51:07] Initial heap size is 128MB (should be no less than 512MB, use -Xms512m -Xmx512m). [09:51:07] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [09:51:07] Security status [authentication=off, tls/ssl=off] [09:51:12] Topology snapshot [ver=5, locNode=d67eb547, servers=4, clients=1, state=ACTIVE, CPUs=4, offheap=3.2GB, heap=3.5GB] [09:51:12] Nodes started on local machine require more than 80% of physical RAM what can lead to significant slowdown due to swapping (please decrease JVM heap size, data region size or checkpoint buffer size) [required=15842MB, available=8077MB] [09:51:13] Performance suggestions for grid '1568080267260' (fix if possible) [09:51:13] To disable, set -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true [09:51:13] ^-- Enable G1 Garbage Collector (add '-XX:+UseG1GC' to JVM options) [09:51:13] ^-- Specify JVM heap max size (add '-Xmx[g|G|m|M|k|K]' to JVM options) [09:51:13] ^-- Set max direct memory size if getting 'OOME: Direct buffer memory' (add '-XX:MaxDirectMemorySize=[g|G|m|M|k|K]' to JVM options) [09:51:13] ^-- Disable processing of calls to System.gc() (add '-XX:+DisableExplicitGC' to JVM options) [09:51:13] ^-- Decrease number of backups (set 'backups' to 0) [09:51:13] Refer to this page for more performance suggestions: https://apacheignite.readme.io/docs/jvm-and-system-tuning [09:51:13] [09:51:13] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [09:51:13] Data Regions Configured: [09:51:13] ^-- default [initSize=256.0 MiB, maxSize=1.6 GiB, persistence=false] [09:51:13] [09:51:13] Ignite node started OK (id=00df516b, instance name=1568080267260) [09:51:13] Topology snapshot [ver=5, locNode=00df516b, servers=4, clients=1, state=ACTIVE, CPUs=4, offheap=3.2GB, heap=3.5GB] =======active=true ---------- [09:51:13] __________ ________________ [09:51:13] / _/ ___/ |/ / _/_ __/ __/ [09:51:13] _/ // (7 7 // / / / / _/ [09:51:13] /___/\___/_/|_/___/ /_/ /___/ [09:51:13] [09:51:13] ver. 2.7.5#20190603-sha1:be4f2a15 [09:51:13] 2018 Copyright(C) Apache Software Foundation [09:51:13] [09:51:13] Ignite documentation: http://ignite.apache.org [09:51:13] [09:51:13] Quiet mode. [09:51:13] ^-- Logging to file 'C:\Users\ad\AppData\Local\Temp\ignite\work\log\ignite-d67eb547.0.log' [09:51:13] ^-- Logging by 'JavaLogger [quiet=true, config=null]' [09:51:13] ^-- To see **FULL** console log here add -DIGNITE_QUIET=false or "-v" to ignite.{sh|bat} [09:51:13] [09:51:13] OS: Windows 10 10.0 amd64 [09:51:13] VM information: Java(TM) SE Runtime Environment 1.8.0_151-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.151-b12 [09:51:13] Please set system property '-Djava.net.preferIPv4Stack=true' to avoid possible problems in mixed environments. [09:51:13] Configured plugins: [09:51:13] ^-- None [09:51:13] [09:51:13] Configured failure handler: [hnd=StopNodeOrHaltFailureHandler [tryStop=false, timeout=0, super=AbstractFailureHandler [ignoredFailureTypes=[SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [09:51:13] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [09:51:13] Security status [authentication=off, tls/ssl=off] [09:51:13] REST protocols do not start on client node. To start the protocols on client node set '-DIGNITE_REST_START_ON_CLIENT=true' system property. [09:51:13] Initial heap size is 128MB (should be no less than 512MB, use -Xms512m -Xmx512m). [09:51:20] Topology snapshot [ver=6, locNode=d67eb547, servers=4, clients=2, state=ACTIVE, CPUs=4, offheap=3.2GB, heap=3.5GB] [09:51:20] Topology snapshot [ver=6, locNode=00df516b, servers=4, clients=2, state=ACTIVE, CPUs=4, offheap=3.2GB, heap=3.5GB] [09:51:20] Nodes started on local machine require more than 80% of physical RAM what can lead to significant slowdown due to swapping (please decrease JVM heap size, data region size or checkpoint buffer size) [required=17638MB, available=8077MB] [09:51:20] Performance suggestions for grid '1568080273231' (fix if possible) [09:51:20] To disable, set -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true [09:51:20] ^-- Enable G1 Garbage Collector (add '-XX:+UseG1GC' to JVM options) [09:51:20] ^-- Specify JVM heap max size (add '-Xmx[g|G|m|M|k|K]' to JVM options) [09:51:20] ^-- Set max direct memory size if getting 'OOME: Direct buffer memory' (add '-XX:MaxDirectMemorySize=[g|G|m|M|k|K]' to JVM options) [09:51:20] ^-- Disable processing of calls to System.gc() (add '-XX:+DisableExplicitGC' to JVM options) [09:51:20] ^-- Decrease number of backups (set 'backups' to 0) [09:51:20] Refer to this page for more performance suggestions: https://apacheignite.readme.io/docs/jvm-and-system-tuning [09:51:20] [09:51:20] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [09:51:20] [09:51:20] Ignite node started OK (id=3416fa15, instance name=1568080273231) [09:51:20] Topology snapshot [ver=6, locNode=3416fa15, servers=4, clients=2, state=ACTIVE, CPUs=4, offheap=1.6GB, heap=3.5GB] =======active=true ---------- [09:52:05,838][SEVERE][grid-nio-worker-tcp-comm-2-#78%1568080267260%][TcpCommunicationSpi] Failed to process selector key [ses=GridSelectorNioSessionImpl [worker=DirectNioClientWorker [super=AbstractNioClientWorker [idx=2, bytesRcvd=12762, bytesSent=1775019, bytesRcvd0=1392, bytesSent0=1307, select=true, super=GridWorker [name=grid-nio-worker-tcp-comm-2, igniteInstanceName=1568080267260, finished=false, heartbeatTs=1568080324449, hashCode=1797829845, interrupted=false, runner=grid-nio-worker-tcp-comm-2-#78%1568080267260%]]], writeBuf=java.nio.DirectByteBuffer[pos=0 lim=32768 cap=32768], readBuf=java.nio.DirectByteBuffer[pos=0 lim=32768 cap=32768], inRecovery=GridNioRecoveryDescriptor [acked=36416, resendCnt=0, rcvCnt=16, sentCnt=36428, reserved=true, lastAck=0, nodeLeft=false, node=TcpDiscoveryNode [id=1f4fa760-efcc-4184-bd0d-73a73f53e2e7, addrs=[127.0.0.1], sockAddrs=[/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1568080272006, loc=false, ver=2.7.5#20190603-sha1:be4f2a15, isClient=true], connected=false, connectCnt=1, queueLimit=4096, reserveCnt=1, pairedConnections=false], outRecovery=GridNioRecoveryDescriptor [acked=36416, resendCnt=0, rcvCnt=16, sentCnt=36428, reserved=true, lastAck=0, nodeLeft=false, node=TcpDiscoveryNode [id=1f4fa760-efcc-4184-bd0d-73a73f53e2e7, addrs=[127.0.0.1], sockAddrs=[/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1568080272006, loc=false, ver=2.7.5#20190603-sha1:be4f2a15, isClient=true], connected=false, connectCnt=1, queueLimit=4096, reserveCnt=1, pairedConnections=false], super=GridNioSessionImpl [locAddr=/127.0.0.1:51741, rmtAddr=/127.0.0.1:47102, createTime=1568080272833, closeTime=0, bytesSent=1775019, bytesRcvd=12762, bytesSent0=1307, bytesRcvd0=1392, sndSchedTime=1568080272833, lastSndTime=1568080324449, lastRcvTime=1568080324361, readsPaused=false, filterChain=FilterChain[filters=[GridNioCodecFilter [parser=o.a.i.i.util.nio.GridDirectParser@344e7a81, directMode=true], GridConnectionBytesVerifyFilter], accepted=false, markedForClose=false]]] java.io.IOException: 远程主机强迫关闭了一个现有的连接。 at sun.nio.ch.SocketDispatcher.read0(Native Method) at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:43) at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223) at sun.nio.ch.IOUtil.read(IOUtil.java:192) at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380) at org.apache.ignite.internal.util.nio.GridNioServer$DirectNioClientWorker.processRead(GridNioServer.java:1282) at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.processSelectedKeysOptimized(GridNioServer.java:2386) at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2153) at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1794) at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) [09:52:05,841][SEVERE][grid-nio-worker-tcp-comm-0-#76%1568080267260%][TcpCommunicationSpi] Failed to process selector key [ses=GridSelectorNioSessionImpl [worker=DirectNioClientWorker [super=AbstractNioClientWorker [idx=0, bytesRcvd=14637249, bytesSent=275834, bytesRcvd0=14814, bytesSent0=3082, select=true, super=GridWorker [name=grid-nio-worker-tcp-comm-0, igniteInstanceName=1568080267260, finished=false, heartbeatTs=1568080324813, hashCode=440102742, interrupted=false, runner=grid-nio-worker-tcp-comm-0-#76%1568080267260%]]], writeBuf=java.nio.DirectByteBuffer[pos=0 lim=32768 cap=32768], readBuf=java.nio.DirectByteBuffer[pos=0 lim=32768 cap=32768], inRecovery=GridNioRecoveryDescriptor [acked=704, resendCnt=0, rcvCnt=28549, sentCnt=730, reserved=true, lastAck=28544, nodeLeft=false, node=TcpDiscoveryNode [id=bf6ca73b-c193-4ee9-b9ae-2776c6b84aaf, addrs=[127.0.0.1], sockAddrs=[/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1568080272006, loc=false, ver=2.7.5#20190603-sha1:be4f2a15, isClient=false], connected=false, connectCnt=1, queueLimit=4096, reserveCnt=1, pairedConnections=false], outRecovery=GridNioRecoveryDescriptor [acked=704, resendCnt=0, rcvCnt=28549, sentCnt=730, reserved=true, lastAck=28544, nodeLeft=false, node=TcpDiscoveryNode [id=bf6ca73b-c193-4ee9-b9ae-2776c6b84aaf, addrs=[127.0.0.1], sockAddrs=[/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1568080272006, loc=false, ver=2.7.5#20190603-sha1:be4f2a15, isClient=false], connected=false, connectCnt=1, queueLimit=4096, reserveCnt=1, pairedConnections=false], super=GridNioSessionImpl [locAddr=/127.0.0.1:51739, rmtAddr=/127.0.0.1:47100, createTime=1568080272328, closeTime=0, bytesSent=273826, bytesRcvd=14635163, bytesSent0=1074, bytesRcvd0=12728, sndSchedTime=1568080272328, lastSndTime=1568080324623, lastRcvTime=1568080324405, readsPaused=false, filterChain=FilterChain[filters=[GridNioCodecFilter [parser=o.a.i.i.util.nio.GridDirectParser@344e7a81, directMode=true], GridConnectionBytesVerifyFilter], accepted=false, markedForClose=false]]] java.io.IOException: 远程主机强迫关闭了一个现有的连接。 at sun.nio.ch.SocketDispatcher.read0(Native Method) at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:43) at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223) at sun.nio.ch.IOUtil.read(IOUtil.java:192) at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380) at org.apache.ignite.internal.util.nio.GridNioServer$DirectNioClientWorker.processRead(GridNioServer.java:1282) at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.processSelectedKeysOptimized(GridNioServer.java:2386) at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2153) at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1794) at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) [09:52:05,842][SEVERE][grid-nio-worker-tcp-comm-0-#132%1568080273231%][TcpCommunicationSpi] Failed to process selector key [ses=GridSelectorNioSessionImpl [worker=DirectNioClientWorker [super=AbstractNioClientWorker [idx=0, bytesRcvd=3670637, bytesSent=2479834, bytesRcvd0=10622, bytesSent0=2433, select=true, super=GridWorker [name=grid-nio-worker-tcp-comm-0, igniteInstanceName=1568080273231, finished=false, heartbeatTs=1568080324416, hashCode=1989808894, interrupted=false, runner=grid-nio-worker-tcp-comm-0-#132%1568080273231%]]], writeBuf=java.nio.DirectByteBuffer[pos=0 lim=32768 cap=32768], readBuf=java.nio.DirectByteBuffer[pos=0 lim=32768 cap=32768], inRecovery=GridNioRecoveryDescriptor [acked=27008, resendCnt=0, rcvCnt=53751, sentCnt=27028, reserved=true, lastAck=53728, nodeLeft=false, node=TcpDiscoveryNode [id=bf6ca73b-c193-4ee9-b9ae-2776c6b84aaf, addrs=[127.0.0.1], sockAddrs=[/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1568080280133, loc=false, ver=2.7.5#20190603-sha1:be4f2a15, isClient=false], connected=false, connectCnt=1, queueLimit=4096, reserveCnt=1, pairedConnections=false], outRecovery=GridNioRecoveryDescriptor [acked=27008, resendCnt=0, rcvCnt=53751, sentCnt=27028, reserved=true, lastAck=53728, nodeLeft=false, node=TcpDiscoveryNode [id=bf6ca73b-c193-4ee9-b9ae-2776c6b84aaf, addrs=[127.0.0.1], sockAddrs=[/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1568080280133, loc=false, ver=2.7.5#20190603-sha1:be4f2a15, isClient=false], connected=false, connectCnt=1, queueLimit=4096, reserveCnt=1, pairedConnections=false], super=GridNioSessionImpl [locAddr=/127.0.0.1:51787, rmtAddr=/127.0.0.1:47100, createTime=1568080280797, closeTime=0, bytesSent=2479834, bytesRcvd=3670637, bytesSent0=2433, bytesRcvd0=10622, sndSchedTime=1568080280797, lastSndTime=1568080324416, lastRcvTime=1568080324262, readsPaused=false, filterChain=FilterChain[filters=[GridNioCodecFilter [parser=o.a.i.i.util.nio.GridDirectParser@6bc75c54, directMode=true], GridConnectionBytesVerifyFilter], accepted=false, markedForClose=false]]] java.io.IOException: 远程主机强迫关闭了一个现有的连接。 at sun.nio.ch.SocketDispatcher.read0(Native Method) at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:43) at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223) at sun.nio.ch.IOUtil.read(IOUtil.java:192) at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380) at org.apache.ignite.internal.util.nio.GridNioServer$DirectNioClientWorker.processRead(GridNioServer.java:1282) at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.processSelectedKeysOptimized(GridNioServer.java:2386) at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2153) at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1794) at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) [09:52:05,844][SEVERE][grid-nio-worker-tcp-comm-1-#25%1568080257377%][TcpCommunicationSpi] Failed to process selector key [ses=GridSelectorNioSessionImpl [worker=DirectNioClientWorker [super=AbstractNioClientWorker [idx=1, bytesRcvd=13823, bytesSent=1956824, bytesRcvd0=1503, bytesSent0=39184, select=true, super=GridWorker [name=grid-nio-worker-tcp-comm-1, igniteInstanceName=1568080257377, finished=false, heartbeatTs=1568080324449, hashCode=579454506, interrupted=false, runner=grid-nio-worker-tcp-comm-1-#25%1568080257377%]]], writeBuf=java.nio.DirectByteBuffer[pos=0 lim=32768 cap=32768], readBuf=java.nio.DirectByteBuffer[pos=0 lim=32768 cap=32768], inRecovery=GridNioRecoveryDescriptor [acked=40224, resendCnt=0, rcvCnt=15, sentCnt=40250, reserved=true, lastAck=0, nodeLeft=false, node=TcpDiscoveryNode [id=1f4fa760-efcc-4184-bd0d-73a73f53e2e7, addrs=[127.0.0.1], sockAddrs=[/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1568080264711, loc=false, ver=2.7.5#20190603-sha1:be4f2a15, isClient=true], connected=false, connectCnt=1, queueLimit=4096, reserveCnt=1, pairedConnections=false], outRecovery=GridNioRecoveryDescriptor [acked=40224, resendCnt=0, rcvCnt=15, sentCnt=40250, reserved=true, lastAck=0, nodeLeft=false, node=TcpDiscoveryNode [id=1f4fa760-efcc-4184-bd0d-73a73f53e2e7, addrs=[127.0.0.1], sockAddrs=[/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1568080264711, loc=false, ver=2.7.5#20190603-sha1:be4f2a15, isClient=true], connected=false, connectCnt=1, queueLimit=4096, reserveCnt=1, pairedConnections=false], super=GridNioSessionImpl [locAddr=/127.0.0.1:51677, rmtAddr=/127.0.0.1:47102, createTime=1568080266177, closeTime=0, bytesSent=1956824, bytesRcvd=13823, bytesSent0=39184, bytesRcvd0=1503, sndSchedTime=1568080266177, lastSndTime=1568080324449, lastRcvTime=1568080324449, readsPaused=false, filterChain=FilterChain[filters=[GridNioCodecFilter [parser=o.a.i.i.util.nio.GridDirectParser@2354abd5, directMode=true], GridConnectionBytesVerifyFilter], accepted=false, markedForClose=false]]] java.io.IOException: 远程主机强迫关闭了一个现有的连接。 at sun.nio.ch.SocketDispatcher.read0(Native Method) at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:43) at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223) at sun.nio.ch.IOUtil.read(IOUtil.java:192) at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380) at org.apache.ignite.internal.util.nio.GridNioServer$DirectNioClientWorker.processRead(GridNioServer.java:1282) at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.processSelectedKeysOptimized(GridNioServer.java:2386) at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2153) at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1794) at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) [09:52:05,847][SEVERE][grid-nio-worker-tcp-comm-1-#77%1568080267260%][TcpCommunicationSpi] Failed to process selector key [ses=GridSelectorNioSessionImpl [worker=DirectNioClientWorker [super=AbstractNioClientWorker [idx=1, bytesRcvd=6153308, bytesSent=328075, bytesRcvd0=2514, bytesSent0=2151, select=true, super=GridWorker [name=grid-nio-worker-tcp-comm-1, igniteInstanceName=1568080267260, finished=false, heartbeatTs=1568080324740, hashCode=174902097, interrupted=false, runner=grid-nio-worker-tcp-comm-1-#77%1568080267260%]]], writeBuf=java.nio.DirectByteBuffer[pos=0 lim=32768 cap=32768], readBuf=java.nio.DirectByteBuffer[pos=0 lim=32768 cap=32768], inRecovery=GridNioRecoveryDescriptor [acked=704, resendCnt=0, rcvCnt=36938, sentCnt=718, reserved=true, lastAck=36928, nodeLeft=false, node=TcpDiscoveryNode [id=ade9a0be-6756-438e-bd5e-d72a6dec0970, addrs=[127.0.0.1], sockAddrs=[/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1568080272006, loc=false, ver=2.7.5#20190603-sha1:be4f2a15, isClient=false], connected=true, connectCnt=0, queueLimit=4096, reserveCnt=1, pairedConnections=false], outRecovery=GridNioRecoveryDescriptor [acked=704, resendCnt=0, rcvCnt=36938, sentCnt=718, reserved=true, lastAck=36928, nodeLeft=false, node=TcpDiscoveryNode [id=ade9a0be-6756-438e-bd5e-d72a6dec0970, addrs=[127.0.0.1], sockAddrs=[/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1568080272006, loc=false, ver=2.7.5#20190603-sha1:be4f2a15, isClient=false], connected=true, connectCnt=0, queueLimit=4096, reserveCnt=1, pairedConnections=false], super=GridNioSessionImpl [locAddr=/127.0.0.1:47104, rmtAddr=/127.0.0.1:51740, createTime=1568080272822, closeTime=0, bytesSent=328075, bytesRcvd=6153308, bytesSent0=2151, bytesRcvd0=2514, sndSchedTime=1568080272822, lastSndTime=1568080324740, lastRcvTime=1568080324416, readsPaused=false, filterChain=FilterChain[filters=[GridNioCodecFilter [parser=o.a.i.i.util.nio.GridDirectParser@344e7a81, directMode=true], GridConnectionBytesVerifyFilter], accepted=true, markedForClose=false]]] java.io.IOException: 远程主机强迫关闭了一个现有的连接。 at sun.nio.ch.SocketDispatcher.read0(Native Method) at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:43) at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223) at sun.nio.ch.IOUtil.read(IOUtil.java:192) at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380) at org.apache.ignite.internal.util.nio.GridNioServer$DirectNioClientWorker.processRead(GridNioServer.java:1282) at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.processSelectedKeysOptimized(GridNioServer.java:2386) at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2153) at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1794) at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) [09:52:05,847][SEVERE][grid-nio-worker-tcp-comm-2-#26%1568080257377%][TcpCommunicationSpi] Failed to process selector key [ses=GridSelectorNioSessionImpl [worker=DirectNioClientWorker [super=AbstractNioClientWorker [idx=2, bytesRcvd=5497627, bytesSent=295253, bytesRcvd0=120630, bytesSent0=11275, select=true, super=GridWorker [name=grid-nio-worker-tcp-comm-2, igniteInstanceName=1568080257377, finished=false, heartbeatTs=1568080324813, hashCode=1241010667, interrupted=false, runner=grid-nio-worker-tcp-comm-2-#26%1568080257377%]]], writeBuf=java.nio.DirectByteBuffer[pos=0 lim=32768 cap=32768], readBuf=java.nio.DirectByteBuffer[pos=0 lim=32768 cap=32768], inRecovery=GridNioRecoveryDescriptor [acked=768, resendCnt=0, rcvCnt=32975, sentCnt=797, reserved=true, lastAck=32960, nodeLeft=false, node=TcpDiscoveryNode [id=ade9a0be-6756-438e-bd5e-d72a6dec0970, addrs=[127.0.0.1], sockAddrs=[/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1568080264728, loc=false, ver=2.7.5#20190603-sha1:be4f2a15, isClient=false], connected=true, connectCnt=0, queueLimit=4096, reserveCnt=1, pairedConnections=false], outRecovery=GridNioRecoveryDescriptor [acked=768, resendCnt=0, rcvCnt=32975, sentCnt=797, reserved=true, lastAck=32960, nodeLeft=false, node=TcpDiscoveryNode [id=ade9a0be-6756-438e-bd5e-d72a6dec0970, addrs=[127.0.0.1], sockAddrs=[/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1568080264728, loc=false, ver=2.7.5#20190603-sha1:be4f2a15, isClient=false], connected=true, connectCnt=0, queueLimit=4096, reserveCnt=1, pairedConnections=false], super=GridNioSessionImpl [locAddr=/127.0.0.1:47103, rmtAddr=/127.0.0.1:51678, createTime=1568080266221, closeTime=0, bytesSent=295253, bytesRcvd=5497627, bytesSent0=11275, bytesRcvd0=120630, sndSchedTime=1568080266221, lastSndTime=1568080324813, lastRcvTime=1568080324438, readsPaused=false, filterChain=FilterChain[filters=[GridNioCodecFilter [parser=o.a.i.i.util.nio.GridDirectParser@2354abd5, directMode=true], GridConnectionBytesVerifyFilter], accepted=true, markedForClose=false]]] java.io.IOException: 远程主机强迫关闭了一个现有的连接。 at sun.nio.ch.SocketDispatcher.read0(Native Method) at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:43) at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223) at sun.nio.ch.IOUtil.read(IOUtil.java:192) at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380) at org.apache.ignite.internal.util.nio.GridNioServer$DirectNioClientWorker.processRead(GridNioServer.java:1282) at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.processSelectedKeysOptimized(GridNioServer.java:2386) at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2153) at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1794) at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) [09:52:05,847][SEVERE][grid-nio-worker-tcp-comm-2-#134%1568080273231%][TcpCommunicationSpi] Failed to process selector key [ses=GridSelectorNioSessionImpl [worker=DirectNioClientWorker [super=AbstractNioClientWorker [idx=2, bytesRcvd=3566704, bytesSent=2599025, bytesRcvd0=1175, bytesSent0=1901, select=true, super=GridWorker [name=grid-nio-worker-tcp-comm-2, igniteInstanceName=1568080273231, finished=false, heartbeatTs=1568080324416, hashCode=352874758, interrupted=false, runner=grid-nio-worker-tcp-comm-2-#134%1568080273231%]]], writeBuf=java.nio.DirectByteBuffer[pos=0 lim=32768 cap=32768], readBuf=java.nio.DirectByteBuffer[pos=0 lim=32768 cap=32768], inRecovery=GridNioRecoveryDescriptor [acked=28320, resendCnt=0, rcvCnt=54609, sentCnt=28322, reserved=true, lastAck=54592, nodeLeft=false, node=TcpDiscoveryNode [id=ade9a0be-6756-438e-bd5e-d72a6dec0970, addrs=[127.0.0.1], sockAddrs=[/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1568080280133, loc=false, ver=2.7.5#20190603-sha1:be4f2a15, isClient=false], connected=false, connectCnt=1, queueLimit=4096, reserveCnt=1, pairedConnections=false], outRecovery=GridNioRecoveryDescriptor [acked=28320, resendCnt=0, rcvCnt=54609, sentCnt=28322, reserved=true, lastAck=54592, nodeLeft=false, node=TcpDiscoveryNode [id=ade9a0be-6756-438e-bd5e-d72a6dec0970, addrs=[127.0.0.1], sockAddrs=[/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1568080280133, loc=false, ver=2.7.5#20190603-sha1:be4f2a15, isClient=false], connected=false, connectCnt=1, queueLimit=4096, reserveCnt=1, pairedConnections=false], super=GridNioSessionImpl [locAddr=/127.0.0.1:51789, rmtAddr=/127.0.0.1:47101, createTime=1568080281382, closeTime=0, bytesSent=2599025, bytesRcvd=3566704, bytesSent0=1901, bytesRcvd0=1175, sndSchedTime=1568080281382, lastSndTime=1568080324416, lastRcvTime=1568080324405, readsPaused=false, filterChain=FilterChain[filters=[GridNioCodecFilter [parser=o.a.i.i.util.nio.GridDirectParser@6bc75c54, directMode=true], GridConnectionBytesVerifyFilter], accepted=false, markedForClose=false]]] java.io.IOException: 远程主机强迫关闭了一个现有的连接。 at sun.nio.ch.SocketDispatcher.read0(Native Method) at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:43) at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223) at sun.nio.ch.IOUtil.read(IOUtil.java:192) at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380) at org.apache.ignite.internal.util.nio.GridNioServer$DirectNioClientWorker.processRead(GridNioServer.java:1282) at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.processSelectedKeysOptimized(GridNioServer.java:2386) at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2153) at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1794) at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) [09:52:05,847][SEVERE][grid-nio-worker-tcp-comm-0-#24%1568080257377%][TcpCommunicationSpi] Failed to process selector key [ses=GridSelectorNioSessionImpl [worker=DirectNioClientWorker [super=AbstractNioClientWorker [idx=0, bytesRcvd=15970558, bytesSent=357536, bytesRcvd0=172939, bytesSent0=19482, select=true, super=GridWorker [name=grid-nio-worker-tcp-comm-0, igniteInstanceName=1568080257377, finished=false, heartbeatTs=1568080324813, hashCode=1327448199, interrupted=false, runner=grid-nio-worker-tcp-comm-0-#24%1568080257377%]]], writeBuf=java.nio.DirectByteBuffer[pos=0 lim=32768 cap=32768], readBuf=java.nio.DirectByteBuffer[pos=0 lim=32768 cap=32768], inRecovery=GridNioRecoveryDescriptor [acked=800, resendCnt=0, rcvCnt=35460, sentCnt=819, reserved=true, lastAck=35456, nodeLeft=false, node=TcpDiscoveryNode [id=bf6ca73b-c193-4ee9-b9ae-2776c6b84aaf, addrs=[127.0.0.1], sockAddrs=[/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1568080264728, loc=false, ver=2.7.5#20190603-sha1:be4f2a15, isClient=false], connected=false, connectCnt=1, queueLimit=4096, reserveCnt=1, pairedConnections=false], outRecovery=GridNioRecoveryDescriptor [acked=800, resendCnt=0, rcvCnt=35460, sentCnt=819, reserved=true, lastAck=35456, nodeLeft=false, node=TcpDiscoveryNode [id=bf6ca73b-c193-4ee9-b9ae-2776c6b84aaf, addrs=[127.0.0.1], sockAddrs=[/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1568080264728, loc=false, ver=2.7.5#20190603-sha1:be4f2a15, isClient=false], connected=false, connectCnt=1, queueLimit=4096, reserveCnt=1, pairedConnections=false], super=GridNioSessionImpl [locAddr=/127.0.0.1:51676, rmtAddr=/127.0.0.1:47100, createTime=1568080265465, closeTime=0, bytesSent=355422, bytesRcvd=15968508, bytesSent0=17368, bytesRcvd0=170889, sndSchedTime=1568080265465, lastSndTime=1568080324612, lastRcvTime=1568080324416, readsPaused=false, filterChain=FilterChain[filters=[GridNioCodecFilter [parser=o.a.i.i.util.nio.GridDirectParser@2354abd5, directMode=true], GridConnectionBytesVerifyFilter], accepted=false, markedForClose=false]]] java.io.IOException: 远程主机强迫关闭了一个现有的连接。 at sun.nio.ch.SocketDispatcher.read0(Native Method) at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:43) at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223) at sun.nio.ch.IOUtil.read(IOUtil.java:192) at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380) at org.apache.ignite.internal.util.nio.GridNioServer$DirectNioClientWorker.processRead(GridNioServer.java:1282) at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.processSelectedKeysOptimized(GridNioServer.java:2386) at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2153) at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1794) at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) [09:52:05] Topology snapshot [ver=7, locNode=d67eb547, servers=3, clients=2, state=ACTIVE, CPUs=4, offheap=3.2GB, heap=3.5GB] [09:52:05] Topology snapshot [ver=7, locNode=00df516b, servers=3, clients=2, state=ACTIVE, CPUs=4, offheap=3.2GB, heap=3.5GB] [09:52:05] Coordinator changed [prev=TcpDiscoveryNode [id=bf6ca73b-c193-4ee9-b9ae-2776c6b84aaf, addrs=[127.0.0.1], sockAddrs=[/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1568080264728, loc=false, ver=2.7.5#20190603-sha1:be4f2a15, isClient=false], cur=TcpDiscoveryNode [id=ade9a0be-6756-438e-bd5e-d72a6dec0970, addrs=[127.0.0.1], sockAddrs=[/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1568080264728, loc=false, ver=2.7.5#20190603-sha1:be4f2a15, isClient=false]] [09:52:05] Topology snapshot [ver=7, locNode=3416fa15, servers=3, clients=2, state=ACTIVE, CPUs=4, offheap=1.6GB, heap=3.5GB] [09:52:05] Coordinator changed [prev=TcpDiscoveryNode [id=bf6ca73b-c193-4ee9-b9ae-2776c6b84aaf, addrs=[127.0.0.1], sockAddrs=[/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1568080280133, loc=false, ver=2.7.5#20190603-sha1:be4f2a15, isClient=false], cur=TcpDiscoveryNode [id=ade9a0be-6756-438e-bd5e-d72a6dec0970, addrs=[127.0.0.1], sockAddrs=[/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1568080280133, loc=false, ver=2.7.5#20190603-sha1:be4f2a15, isClient=false]] [09:52:05] Coordinator changed [prev=TcpDiscoveryNode [id=bf6ca73b-c193-4ee9-b9ae-2776c6b84aaf, addrs=[127.0.0.1], sockAddrs=[/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1568080272006, loc=false, ver=2.7.5#20190603-sha1:be4f2a15, isClient=false], cur=TcpDiscoveryNode [id=ade9a0be-6756-438e-bd5e-d72a6dec0970, addrs=[127.0.0.1], sockAddrs=[/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1568080272006, loc=false, ver=2.7.5#20190603-sha1:be4f2a15, isClient=false]] [09:52:05] Topology snapshot [ver=8, locNode=3416fa15, servers=2, clients=2, state=ACTIVE, CPUs=4, offheap=0.1GB, heap=3.5GB] [09:52:05] Topology snapshot [ver=8, locNode=d67eb547, servers=2, clients=2, state=ACTIVE, CPUs=4, offheap=1.6GB, heap=3.5GB] [09:52:05] Coordinator changed [prev=TcpDiscoveryNode [id=ade9a0be-6756-438e-bd5e-d72a6dec0970, addrs=[127.0.0.1], sockAddrs=[/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1568080280133, loc=false, ver=2.7.5#20190603-sha1:be4f2a15, isClient=false], cur=TcpDiscoveryNode [id=d67eb547-9ecd-4b32-843b-23a118d696aa, addrs=[127.0.0.1], sockAddrs=[/127.0.0.1:47502], discPort=47502, order=4, intOrder=4, lastExchangeTime=1568080280133, loc=false, ver=2.7.5#20190603-sha1:be4f2a15, isClient=false]] [09:52:05] Coordinator changed [prev=TcpDiscoveryNode [id=ade9a0be-6756-438e-bd5e-d72a6dec0970, addrs=[127.0.0.1], sockAddrs=[/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1568080264728, loc=false, ver=2.7.5#20190603-sha1:be4f2a15, isClient=false], cur=TcpDiscoveryNode [id=d67eb547-9ecd-4b32-843b-23a118d696aa, addrs=[127.0.0.1], sockAddrs=[/127.0.0.1:47502], discPort=47502, order=4, intOrder=4, lastExchangeTime=1568080325920, loc=true, ver=2.7.5#20190603-sha1:be4f2a15, isClient=false]] [09:52:05] Topology snapshot [ver=8, locNode=00df516b, servers=2, clients=2, state=ACTIVE, CPUs=4, offheap=1.6GB, heap=3.5GB] [09:52:05] Coordinator changed [prev=TcpDiscoveryNode [id=ade9a0be-6756-438e-bd5e-d72a6dec0970, addrs=[127.0.0.1], sockAddrs=[/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1568080272006, loc=false, ver=2.7.5#20190603-sha1:be4f2a15, isClient=false], cur=TcpDiscoveryNode [id=d67eb547-9ecd-4b32-843b-23a118d696aa, addrs=[127.0.0.1], sockAddrs=[/127.0.0.1:47502], discPort=47502, order=4, intOrder=4, lastExchangeTime=1568080272006, loc=false, ver=2.7.5#20190603-sha1:be4f2a15, isClient=false]] [09:52:05,990][SEVERE][exchange-worker-#146%1568080273231%][TcpCommunicationSpi] Failed to send message to remote node [node=TcpDiscoveryNode [id=ade9a0be-6756-438e-bd5e-d72a6dec0970, addrs=[127.0.0.1], sockAddrs=[/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1568080280133, loc=false, ver=2.7.5#20190603-sha1:be4f2a15, isClient=false], msg=GridIoMessage [plc=2, topic=TOPIC_CACHE, topicOrd=8, ordered=false, timeout=0, skipOnTimeout=false, msg=GridDhtPartitionsSingleMessage [parts=null, partCntrs=null, partsSizes=null, partHistCntrs=null, err=null, client=true, compress=true, finishMsg=null, activeQryTrackers=GridLongList [idx=0, arr=[]], super=GridDhtPartitionsAbstractMessage [exchId=GridDhtPartitionExchangeId [topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], discoEvt=DiscoveryEvent [evtNode=TcpDiscoveryNode [id=bf6ca73b-c193-4ee9-b9ae-2776c6b84aaf, addrs=[127.0.0.1], sockAddrs=[/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1568080280133, loc=false, ver=2.7.5#20190603-sha1:be4f2a15, isClient=false], topVer=7, nodeId8=3416fa15, msg=Node failed: TcpDiscoveryNode [id=bf6ca73b-c193-4ee9-b9ae-2776c6b84aaf, addrs=[127.0.0.1], sockAddrs=[/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1568080280133, loc=false, ver=2.7.5#20190603-sha1:be4f2a15, isClient=false], type=NODE_FAILED, tstamp=1568080325931], nodeId=bf6ca73b, evt=NODE_FAILED], lastVer=GridCacheVersion [topVer=179560070, order=1568080331100, nodeOrder=6], super=GridCacheMessage [msgId=192358, depInfo=null, err=null, skipPrepare=false]]]]] class org.apache.ignite.internal.cluster.ClusterTopologyCheckedException: Failed to send message (node left topology): TcpDiscoveryNode [id=ade9a0be-6756-438e-bd5e-d72a6dec0970, addrs=[127.0.0.1], sockAddrs=[/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1568080280133, loc=false, ver=2.7.5#20190603-sha1:be4f2a15, isClient=false] at org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.createTcpClient(TcpCommunicationSpi.java:3270) at org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.createNioClient(TcpCommunicationSpi.java:2987) at org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.reserveClient(TcpCommunicationSpi.java:2870) at org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.sendMessage0(TcpCommunicationSpi.java:2713) at org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.sendMessage(TcpCommunicationSpi.java:2672) at org.apache.ignite.internal.managers.communication.GridIoManager.send(GridIoManager.java:1656) at org.apache.ignite.internal.managers.communication.GridIoManager.sendToGridTopic(GridIoManager.java:1731) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.send(GridCacheIoManager.java:1170) at org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture.sendLocalPartitions(GridDhtPartitionsExchangeFuture.java:1883) at org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture.clientOnlyExchange(GridDhtPartitionsExchangeFuture.java:1335) at org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture.init(GridDhtPartitionsExchangeFuture.java:818) at org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$ExchangeWorker.body0(GridCachePartitionExchangeManager.java:2668) at org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$ExchangeWorker.body(GridCachePartitionExchangeManager.java:2540) at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) [09:52:06,031][SEVERE][exchange-worker-#97%1568080267260%][TcpCommunicationSpi] Failed to send message to remote node [node=TcpDiscoveryNode [id=ade9a0be-6756-438e-bd5e-d72a6dec0970, addrs=[127.0.0.1], sockAddrs=[/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1568080272006, loc=false, ver=2.7.5#20190603-sha1:be4f2a15, isClient=false], msg=GridIoMessage [plc=2, topic=TOPIC_CACHE, topicOrd=8, ordered=false, timeout=0, skipOnTimeout=false, msg=GridDhtPartitionsSingleMessage [parts={110251491=GridDhtPartitionMap [moving=0, top=AffinityTopologyVersion [topVer=6, minorTopVer=1], updateSeq=554, size=537], -2100569601=GridDhtPartitionMap [moving=0, top=AffinityTopologyVersion [topVer=6, minorTopVer=1], updateSeq=116, size=100], -1422500400=GridDhtPartitionMap [moving=0, top=AffinityTopologyVersion [topVer=6, minorTopVer=1], updateSeq=553, size=0], -1365813811=GridDhtPartitionMap [moving=0, top=AffinityTopologyVersion [topVer=6, minorTopVer=1], updateSeq=554, size=0]}, partCntrs={110251491=CachePartitionPartialCountersMap {}, -2100569601=CachePartitionPartialCountersMap {}, -1422500400=CachePartitionPartialCountersMap {0=(0,497), 2=(0,497), 12=(0,497), 13=(0,497), 14=(0,497), 15=(0,497), 17=(0,497), 18=(0,497), 20=(0,497), 22=(0,497), 23=(0,497), 26=(0,497), 28=(0,497), 29=(0,497), 31=(0,497), 33=(0,498), 34=(0,498), 39=(0,498), 40=(0,498), 42=(0,498), 43=(0,498), 45=(0,498), 46=(0,498), 48=(0,498), 49=(0,498), 52=(0,498), 55=(0,498), 56=(0,498), 57=(0,498), 59=(0,498), 61=(0,498), 63=(0,498), 64=(0,498), 65=(0,498), 66=(0,498), 68=(0,498), 70=(0,498), 72=(0,498), 74=(0,498), 75=(0,498), 77=(0,498), 80=(0,498), 84=(0,498), 85=(0,498), 86=(0,498), 91=(0,498), 92=(0,498), 93=(0,498), 95=(0,498), 96=(0,498), 99=(0,498), 101=(0,498), 102=(0,498), 103=(0,498), 104=(0,498), 105=(0,498), 107=(0,498), 111=(0,498), 112=(0,498), 113=(0,498), 115=(0,498), 118=(0,498), 119=(0,498), 120=(0,498), 123=(0,498), 124=(0,498), 128=(0,498), 129=(0,498), 133=(0,498), 135=(0,498), 139=(0,498), 141=(0,498), 143=(0,498), 145=(0,498), 146=(0,498), 147=(0,498), 149=(0,498), 151=(0,498), 153=(0,498), 157=(0,498), 162=(0,499), 163=(0,499), 167=(0,499), 169=(0,499), 170=(0,499), 171=(0,499), 172=(0,499), 173=(0,499), 175=(0,499), 176=(0,499), 179=(0,499), 180=(0,499), 183=(0,499), 185=(0,499), 187=(0,499), 193=(0,499), 194=(0,499), 196=(0,499), 197=(0,499), 198=(0,499), 199=(0,499), 200=(0,499), 201=(0,499), 202=(0,499), 203=(0,499), 206=(0,499), 207=(0,499), 208=(0,499), 209=(0,499), 211=(0,499), 212=(0,499), 214=(0,499), 215=(0,499), 216=(0,499), 217=(0,499), 218=(0,499), 219=(0,499), 220=(0,499), 221=(0,499), 223=(0,499), 224=(0,499), 227=(0,499), 228=(0,499), 231=(0,499), 232=(0,499), 233=(0,499), 234=(0,499), 236=(0,499), 237=(0,499), 238=(0,499), 241=(0,499), 244=(0,499), 246=(0,499), 247=(0,499), 252=(0,499), 253=(0,499), 254=(0,499), 255=(0,499), 256=(0,499), 258=(0,499), 259=(0,499), 261=(0,499), 265=(0,499), 270=(0,499), 271=(0,499), 272=(0,499), 274=(0,499), 277=(0,499), 278=(0,499), 279=(0,499), 281=(0,499), 282=(0,499), 284=(0,499), 287=(0,499), 290=(0,499), 291=(0,499), 293=(0,499), 294=(0,499), 295=(0,499), 297=(0,499), 298=(0,499), 301=(0,499), 302=(0,499), 303=(0,499), 305=(0,499), 308=(0,499), 309=(0,499), 310=(0,499), 311=(0,499), 313=(0,499), 320=(0,499), 323=(0,499), 326=(0,499), 327=(0,499), 328=(0,499), 329=(0,499), 331=(0,499), 332=(0,499), 333=(0,499), 339=(0,499), 340=(0,499), 341=(0,499), 342=(0,499), 344=(0,499), 346=(0,499), 347=(0,499), 349=(0,499), 350=(0,499), 351=(0,499), 354=(0,499), 355=(0,499), 356=(0,499), 357=(0,499), 359=(0,499), 360=(0,499), 361=(0,499), 364=(0,499), 365=(0,499), 367=(0,499), 369=(0,499), 370=(0,499), 373=(0,499), 376=(0,499), 377=(0,499), 378=(0,499), 379=(0,499), 383=(0,499), 385=(0,499), 386=(0,499), 388=(0,499), 389=(0,499), 391=(0,499), 392=(0,499), 393=(0,499), 396=(0,499), 397=(0,499), 400=(0,499), 402=(0,499), 404=(0,499), 407=(0,499), 408=(0,499), 411=(0,499), 413=(0,499), 414=(0,499), 415=(0,499), 417=(0,499), 418=(0,499), 419=(0,499), 421=(0,499), 422=(0,499), 423=(0,499), 424=(0,499), 430=(0,498), 431=(0,498), 432=(0,498), 434=(0,498), 435=(0,498), 436=(0,498), 437=(0,498), 438=(0,498), 440=(0,498), 442=(0,498), 447=(0,498), 448=(0,498), 450=(0,498), 453=(0,498), 454=(0,498), 455=(0,498), 456=(0,498), 459=(0,498), 460=(0,498), 463=(0,498), 464=(0,498), 466=(0,498), 468=(0,498), 469=(0,498), 477=(0,498), 478=(0,498), 479=(0,498), 480=(0,497), 482=(0,497), 485=(0,497), 487=(0,497), 489=(0,497), 490=(0,497), 491=(0,497), 492=(0,497), 493=(0,497), 494=(0,497), 495=(0,497), 496=(0,497), 497=(0,497), 498=(0,497), 502=(0,497), 503=(0,497), 504=(0,497), 505=(0,497), 506=(0,497), 508=(0,497), 510=(0,497), 511=(0,497), 515=(0,497), 516=(0,497), 518=(0,497), 523=(0,497), 524=(0,497), 525=(0,497), 526=(0,497), 528=(0,496), 532=(0,496), 533=(0,496), 534=(0,496), 536=(0,496), 537=(0,496), 539=(0,496), 540=(0,496), 542=(0,496), 545=(0,496), 546=(0,496), 547=(0,496), 549=(0,496), 550=(0,496), 552=(0,496), 553=(0,496), 555=(0,496), 558=(0,496), 559=(0,496), 560=(0,496), 561=(0,496), 563=(0,496), 565=(0,496), 566=(0,496), 568=(0,496), 570=(0,496), 572=(0,496), 574=(0,496), 576=(0,496), 577=(0,496), 578=(0,496), 579=(0,496), 580=(0,496), 581=(0,496), 582=(0,496), 584=(0,496), 585=(0,496), 587=(0,496), 588=(0,496), 592=(0,496), 597=(0,496), 598=(0,496), 601=(0,496), 602=(0,496), 603=(0,496), 604=(0,496), 607=(0,496), 610=(0,496), 612=(0,496), 613=(0,496), 616=(0,496), 617=(0,496), 618=(0,496), 622=(0,496), 624=(0,496), 626=(0,496), 627=(0,496), 629=(0,496), 632=(0,496), 637=(0,496), 639=(0,496), 640=(0,496), 641=(0,496), 643=(0,496), 650=(0,496), 651=(0,496), 654=(0,496), 655=(0,496), 656=(0,496), 657=(0,496), 658=(0,496), 660=(0,496), 661=(0,496), 663=(0,496), 665=(0,496), 668=(0,496), 671=(0,496), 672=(0,496), 673=(0,496), 674=(0,496), 675=(0,496), 679=(0,496), 680=(0,496), 685=(0,496), 686=(0,496), 687=(0,496), 688=(0,496), 689=(0,496), 690=(0,496), 691=(0,496), 695=(0,496), 699=(0,496), 703=(0,496), 704=(0,496), 705=(0,496), 706=(0,496), 707=(0,496), 708=(0,496), 710=(0,496), 712=(0,496), 713=(0,496), 714=(0,496), 716=(0,496), 717=(0,496), 718=(0,496), 730=(0,496), 731=(0,496), 732=(0,496), 737=(0,495), 738=(0,495), 741=(0,496), 742=(0,495), 743=(0,496), 745=(0,495), 746=(0,495), 747=(0,495), 749=(0,495), 751=(0,495), 752=(0,495), 754=(0,495), 759=(0,495), 761=(0,495), 766=(0,495), 767=(0,495), 773=(0,495), 774=(0,495), 775=(0,495), 777=(0,495), 780=(0,495), 783=(0,495), 784=(0,495), 785=(0,495), 787=(0,495), 788=(0,495), 794=(0,495), 796=(0,495), 797=(0,495), 800=(0,495), 802=(0,495), 804=(0,495), 806=(0,495), 807=(0,495), 808=(0,495), 809=(0,495), 810=(0,495), 813=(0,495), 814=(0,495), 815=(0,495), 819=(0,495), 820=(0,495), 822=(0,495), 824=(0,495), 826=(0,495), 830=(0,495), 831=(0,495), 832=(0,495), 833=(0,495), 837=(0,495), 841=(0,495), 842=(0,495), 843=(0,495), 846=(0,495), 848=(0,495), 849=(0,495), 853=(0,495), 854=(0,495), 856=(0,495), 858=(0,495), 860=(0,495), 861=(0,495), 862=(0,495), 864=(0,495), 868=(0,495), 869=(0,495), 872=(0,495), 873=(0,495), 875=(0,495), 876=(0,495), 880=(0,495), 882=(0,495), 883=(0,495), 887=(0,495), 888=(0,495), 890=(0,495), 891=(0,495), 896=(0,495), 899=(0,495), 901=(0,495), 902=(0,495), 903=(0,495), 905=(0,495), 909=(0,495), 911=(0,495), 912=(0,495), 913=(0,495), 914=(0,495), 915=(0,495), 918=(0,495), 920=(0,495), 921=(0,495), 922=(0,495), 925=(0,495), 926=(0,495), 927=(0,495), 929=(0,495), 931=(0,495), 932=(0,495), 934=(0,495), 936=(0,495), 937=(0,495), 938=(0,495), 940=(0,495), 941=(0,495), 943=(0,495), 949=(0,495), 950=(0,495), 951=(0,495), 952=(0,495), 953=(0,495), 954=(0,495), 957=(0,495), 959=(0,495), 962=(0,495), 964=(0,495), 966=(0,495), 969=(0,495), 972=(0,495), 975=(0,495), 977=(0,495), 980=(0,495), 983=(0,495), 984=(0,495), 985=(0,495), 987=(0,495), 988=(0,495), 990=(0,495), 991=(0,495), 992=(0,495), 994=(0,495), 997=(0,495), 1003=(0,495), 1005=(0,495), 1006=(0,495), 1007=(0,495), 1008=(0,495), 1010=(0,495), 1012=(0,495), 1014=(0,495), 1017=(0,495)}, -1365813811=CachePartitionPartialCountersMap {}}, partsSizes={-1422500400={0=297, 2=297, 12=297, 13=297, 14=297, 15=297, 17=297, 18=297, 20=297, 22=297, 23=297, 26=297, 28=297, 29=297, 31=297, 33=296, 34=296, 39=296, 40=296, 42=296, 43=296, 45=296, 46=296, 48=296, 49=296, 52=... and 2129 skipped ...6, 813=296, 814=296, 815=296, 819=296, 820=296, 822=296, 824=297, 826=297, 830=297, 831=297, 832=297, 833=297, 837=297, 841=297, 842=297, 843=297, 846=297, 848=297, 849=297, 853=297, 854=297, 856=297, 858=297, 860=297, 861=297, 862=297, 864=297, 868=297, 869=297, 872=297, 873=297, 875=297, 876=297, 880=297, 882=297, 883=297, 887=297, 888=297, 890=297, 891=297, 896=297, 899=297, 901=297, 902=297, 903=297, 905=297, 909=297, 911=297, 912=297, 913=297, 914=297, 915=297, 918=297, 920=297, 921=297, 922=297, 925=297, 926=297, 927=297, 929=297, 931=297, 932=297, 934=297, 936=297, 937=297, 938=297, 940=297, 941=297, 943=297, 949=297, 950=297, 951=297, 952=297, 953=297, 954=297, 957=297, 959=297, 962=297, 964=297, 966=297, 969=297, 972=297, 975=297, 977=297, 980=297, 983=297, 984=297, 985=297, 987=297, 988=297, 990=297, 991=297, 992=297, 994=297, 997=297, 1003=297, 1005=297, 1006=297, 1007=297, 1008=297, 1010=297, 1012=297, 1014=297, 1017=297}}, partHistCntrs=null, err=null, client=false, compress=true, finishMsg=null, activeQryTrackers=GridLongList [idx=0, arr=[]], super=GridDhtPartitionsAbstractMessage [exchId=GridDhtPartitionExchangeId [topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], discoEvt=DiscoveryEvent [evtNode=TcpDiscoveryNode [id=bf6ca73b-c193-4ee9-b9ae-2776c6b84aaf, addrs=[127.0.0.1], sockAddrs=[/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1568080272006, loc=false, ver=2.7.5#20190603-sha1:be4f2a15, isClient=false], topVer=7, nodeId8=00df516b, msg=Node failed: TcpDiscoveryNode [id=bf6ca73b-c193-4ee9-b9ae-2776c6b84aaf, addrs=[127.0.0.1], sockAddrs=[/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1568080272006, loc=false, ver=2.7.5#20190603-sha1:be4f2a15, isClient=false], type=NODE_FAILED, tstamp=1568080325931], nodeId=bf6ca73b, evt=NODE_FAILED], lastVer=GridCacheVersion [topVer=179560072, order=1568080337863, nodeOrder=5], super=GridCacheMessage [msgId=192364, depInfo=null, err=null, skipPrepare=false]]]]] class org.apache.ignite.internal.cluster.ClusterTopologyCheckedException: Failed to send message (node left topology): TcpDiscoveryNode [id=ade9a0be-6756-438e-bd5e-d72a6dec0970, addrs=[127.0.0.1], sockAddrs=[/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1568080272006, loc=false, ver=2.7.5#20190603-sha1:be4f2a15, isClient=false] at org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.createTcpClient(TcpCommunicationSpi.java:3270) at org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.createNioClient(TcpCommunicationSpi.java:2987) at org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.reserveClient(TcpCommunicationSpi.java:2870) at org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.sendMessage0(TcpCommunicationSpi.java:2713) at org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.sendMessage(TcpCommunicationSpi.java:2672) at org.apache.ignite.internal.managers.communication.GridIoManager.send(GridIoManager.java:1656) at org.apache.ignite.internal.managers.communication.GridIoManager.sendToGridTopic(GridIoManager.java:1731) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.send(GridCacheIoManager.java:1170) at org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture.sendLocalPartitions(GridDhtPartitionsExchangeFuture.java:1883) at org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture.sendPartitions(GridDhtPartitionsExchangeFuture.java:2014) at org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture.distributedExchange(GridDhtPartitionsExchangeFuture.java:1504) at org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture.init(GridDhtPartitionsExchangeFuture.java:809) at org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$ExchangeWorker.body0(GridCachePartitionExchangeManager.java:2668) at org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$ExchangeWorker.body(GridCachePartitionExchangeManager.java:2540) at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) [09:52:06,054][SEVERE][exchange-worker-#43%1568080257377%][TcpCommunicationSpi] Failed to send message to remote node [node=TcpDiscoveryNode [id=ade9a0be-6756-438e-bd5e-d72a6dec0970, addrs=[127.0.0.1], sockAddrs=[/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1568080264728, loc=false, ver=2.7.5#20190603-sha1:be4f2a15, isClient=false], msg=GridIoMessage [plc=2, topic=TOPIC_CACHE, topicOrd=8, ordered=false, timeout=0, skipOnTimeout=false, msg=GridDhtPartitionsSingleMessage [parts={110251491=GridDhtPartitionMap [moving=0, top=AffinityTopologyVersion [topVer=6, minorTopVer=1], updateSeq=729, size=521], -2100569601=GridDhtPartitionMap [moving=0, top=AffinityTopologyVersion [topVer=6, minorTopVer=1], updateSeq=120, size=100], -1422500400=GridDhtPartitionMap [moving=0, top=AffinityTopologyVersion [topVer=6, minorTopVer=1], updateSeq=540, size=0], -1365813811=GridDhtPartitionMap [moving=0, top=AffinityTopologyVersion [topVer=6, minorTopVer=1], updateSeq=729, size=0]}, partCntrs={110251491=CachePartitionPartialCountersMap {}, -2100569601=CachePartitionPartialCountersMap {}, -1422500400=CachePartitionPartialCountersMap {4=(0,497), 5=(0,497), 6=(0,497), 7=(0,497), 8=(0,497), 10=(0,497), 11=(0,497), 14=(0,497), 16=(0,497), 17=(0,497), 18=(0,497), 19=(0,497), 22=(0,497), 23=(0,497), 24=(0,497), 26=(0,497), 27=(0,497), 30=(0,497), 35=(0,498), 36=(0,498), 37=(0,498), 38=(0,498), 39=(0,498), 41=(0,498), 44=(0,498), 45=(0,498), 47=(0,498), 49=(0,498), 51=(0,498), 54=(0,498), 57=(0,498), 58=(0,498), 59=(0,498), 60=(0,498), 62=(0,498), 67=(0,498), 68=(0,498), 69=(0,498), 71=(0,498), 73=(0,498), 75=(0,498), 76=(0,498), 79=(0,498), 81=(0,498), 83=(0,498), 87=(0,498), 88=(0,498), 90=(0,498), 91=(0,498), 94=(0,498), 95=(0,498), 97=(0,498), 98=(0,498), 100=(0,498), 101=(0,498), 103=(0,498), 105=(0,498), 106=(0,498), 110=(0,498), 112=(0,498), 114=(0,498), 117=(0,498), 118=(0,498), 121=(0,498), 125=(0,498), 126=(0,498), 128=(0,498), 131=(0,498), 132=(0,498), 133=(0,498), 136=(0,498), 138=(0,498), 139=(0,498), 140=(0,498), 141=(0,498), 142=(0,498), 143=(0,498), 144=(0,498), 147=(0,498), 150=(0,498), 152=(0,498), 154=(0,498), 155=(0,498), 156=(0,498), 158=(0,498), 159=(0,498), 161=(0,499), 162=(0,499), 164=(0,499), 168=(0,499), 169=(0,499), 170=(0,499), 173=(0,499), 174=(0,499), 177=(0,499), 178=(0,499), 179=(0,499), 182=(0,499), 184=(0,499), 189=(0,499), 190=(0,499), 192=(0,499), 193=(0,499), 195=(0,499), 200=(0,499), 204=(0,499), 208=(0,499), 212=(0,499), 213=(0,499), 219=(0,499), 221=(0,499), 222=(0,499), 223=(0,499), 225=(0,499), 226=(0,499), 229=(0,499), 230=(0,499), 231=(0,499), 232=(0,499), 233=(0,499), 238=(0,499), 239=(0,499), 240=(0,499), 241=(0,499), 242=(0,499), 244=(0,499), 246=(0,499), 248=(0,499), 249=(0,499), 250=(0,499), 253=(0,499), 254=(0,499), 255=(0,499), 257=(0,499), 258=(0,499), 261=(0,499), 262=(0,499), 264=(0,499), 265=(0,499), 270=(0,499), 273=(0,499), 276=(0,499), 277=(0,499), 278=(0,499), 280=(0,499), 283=(0,499), 285=(0,499), 286=(0,499), 288=(0,499), 289=(0,499), 292=(0,499), 294=(0,499), 296=(0,499), 297=(0,499), 299=(0,499), 300=(0,499), 302=(0,499), 306=(0,499), 309=(0,499), 314=(0,499), 315=(0,499), 317=(0,499), 318=(0,499), 319=(0,499), 321=(0,499), 322=(0,499), 323=(0,499), 324=(0,499), 325=(0,499), 328=(0,499), 330=(0,499), 333=(0,499), 335=(0,499), 336=(0,499), 337=(0,499), 338=(0,499), 339=(0,499), 345=(0,499), 346=(0,499), 347=(0,499), 348=(0,499), 351=(0,499), 352=(0,499), 353=(0,499), 354=(0,499), 357=(0,499), 358=(0,499), 361=(0,499), 362=(0,499), 365=(0,499), 368=(0,499), 369=(0,499), 371=(0,499), 372=(0,499), 374=(0,499), 375=(0,499), 380=(0,499), 381=(0,499), 382=(0,499), 384=(0,499), 387=(0,499), 389=(0,499), 391=(0,499), 394=(0,499), 397=(0,499), 398=(0,499), 400=(0,499), 401=(0,499), 402=(0,499), 403=(0,499), 406=(0,499), 407=(0,499), 408=(0,499), 409=(0,499), 414=(0,499), 416=(0,499), 420=(0,499), 422=(0,499), 424=(0,499), 425=(0,499), 428=(0,499), 431=(0,498), 433=(0,498), 439=(0,498), 441=(0,498), 443=(0,498), 444=(0,498), 449=(0,498), 451=(0,498), 452=(0,498), 453=(0,498), 458=(0,498), 459=(0,498), 464=(0,498), 465=(0,498), 466=(0,498), 472=(0,497), 473=(0,497), 474=(0,498), 476=(0,498), 477=(0,498), 479=(0,498), 480=(0,497), 481=(0,497), 483=(0,497), 484=(0,497), 485=(0,497), 488=(0,497), 491=(0,497), 492=(0,497), 496=(0,497), 497=(0,497), 498=(0,497), 499=(0,497), 501=(0,497), 503=(0,497), 506=(0,497), 509=(0,497), 512=(0,497), 517=(0,497), 518=(0,497), 520=(0,496), 521=(0,496), 523=(0,497), 526=(0,497), 527=(0,497), 530=(0,496), 531=(0,496), 538=(0,496), 540=(0,496), 541=(0,496), 543=(0,496), 547=(0,496), 548=(0,496), 551=(0,496), 554=(0,496), 558=(0,496), 562=(0,496), 563=(0,496), 564=(0,496), 566=(0,496), 568=(0,496), 569=(0,496), 570=(0,496), 573=(0,496), 578=(0,496), 579=(0,496), 580=(0,496), 583=(0,496), 585=(0,496), 586=(0,496), 587=(0,496), 588=(0,496), 589=(0,496), 590=(0,496), 591=(0,496), 593=(0,496), 595=(0,496), 596=(0,496), 597=(0,496), 599=(0,496), 601=(0,496), 602=(0,496), 604=(0,496), 608=(0,496), 611=(0,496), 612=(0,496), 614=(0,496), 615=(0,496), 618=(0,496), 619=(0,496), 620=(0,496), 621=(0,496), 622=(0,496), 625=(0,496), 626=(0,496), 627=(0,496), 628=(0,496), 629=(0,496), 630=(0,496), 631=(0,496), 632=(0,496), 634=(0,496), 635=(0,496), 636=(0,496), 639=(0,496), 640=(0,496), 642=(0,496), 644=(0,496), 645=(0,496), 647=(0,496), 648=(0,496), 650=(0,496), 652=(0,496), 655=(0,496), 657=(0,496), 659=(0,496), 662=(0,496), 663=(0,496), 666=(0,496), 668=(0,496), 669=(0,496), 670=(0,496), 671=(0,496), 675=(0,496), 676=(0,496), 677=(0,496), 678=(0,496), 680=(0,496), 681=(0,496), 682=(0,496), 683=(0,496), 684=(0,496), 688=(0,496), 689=(0,496), 692=(0,496), 693=(0,496), 694=(0,496), 695=(0,496), 696=(0,496), 697=(0,496), 699=(0,496), 702=(0,496), 704=(0,496), 711=(0,496), 712=(0,496), 713=(0,496), 716=(0,496), 720=(0,496), 722=(0,496), 723=(0,496), 724=(0,496), 725=(0,496), 726=(0,496), 728=(0,496), 733=(0,496), 734=(0,496), 736=(0,495), 737=(0,495), 740=(0,496), 744=(0,495), 745=(0,495), 747=(0,495), 748=(0,495), 750=(0,495), 753=(0,495), 754=(0,495), 755=(0,495), 756=(0,495), 757=(0,495), 758=(0,495), 760=(0,495), 762=(0,495), 768=(0,495), 769=(0,495), 771=(0,495), 772=(0,495), 776=(0,495), 778=(0,495), 780=(0,495), 781=(0,495), 783=(0,495), 786=(0,495), 788=(0,495), 791=(0,495), 793=(0,495), 795=(0,495), 798=(0,495), 803=(0,495), 805=(0,495), 806=(0,495), 808=(0,495), 812=(0,495), 816=(0,495), 817=(0,495), 819=(0,495), 823=(0,495), 827=(0,495), 828=(0,495), 829=(0,495), 830=(0,495), 832=(0,495), 833=(0,495), 834=(0,495), 835=(0,495), 838=(0,495), 839=(0,495), 840=(0,495), 841=(0,495), 843=(0,495), 844=(0,495), 845=(0,495), 846=(0,495), 847=(0,495), 850=(0,495), 851=(0,495), 852=(0,495), 854=(0,495), 859=(0,495), 860=(0,495), 861=(0,495), 863=(0,495), 866=(0,495), 867=(0,495), 869=(0,495), 870=(0,495), 871=(0,495), 877=(0,495), 879=(0,495), 881=(0,495), 883=(0,495), 885=(0,495), 887=(0,495), 889=(0,495), 891=(0,495), 892=(0,495), 895=(0,495), 896=(0,495), 898=(0,495), 899=(0,495), 903=(0,495), 905=(0,495), 906=(0,495), 907=(0,495), 908=(0,495), 910=(0,495), 912=(0,495), 913=(0,495), 915=(0,495), 916=(0,495), 917=(0,495), 918=(0,495), 919=(0,495), 920=(0,495), 923=(0,495), 924=(0,495), 929=(0,495), 930=(0,495), 931=(0,495), 933=(0,495), 935=(0,495), 941=(0,495), 944=(0,495), 946=(0,495), 947=(0,495), 948=(0,495), 953=(0,495), 955=(0,495), 960=(0,495), 961=(0,495), 966=(0,495), 968=(0,495), 970=(0,495), 974=(0,495), 975=(0,495), 976=(0,495), 978=(0,495), 979=(0,495), 982=(0,495), 984=(0,495), 986=(0,495), 987=(0,495), 989=(0,495), 993=(0,495), 994=(0,495), 995=(0,495), 996=(0,495), 997=(0,495), 998=(0,495), 1002=(0,495), 1004=(0,495), 1006=(0,495), 1007=(0,495), 1009=(0,495), 1012=(0,495), 1013=(0,495), 1016=(0,495), 1017=(0,495), 1018=(0,495), 1019=(0,495), 1020=(0,495)}, -1365813811=CachePartitionPartialCountersMap {36=(0,43)}}, partsSizes={-1422500400={4=297, 5=297, 6=297, 7=297, 8=297, 10=297, 11=297, 14=297, 16=297, 17=297, 18=297, 19=297, 22=297, 23=297, 24=297, 26=297, 27=297, 30=297, 35=296, 36=296, 37=297, 38=296, 39=296, 41=296, 44=296, 45=296, 47=296, 49=296, 51=296, 54=296, 57=296, 58=296, 59=296, 60=296, 62=296, 67=296, 68=296, 69=296, 71=296, 73=296, 75=296, 76=296, 79=296, 81=296, 83=296, 87=296, 88=296, 90=296, 91=296, 94=296, 95=296,... and 2129 skipped ...9=297, 830=297, 832=297, 833=297, 834=297, 835=297, 838=297, 839=297, 840=297, 841=297, 843=297, 844=297, 845=297, 846=297, 847=297, 850=297, 851=297, 852=297, 854=297, 859=297, 860=297, 861=297, 863=297, 866=297, 867=297, 869=297, 870=297, 871=297, 877=297, 879=297, 881=297, 883=297, 885=297, 887=297, 889=297, 891=297, 892=297, 895=297, 896=297, 898=297, 899=297, 903=297, 905=297, 906=297, 907=297, 908=297, 910=297, 912=297, 913=297, 915=297, 916=297, 917=297, 918=297, 919=297, 920=297, 923=297, 924=297, 929=297, 930=297, 931=297, 933=297, 935=297, 941=297, 944=297, 946=297, 947=297, 948=297, 953=297, 955=297, 960=297, 961=297, 966=297, 968=297, 970=297, 974=297, 975=297, 976=297, 978=297, 979=297, 982=297, 984=297, 986=297, 987=297, 989=297, 993=297, 994=297, 995=297, 996=297, 997=297, 998=297, 1002=297, 1004=297, 1006=297, 1007=297, 1009=297, 1012=297, 1013=297, 1016=297, 1017=297, 1018=297, 1019=297, 1020=297}, -1365813811={36=1}}, partHistCntrs=null, err=null, client=false, compress=true, finishMsg=null, activeQryTrackers=GridLongList [idx=0, arr=[]], super=GridDhtPartitionsAbstractMessage [exchId=GridDhtPartitionExchangeId [topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], discoEvt=DiscoveryEvent [evtNode=TcpDiscoveryNode [id=bf6ca73b-c193-4ee9-b9ae-2776c6b84aaf, addrs=[127.0.0.1], sockAddrs=[/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1568080264728, loc=false, ver=2.7.5#20190603-sha1:be4f2a15, isClient=false], topVer=7, nodeId8=d67eb547, msg=Node failed: TcpDiscoveryNode [id=bf6ca73b-c193-4ee9-b9ae-2776c6b84aaf, addrs=[127.0.0.1], sockAddrs=[/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1568080264728, loc=false, ver=2.7.5#20190603-sha1:be4f2a15, isClient=false], type=NODE_FAILED, tstamp=1568080325931], nodeId=bf6ca73b, evt=NODE_FAILED], lastVer=GridCacheVersion [topVer=179560072, order=1568080337865, nodeOrder=4], super=GridCacheMessage [msgId=192365, depInfo=null, err=null, skipPrepare=false]]]]] class org.apache.ignite.internal.cluster.ClusterTopologyCheckedException: Failed to send message (node left topology): TcpDiscoveryNode [id=ade9a0be-6756-438e-bd5e-d72a6dec0970, addrs=[127.0.0.1], sockAddrs=[/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1568080264728, loc=false, ver=2.7.5#20190603-sha1:be4f2a15, isClient=false] at org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.createTcpClient(TcpCommunicationSpi.java:3270) at org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.createNioClient(TcpCommunicationSpi.java:2987) at org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.reserveClient(TcpCommunicationSpi.java:2870) at org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.sendMessage0(TcpCommunicationSpi.java:2713) at org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.sendMessage(TcpCommunicationSpi.java:2672) at org.apache.ignite.internal.managers.communication.GridIoManager.send(GridIoManager.java:1656) at org.apache.ignite.internal.managers.communication.GridIoManager.sendToGridTopic(GridIoManager.java:1731) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.send(GridCacheIoManager.java:1170) at org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture.sendLocalPartitions(GridDhtPartitionsExchangeFuture.java:1883) at org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture.sendPartitions(GridDhtPartitionsExchangeFuture.java:2014) at org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture.distributedExchange(GridDhtPartitionsExchangeFuture.java:1504) at org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture.init(GridDhtPartitionsExchangeFuture.java:809) at org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$ExchangeWorker.body0(GridCachePartitionExchangeManager.java:2668) at org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$ExchangeWorker.body(GridCachePartitionExchangeManager.java:2540) at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) [09:52:06,859][SEVERE][sys-#46%1568080257377%][TcpCommunicationSpi] Failed to send message to remote node [node=TcpDiscoveryNode [id=1f4fa760-efcc-4184-bd0d-73a73f53e2e7, addrs=[127.0.0.1], sockAddrs=[/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1568080264711, loc=false, ver=2.7.5#20190603-sha1:be4f2a15, isClient=true], msg=GridIoMessage [plc=2, topic=TOPIC_CACHE, topicOrd=8, ordered=false, timeout=0, skipOnTimeout=false, msg=GridDhtPartitionsSingleRequest [restoreExchId=GridDhtPartitionExchangeId [topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], discoEvt=DiscoveryEvent [evtNode=TcpDiscoveryNode [id=bf6ca73b-c193-4ee9-b9ae-2776c6b84aaf, addrs=[127.0.0.1], sockAddrs=[/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1568080264728, loc=false, ver=2.7.5#20190603-sha1:be4f2a15, isClient=false], topVer=7, nodeId8=d67eb547, msg=Node failed: TcpDiscoveryNode [id=bf6ca73b-c193-4ee9-b9ae-2776c6b84aaf, addrs=[127.0.0.1], sockAddrs=[/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1568080264728, loc=false, ver=2.7.5#20190603-sha1:be4f2a15, isClient=false], type=NODE_FAILED, tstamp=1568080325931], nodeId=bf6ca73b, evt=NODE_FAILED], super=GridDhtPartitionsAbstractMessage [exchId=GridDhtPartitionExchangeId [topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], discoEvt=DiscoveryEvent [evtNode=TcpDiscoveryNode [id=bf6ca73b-c193-4ee9-b9ae-2776c6b84aaf, addrs=[127.0.0.1], sockAddrs=[/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1568080264728, loc=false, ver=2.7.5#20190603-sha1:be4f2a15, isClient=false], topVer=7, nodeId8=d67eb547, msg=Node failed: TcpDiscoveryNode [id=bf6ca73b-c193-4ee9-b9ae-2776c6b84aaf, addrs=[127.0.0.1], sockAddrs=[/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1568080264728, loc=false, ver=2.7.5#20190603-sha1:be4f2a15, isClient=false], type=NODE_FAILED, tstamp=1568080325931], nodeId=bf6ca73b, evt=NODE_FAILED], lastVer=null, super=GridCacheMessage [msgId=192366, depInfo=null, err=null, skipPrepare=false]]]]] class org.apache.ignite.IgniteCheckedException: Failed to connect to node (is node still alive?). Make sure that each ComputeTask and cache Transaction has a timeout set in order to prevent parties from waiting forever in case of network issues [nodeId=1f4fa760-efcc-4184-bd0d-73a73f53e2e7, addrs=[/127.0.0.1:47102]] at org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.createTcpClient(TcpCommunicationSpi.java:3459) at org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.createNioClient(TcpCommunicationSpi.java:2987) at org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.reserveClient(TcpCommunicationSpi.java:2870) at org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.access$6000(TcpCommunicationSpi.java:271) at org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi$CommunicationWorker.processDisconnect(TcpCommunicationSpi.java:4489) at org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi$CommunicationWorker.body(TcpCommunicationSpi.java:4294) at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:120) at org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi$5.body(TcpCommunicationSpi.java:2237) at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:62) Suppressed: class org.apache.ignite.IgniteCheckedException: Failed to connect to address [addr=/127.0.0.1:47102, err=Connection refused: no further information] at org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.createTcpClient(TcpCommunicationSpi.java:3462) ... 8 more Caused by: java.net.ConnectException: Connection refused: no further information at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) at sun.nio.ch.SocketAdaptor.connect(SocketAdaptor.java:111) at org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.createTcpClient(TcpCommunicationSpi.java:3299) ... 8 more [09:52:09,479][SEVERE][sys-#94%1568080257377%][TcpCommunicationSpi] Failed to send message to remote node [node=TcpDiscoveryNode [id=1f4fa760-efcc-4184-bd0d-73a73f53e2e7, addrs=[127.0.0.1], sockAddrs=[/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1568080264711, loc=false, ver=2.7.5#20190603-sha1:be4f2a15, isClient=true], msg=GridIoMessage [plc=2, topic=TOPIC_CACHE, topicOrd=8, ordered=false, timeout=0, skipOnTimeout=false, msg=GridDhtPartitionsFullMessage [parts={110251491=GridDhtPartitionFullMap [nodeId=d67eb547-9ecd-4b32-843b-23a118d696aa, nodeOrder=4, updateSeq=1235, size=2], -2100569601=GridDhtPartitionFullMap [nodeId=d67eb547-9ecd-4b32-843b-23a118d696aa, nodeOrder=4, updateSeq=122, size=2], -1422500400=GridDhtPartitionFullMap [nodeId=d67eb547-9ecd-4b32-843b-23a118d696aa, nodeOrder=4, updateSeq=695, size=2], -1365813811=GridDhtPartitionFullMap [nodeId=d67eb547-9ecd-4b32-843b-23a118d696aa, nodeOrder=4, updateSeq=1235, size=2]}, partCntrs=null, partCntrs2=null, partHistSuppliers=null, partsToReload=null, partsSizes={110251491={0=0, 1=0, 2=0, 3=0, 4=null, 5=null, 6=null, 7=null, 8=null, 9=0, 10=0, 11=0, 12=null, 13=0, 14=null, 15=null, 16=null, 17=null, 18=0, 19=0, 20=0, 21=0, 22=0, 23=null, 24=null, 25=0, 26=null, 27=null, 28=null, 29=0, 30=null, 31=null, 32=0, 33=null, 34=0, 35=null, 36=null, 37=null, 38=0, 39=null, 40=null, 41=null, 42=0, 43=null, 44=0, 45=null, 46=0, 47=null, 48=0, 49=null, 50=0, 51=0, 52=0, 53=0, 54=null, 55=0, 56=null, 57=0, 58=null, 59=null, 60=null, 61=null, 62=null, 63=null, 64=0, 65=0, 66=null, 67=null, 68=null, 69=0, 70=null, 71=null, 72=0, 73=null, 74=0, 75=0, 76=null, 77=0, 78=0, 79=0, 80=0, 81=0, 82=0, 83=null, 84=0, 85=0, 86=null, 87=0, 88=null, 89=0, 90=0, 91=null, 92=null, 93=null, 94=null, 95=0, 96=0, 97=0, 98=0, 99=0, 100=0, 101=0, 102=0, 103=0, 104=0, 105=null, 106=0, 107=null, 108=0, 109=0, 110=null, 111=0, 112=0, 113=null, 114=0, 115=null, 116=0, 117=null, 118=null, 119=0, 120=0, 121=0, 122=0, 123=0, 124=null, 125=0, 126=null, 127=0, 128=0, 129=null, 130=0, 131=0, 132=0, 133=0, 134=0, 135=null, 136=0, 137=0, 138=null, 139=null, 140=null, 141=null, 142=null, 143=null, 144=0, 145=0, 146=null, 147=null, 148=0, 149=null, 150=0, 151=0, 152=0, 153=null, 154=null, 155=null, 156=0, 157=0, 158=0, 159=null, 160=0, 161=null, 162=0, 163=0, 164=0, 165=0, 166=0, 167=null, 168=0, 169=0, 170=null, 171=0, 172=0, 173=null, 174=0, 175=0, 176=0, 177=null, 178=0, 179=null, 180=0, 181=0, 182=0, 183=0, 184=0, 185=0, 186=0, 187=null, 188=0, 189=0, 190=0, 191=0, 192=null, 193=0, 194=0, 195=null, 196=null, 197=null, 198=0, 199=0, 200=0, 201=0, 202=0, 203=0, 204=0, 205=0, 206=0, 207=null, 208=null, 209=0, 210=0, 211=0, 212=null, 213=null, 214=0, 215=null, 216=0, 217=0, 218=null, 219=null, 220=0, 221=0, 222=null, 223=0, 224=null, 225=0, 226=0, 227=null, 228=0, 229=0, 230=null, 231=0, 232=0, 233=null, 234=0, 235=0, 236=0, 237=null, 238=null, 239=0, 240=null, 241=null, 242=null, 243=0, 244=0, 245=0, 246=null, 247=null, 248=0, 249=null, 250=null, 251=0, 252=0, 253=null, 254=null, 255=null, 256=0, 257=0, 258=null, 259=0, 260=0, 261=null, 262=0, 263=0, 264=0, 265=null, 266=0, 267=0, 268=0, 269=0, 270=0, 271=0, 272=0, 273=0, 274=0, 275=0, 276=0, 277=null, 278=0, 279=null, 280=null, 281=0, 282=0, 283=0, 284=null, 285=0, 286=0, 287=0, 288=0, 289=0, 290=null, 291=null, 292=0, 293=0, 294=0, 295=0, 296=0, 297=null, 298=0, 299=0, 300=null, 301=0, 302=null, 303=0, 304=0, 305=0, 306=0, 307=0, 308=0, 309=0, 310=0, 311=0, 312=0, 313=0, 314=null, 315=null, 316=0, 317=null, 318=0, 319=0, 320=null, 321=0, 322=0, 323=null, 324=0, 325=null, 326=null, 327=0, 328=null, 329=null, 330=null, 331=0, 332=null, 333=null, 334=0, 335=0, 336=0, 337=0, 338=0, 339=0, 340=0, 341=0, 342=null, 343=0, 344=null, 345=0, 346=0, 347=0, 348=0, 349=0, 350=null, 351=null, 352=0, 353=0, 354=null, 355=0, 356=0, 357=null, 358=0, 359=0, 360=0, 361=0, 362=null, 363=0, 364=0, 365=0, 366=0, 367=0, 368=null, 369=null, 370=0, 371=0, 372=0, 373=null, 374=null, 375=0, 376=0, 377=null, 378=0, 379=null, 380=null, 381=null, 382=null, 383=null, 384=0, 385=null, 386=null, 387=null, 388=0, 389=null, 390=0, 391=null, 392=0, 393=null, 394=0, 395=0, 396=0, 397=0, 398=0, 399=0, 400=0, 401=0, 402=0, 403=null, 404=null, 405=0, 406=0, 407=null, 408=0, 409=0, 410=0, 411=0, 412=0, 413=0, 414=0, 415=null, 416=0, 417=0, 418=0, 419=0, 420=0, 421=0, 422=null, 423=null, 424=0, 425=null, 426=0, 427=0, 428=null, 429=0, 430=0, 431=null, 432=0, 433=0, 434=0, 435=null, 436=null, 437=0, 438=0, 439=0, 440=0, 441=null, 442=0, 443=null, 444=null, 445=0, 446=0, 447=null, 448=0, 449=0, 450=0, 451=0, 452=0, 453=0, 454=0, 455=0, 456=0, 457=0, 458=0, 459=null, 460=null, 461=0, 462=0, 463=0, 464=0, 465=null, 466=0, 467=0, 468=0, 469=null, 470=0, 471=0, 472=0, 473=0, 474=null, 475=0, 476=0, 477=0, 478=null, 479=null, 480=0, 481=null, 482=0, 483=null, 484=null, 485=0, 486=0, 487=0, 488=0, 489=0, 490=0, 491=null, 492=0, 493=0, 494=null, 495=0, 496=0, 497=0, 498=0, 499=0, 500=0, 501=0, 502=0, 503=0, 504=0, 505=0, 506=null, 507=0, 508=0, 509=null, 510=0, 511=0, 512=0, 513=0, 514=0, 515=null, 516=0, 517=null, 518=0, 519=0, 520=null, 521=0, 522=0, 523=0, 524=0, 525=null, 526=null, 527=null, 528=null, 529=0, 530=0, 531=0, 532=null, 533=0, 534=0, 535=0, 536=0, 537=null, 538=0, 539=null, 540=0, 541=null, 542=0, 543=null, 544=0, 545=0, 546=0, 547=null, 548=0, 549=0, 550=0, 551=0, 552=null, 553=null, 554=null, 555=0, 556=0, 557=0, 558=null, 559=0, 560=null, 561=0, 562=0, 563=0, 564=null, 565=null, 566=0, 567=0, 568=0, 569=0, 570=null, 571=0, 572=0, 573=0, 574=null, 575=0, 576=0, 577=0, 578=0, 579=0, 580=0, 581=0, 582=null, 583=null, 584=0, 585=0, 586=0, 587=0, 588=0, 589=0, 590=0, 591=null, 592=0, 593=null, 594=0, 595=0, 596=0, 597=null, 598=null, 599=null, 600=0, 601=0, 602=null, 603=null, 604=null, 605=0, 606=0, 607=null, 608=null, 609=0, 610=null, 611=0, 612=0, 613=0, 614=null, 615=0, 616=0, 617=0, 618=null, 619=null, 620=null, 621=null, 622=null, 623=0, 624=null, 625=0, 626=0, 627=null, 628=null, 629=0, 630=null, 631=0, 632=0, 633=0, 634=null, 635=null, 636=0, 637=0, 638=0, 639=0, 640=null, 641=0, 642=0, 643=0, 644=0, 645=null, 646=0, 647=0, 648=null, 649=0, 650=null, 651=0, 652=0, 653=0, 654=null, 655=0, 656=0, 657=0, 658=0, 659=0, 660=0, 661=0, 662=null, 663=0, 664=0, 665=0, 666=0, 667=0, 668=0, 669=0, 670=0, 671=0, 672=0, 673=0, 674=0, 675=0, 676=0, 677=null, 678=0, 679=0, 680=null, 681=null, 682=null, 683=0, 684=0, 685=0, 686=null, 687=0, 688=null, 689=null, 690=0, 691=0, 692=0, 693=null, 694=0, 695=0, 696=null, 697=0, 698=0, 699=0, 700=0, 701=0, 702=null, 703=0, 704=null, 705=0, 706=0, 707=null, 708=0, 709=0, 710=0, 711=0, 712=0, 713=0, 714=null, 715=0, 716=null, 717=0, 718=null, 719=0, 720=0, 721=0, 722=0, 723=null, 724=null, 725=null, 726=0, 727=0, 728=null, 729=0, 730=0, 731=null, 732=0, 733=null, 734=null, 735=0, 736=null, 737=0, 738=null, 739=0, 740=null, 741=null, 742=0, 743=null, 744=0, 745=0, 746=null, 747=null, 748=0, 749=0, 750=null, 751=0, 752=0, 753=0, 754=null, 755=0, 756=null, 757=null, 758=0, 759=0, 760=null, 761=0, 762=0, 763=0, 764=0, 765=0, 766=null, 767=null, 768=null, 769=null, 770=0, 771=null, 772=0, 773=0, 774=0, 775=null, 776=0, 777=null, 778=null, 779=0, 780=0, 781=0, 782=0, 783=0, 784=0, 785=0, 786=null, 787=null, 788=null, 789=0, 790=0, 791=null, 792=0, 793=0, 794=0, 795=null, 796=null, 797=null, 798=0, 799=0, 800=0, 801=0, 802=0, 803=null, 804=0, 805=null, 806=0, 807=null, 808=0, 809=null, 810=0, 811=0, 812=null, 813=0, 814=null, 815=0, 816=0, 817=null, 818=0, 819=0, 820=0, 821=0, 822=null, 823=0, 824=0, 825=0, 826=0, 827=null, 828=0, 829=null, 830=null, 831=0, 832=null, 833=0, 834=null, 835=null, 836=0, 837=0, 838=0, 839=0, 840=null, 841=0, 842=0, 843=null, 844=0, 845=null, 846=0, 847=0, 848=0, 849=null, 850=0, 851=null, 852=0, 853=0, 854=0, 855=0, 856=null, 857=0, 858=null, 859=null, 860=null, 861=null, 862=0, 863=null, 864=0, 865=0, 866=null, 867=0, 868=null, 869=0, 870=0, 871=0, 872=null, 873=0, 874=0, 875=null, 876=null, 877=null, 878=0, 879=null, 880=0, 881=null, 882=0, 883=null, 884=0, 885=null, 886=0, 887=0, 888=0, 889=0, 890=0, 891=0, 892=null, 893=0, 894=0, 895=null, 896=0, 897=0, 898=0, 899=null, 900=0, 901=0, 902=0, 903=0, 904=0, 905=0, 906=null, 907=0, 908=null, 909=null, 910=0, 911=null, 912=null, 913=0, 914=n... and 2130 skipped ...2=null, 813=0, 814=null, 815=0, 816=0, 817=null, 818=0, 819=0, 820=0, 821=0, 822=null, 823=0, 824=0, 825=0, 826=0, 827=null, 828=0, 829=null, 830=null, 831=0, 832=null, 833=0, 834=null, 835=null, 836=0, 837=0, 838=0, 839=0, 840=null, 841=0, 842=0, 843=null, 844=0, 845=null, 846=0, 847=0, 848=0, 849=null, 850=0, 851=null, 852=0, 853=0, 854=0, 855=0, 856=null, 857=0, 858=null, 859=null, 860=null, 861=null, 862=0, 863=null, 864=0, 865=0, 866=null, 867=0, 868=null, 869=0, 870=0, 871=0, 872=null, 873=0, 874=0, 875=null, 876=null, 877=null, 878=0, 879=null, 880=0, 881=null, 882=0, 883=null, 884=0, 885=null, 886=0, 887=0, 888=0, 889=0, 890=0, 891=0, 892=null, 893=0, 894=0, 895=null, 896=0, 897=0, 898=0, 899=null, 900=0, 901=0, 902=0, 903=0, 904=0, 905=0, 906=null, 907=0, 908=null, 909=null, 910=0, 911=null, 912=null, 913=0, 914=null, 915=null, 916=null, 917=0, 918=0, 919=0, 920=null, 921=null, 922=0, 923=0, 924=0, 925=null, 926=0, 927=0, 928=0, 929=null, 930=null, 931=null, 932=0, 933=null, 934=0, 935=0, 936=0, 937=0, 938=0, 939=0, 940=null, 941=null, 942=0, 943=null, 944=null, 945=0, 946=0, 947=null, 948=0, 949=0, 950=0, 951=null, 952=0, 953=0, 954=0, 955=0, 956=0, 957=0, 958=0, 959=0, 960=0, 961=null, 962=null, 963=0, 964=0, 965=0, 966=null, 967=0, 968=null, 969=0, 970=0, 971=0, 972=0, 973=0, 974=0, 975=0, 976=0, 977=0, 978=0, 979=0, 980=0, 981=0, 982=null, 983=null, 984=null, 985=0, 986=0, 987=null, 988=0, 989=0, 990=0, 991=null, 992=0, 993=null, 994=0, 995=null, 996=0, 997=null, 998=null, 999=0, 1000=0, 1001=0, 1002=null, 1003=0, 1004=null, 1005=null, 1006=0, 1007=0, 1008=0, 1009=null, 1010=0, 1011=0, 1012=null, 1013=null, 1014=null, 1015=0, 1016=0, 1017=null, 1018=0, 1019=0, 1020=null, 1021=0, 1022=0, 1023=0}}, topVer=AffinityTopologyVersion [topVer=8, minorTopVer=0], errs=null, compress=true, resTopVer=null, partCnt=4, super=GridDhtPartitionsAbstractMessage [exchId=null, lastVer=null, super=GridCacheMessage [msgId=202301, depInfo=null, err=null, skipPrepare=false]]]]] class org.apache.ignite.IgniteCheckedException: Failed to connect to node (is node still alive?). Make sure that each ComputeTask and cache Transaction has a timeout set in order to prevent parties from waiting forever in case of network issues [nodeId=1f4fa760-efcc-4184-bd0d-73a73f53e2e7, addrs=[/127.0.0.1:47102]] at org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.createTcpClient(TcpCommunicationSpi.java:3459) at org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.createNioClient(TcpCommunicationSpi.java:2987) at org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.reserveClient(TcpCommunicationSpi.java:2870) at org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.sendMessage0(TcpCommunicationSpi.java:2713) at org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.sendMessage(TcpCommunicationSpi.java:2672) at org.apache.ignite.internal.managers.communication.GridIoManager.send(GridIoManager.java:1656) at org.apache.ignite.internal.managers.communication.GridIoManager.sendToGridTopic(GridIoManager.java:1731) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.sendNoRetry(GridCacheIoManager.java:1282) at org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager.sendAllPartitions(GridCachePartitionExchangeManager.java:1120) at org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager.refreshPartitions(GridCachePartitionExchangeManager.java:1079) at org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$ResendTimeoutObject$1.run(GridCachePartitionExchangeManager.java:2955) at org.apache.ignite.internal.util.IgniteUtils.wrapThreadLoader(IgniteUtils.java:6873) at org.apache.ignite.internal.processors.closure.GridClosureProcessor$1.body(GridClosureProcessor.java:827) at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:120) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Suppressed: class org.apache.ignite.IgniteCheckedException: Failed to connect to address [addr=/127.0.0.1:47102, err=Connection refused: no further information] at org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.createTcpClient(TcpCommunicationSpi.java:3462) ... 16 more Caused by: java.net.ConnectException: Connection refused: no further information at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) at sun.nio.ch.SocketAdaptor.connect(SocketAdaptor.java:111) at org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.createTcpClient(TcpCommunicationSpi.java:3299) ... 16 more [09:52:11,153][SEVERE][sys-#49%1568080257377%][TcpCommunicationSpi] Failed to send message to remote node [node=TcpDiscoveryNode [id=1f4fa760-efcc-4184-bd0d-73a73f53e2e7, addrs=[127.0.0.1], sockAddrs=[/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1568080264711, loc=false, ver=2.7.5#20190603-sha1:be4f2a15, isClient=true], msg=GridIoMessage [plc=2, topic=TOPIC_CACHE, topicOrd=8, ordered=false, timeout=0, skipOnTimeout=false, msg=GridDhtPartitionsFullMessage [parts={110251491=GridDhtPartitionFullMap [nodeId=d67eb547-9ecd-4b32-843b-23a118d696aa, nodeOrder=4, updateSeq=1236, size=2], -2100569601=GridDhtPartitionFullMap [nodeId=d67eb547-9ecd-4b32-843b-23a118d696aa, nodeOrder=4, updateSeq=124, size=2], -1422500400=GridDhtPartitionFullMap [nodeId=d67eb547-9ecd-4b32-843b-23a118d696aa, nodeOrder=4, updateSeq=697, size=2], -1365813811=GridDhtPartitionFullMap [nodeId=d67eb547-9ecd-4b32-843b-23a118d696aa, nodeOrder=4, updateSeq=1236, size=2]}, partCntrs=null, partCntrs2=null, partHistSuppliers=null, partsToReload=null, partsSizes={110251491={0=0, 1=0, 2=0, 3=0, 4=null, 5=null, 6=null, 7=null, 8=null, 9=0, 10=0, 11=0, 12=null, 13=0, 14=null, 15=null, 16=null, 17=null, 18=0, 19=0, 20=0, 21=0, 22=0, 23=null, 24=null, 25=0, 26=null, 27=null, 28=null, 29=0, 30=null, 31=null, 32=0, 33=null, 34=0, 35=null, 36=null, 37=null, 38=0, 39=null, 40=null, 41=null, 42=0, 43=null, 44=0, 45=null, 46=0, 47=null, 48=0, 49=null, 50=0, 51=0, 52=0, 53=0, 54=null, 55=0, 56=null, 57=0, 58=null, 59=null, 60=null, 61=null, 62=null, 63=null, 64=0, 65=0, 66=null, 67=null, 68=null, 69=0, 70=null, 71=null, 72=0, 73=null, 74=0, 75=0, 76=null, 77=0, 78=0, 79=0, 80=0, 81=0, 82=0, 83=null, 84=0, 85=0, 86=null, 87=0, 88=null, 89=0, 90=0, 91=null, 92=null, 93=null, 94=null, 95=0, 96=0, 97=0, 98=0, 99=0, 100=0, 101=0, 102=0, 103=0, 104=0, 105=null, 106=0, 107=null, 108=0, 109=0, 110=null, 111=0, 112=0, 113=null, 114=0, 115=null, 116=0, 117=null, 118=null, 119=0, 120=0, 121=0, 122=0, 123=0, 124=null, 125=0, 126=null, 127=0, 128=0, 129=null, 130=0, 131=0, 132=0, 133=0, 134=0, 135=null, 136=0, 137=0, 138=null, 139=null, 140=null, 141=null, 142=null, 143=null, 144=0, 145=0, 146=null, 147=null, 148=0, 149=null, 150=0, 151=0, 152=0, 153=null, 154=null, 155=null, 156=0, 157=0, 158=0, 159=null, 160=0, 161=null, 162=0, 163=0, 164=0, 165=0, 166=0, 167=null, 168=0, 169=0, 170=null, 171=0, 172=0, 173=null, 174=0, 175=0, 176=0, 177=null, 178=0, 179=null, 180=0, 181=0, 182=0, 183=0, 184=0, 185=0, 186=0, 187=null, 188=0, 189=0, 190=0, 191=0, 192=null, 193=0, 194=0, 195=null, 196=null, 197=null, 198=0, 199=0, 200=0, 201=0, 202=0, 203=0, 204=0, 205=0, 206=0, 207=null, 208=null, 209=0, 210=0, 211=0, 212=null, 213=null, 214=0, 215=null, 216=0, 217=0, 218=null, 219=null, 220=0, 221=0, 222=null, 223=0, 224=null, 225=0, 226=0, 227=null, 228=0, 229=0, 230=null, 231=0, 232=0, 233=null, 234=0, 235=0, 236=0, 237=null, 238=null, 239=0, 240=null, 241=null, 242=null, 243=0, 244=0, 245=0, 246=null, 247=null, 248=0, 249=null, 250=null, 251=0, 252=0, 253=null, 254=null, 255=null, 256=0, 257=0, 258=null, 259=0, 260=0, 261=null, 262=0, 263=0, 264=0, 265=null, 266=0, 267=0, 268=0, 269=0, 270=0, 271=0, 272=0, 273=0, 274=0, 275=0, 276=0, 277=null, 278=0, 279=null, 280=null, 281=0, 282=0, 283=0, 284=null, 285=0, 286=0, 287=0, 288=0, 289=0, 290=null, 291=null, 292=0, 293=0, 294=0, 295=0, 296=0, 297=null, 298=0, 299=0, 300=null, 301=0, 302=null, 303=0, 304=0, 305=0, 306=0, 307=0, 308=0, 309=0, 310=0, 311=0, 312=0, 313=0, 314=null, 315=null, 316=0, 317=null, 318=0, 319=0, 320=null, 321=0, 322=0, 323=null, 324=0, 325=null, 326=null, 327=0, 328=null, 329=null, 330=null, 331=0, 332=null, 333=null, 334=0, 335=0, 336=0, 337=0, 338=0, 339=0, 340=0, 341=0, 342=null, 343=0, 344=null, 345=0, 346=0, 347=0, 348=0, 349=0, 350=null, 351=null, 352=0, 353=0, 354=null, 355=0, 356=0, 357=null, 358=0, 359=0, 360=0, 361=0, 362=null, 363=0, 364=0, 365=0, 366=0, 367=0, 368=null, 369=null, 370=0, 371=0, 372=0, 373=null, 374=null, 375=0, 376=0, 377=null, 378=0, 379=null, 380=null, 381=null, 382=null, 383=null, 384=0, 385=null, 386=null, 387=null, 388=0, 389=null, 390=0, 391=null, 392=0, 393=null, 394=0, 395=0, 396=0, 397=0, 398=0, 399=0, 400=0, 401=0, 402=0, 403=null, 404=null, 405=0, 406=0, 407=null, 408=0, 409=0, 410=0, 411=0, 412=0, 413=0, 414=0, 415=null, 416=0, 417=0, 418=0, 419=0, 420=0, 421=0, 422=null, 423=null, 424=0, 425=null, 426=0, 427=0, 428=null, 429=0, 430=0, 431=null, 432=0, 433=0, 434=0, 435=null, 436=null, 437=0, 438=0, 439=0, 440=0, 441=null, 442=0, 443=null, 444=null, 445=0, 446=0, 447=null, 448=0, 449=0, 450=0, 451=0, 452=0, 453=0, 454=0, 455=0, 456=0, 457=0, 458=0, 459=null, 460=null, 461=0, 462=0, 463=0, 464=0, 465=null, 466=0, 467=0, 468=0, 469=null, 470=0, 471=0, 472=0, 473=0, 474=null, 475=0, 476=0, 477=0, 478=null, 479=null, 480=0, 481=null, 482=0, 483=null, 484=null, 485=0, 486=0, 487=0, 488=0, 489=0, 490=0, 491=null, 492=0, 493=0, 494=null, 495=0, 496=0, 497=0, 498=0, 499=0, 500=0, 501=0, 502=0, 503=0, 504=0, 505=0, 506=null, 507=0, 508=0, 509=null, 510=0, 511=0, 512=0, 513=0, 514=0, 515=null, 516=0, 517=null, 518=0, 519=0, 520=null, 521=0, 522=0, 523=0, 524=0, 525=null, 526=null, 527=null, 528=null, 529=0, 530=0, 531=0, 532=null, 533=0, 534=0, 535=0, 536=0, 537=null, 538=0, 539=null, 540=0, 541=null, 542=0, 543=null, 544=0, 545=0, 546=0, 547=null, 548=0, 549=0, 550=0, 551=0, 552=null, 553=null, 554=null, 555=0, 556=0, 557=0, 558=null, 559=0, 560=null, 561=0, 562=0, 563=0, 564=null, 565=null, 566=0, 567=0, 568=0, 569=0, 570=null, 571=0, 572=0, 573=0, 574=null, 575=0, 576=0, 577=0, 578=0, 579=0, 580=0, 581=0, 582=null, 583=null, 584=0, 585=0, 586=0, 587=0, 588=0, 589=0, 590=0, 591=null, 592=0, 593=null, 594=0, 595=0, 596=0, 597=null, 598=null, 599=null, 600=0, 601=0, 602=null, 603=null, 604=null, 605=0, 606=0, 607=null, 608=null, 609=0, 610=null, 611=0, 612=0, 613=0, 614=null, 615=0, 616=0, 617=0, 618=null, 619=null, 620=null, 621=null, 622=null, 623=0, 624=null, 625=0, 626=0, 627=null, 628=null, 629=0, 630=null, 631=0, 632=0, 633=0, 634=null, 635=null, 636=0, 637=0, 638=0, 639=0, 640=null, 641=0, 642=0, 643=0, 644=0, 645=null, 646=0, 647=0, 648=null, 649=0, 650=null, 651=0, 652=0, 653=0, 654=null, 655=0, 656=0, 657=0, 658=0, 659=0, 660=0, 661=0, 662=null, 663=0, 664=0, 665=0, 666=0, 667=0, 668=0, 669=0, 670=0, 671=0, 672=0, 673=0, 674=0, 675=0, 676=0, 677=null, 678=0, 679=0, 680=null, 681=null, 682=null, 683=0, 684=0, 685=0, 686=null, 687=0, 688=null, 689=null, 690=0, 691=0, 692=0, 693=null, 694=0, 695=0, 696=null, 697=0, 698=0, 699=0, 700=0, 701=0, 702=null, 703=0, 704=null, 705=0, 706=0, 707=null, 708=0, 709=0, 710=0, 711=0, 712=0, 713=0, 714=null, 715=0, 716=null, 717=0, 718=null, 719=0, 720=0, 721=0, 722=0, 723=null, 724=null, 725=null, 726=0, 727=0, 728=null, 729=0, 730=0, 731=null, 732=0, 733=null, 734=null, 735=0, 736=null, 737=0, 738=null, 739=0, 740=null, 741=null, 742=0, 743=null, 744=0, 745=0, 746=null, 747=null, 748=0, 749=0, 750=null, 751=0, 752=0, 753=0, 754=null, 755=0, 756=null, 757=null, 758=0, 759=0, 760=null, 761=0, 762=0, 763=0, 764=0, 765=0, 766=null, 767=null, 768=null, 769=null, 770=0, 771=null, 772=0, 773=0, 774=0, 775=null, 776=0, 777=null, 778=null, 779=0, 780=0, 781=0, 782=0, 783=0, 784=0, 785=0, 786=null, 787=null, 788=null, 789=0, 790=0, 791=null, 792=0, 793=0, 794=0, 795=null, 796=null, 797=null, 798=0, 799=0, 800=0, 801=0, 802=0, 803=null, 804=0, 805=null, 806=0, 807=null, 808=0, 809=null, 810=0, 811=0, 812=null, 813=0, 814=null, 815=0, 816=0, 817=null, 818=0, 819=0, 820=0, 821=0, 822=null, 823=0, 824=0, 825=0, 826=0, 827=null, 828=0, 829=null, 830=null, 831=0, 832=null, 833=0, 834=null, 835=null, 836=0, 837=0, 838=0, 839=0, 840=null, 841=0, 842=0, 843=null, 844=0, 845=null, 846=0, 847=0, 848=0, 849=null, 850=0, 851=null, 852=0, 853=0, 854=0, 855=0, 856=null, 857=0, 858=null, 859=null, 860=null, 861=null, 862=0, 863=null, 864=0, 865=0, 866=null, 867=0, 868=null, 869=0, 870=0, 871=0, 872=null, 873=0, 874=0, 875=null, 876=null, 877=null, 878=0, 879=null, 880=0, 881=null, 882=0, 883=null, 884=0, 885=null, 886=0, 887=0, 888=0, 889=0, 890=0, 891=0, 892=null, 893=0, 894=0, 895=null, 896=0, 897=0, 898=0, 899=null, 900=0, 901=0, 902=0, 903=0, 904=0, 905=0, 906=null, 907=0, 908=null, 909=null, 910=0, 911=null, 912=null, 913=0, 914=n... and 2130 skipped ...2=null, 813=0, 814=null, 815=0, 816=0, 817=null, 818=0, 819=0, 820=0, 821=0, 822=null, 823=0, 824=0, 825=0, 826=0, 827=null, 828=0, 829=null, 830=null, 831=0, 832=null, 833=0, 834=null, 835=null, 836=0, 837=0, 838=0, 839=0, 840=null, 841=0, 842=0, 843=null, 844=0, 845=null, 846=0, 847=0, 848=0, 849=null, 850=0, 851=null, 852=0, 853=0, 854=0, 855=0, 856=null, 857=0, 858=null, 859=null, 860=null, 861=null, 862=0, 863=null, 864=0, 865=0, 866=null, 867=0, 868=null, 869=0, 870=0, 871=0, 872=null, 873=0, 874=0, 875=null, 876=null, 877=null, 878=0, 879=null, 880=0, 881=null, 882=0, 883=null, 884=0, 885=null, 886=0, 887=0, 888=0, 889=0, 890=0, 891=0, 892=null, 893=0, 894=0, 895=null, 896=0, 897=0, 898=0, 899=null, 900=0, 901=0, 902=0, 903=0, 904=0, 905=0, 906=null, 907=0, 908=null, 909=null, 910=0, 911=null, 912=null, 913=0, 914=null, 915=null, 916=null, 917=0, 918=0, 919=0, 920=null, 921=null, 922=0, 923=0, 924=0, 925=null, 926=0, 927=0, 928=0, 929=null, 930=null, 931=null, 932=0, 933=null, 934=0, 935=0, 936=0, 937=0, 938=0, 939=0, 940=null, 941=null, 942=0, 943=null, 944=null, 945=0, 946=0, 947=null, 948=0, 949=0, 950=0, 951=null, 952=0, 953=0, 954=0, 955=0, 956=0, 957=0, 958=0, 959=0, 960=0, 961=null, 962=null, 963=0, 964=0, 965=0, 966=null, 967=0, 968=null, 969=0, 970=0, 971=0, 972=0, 973=0, 974=0, 975=0, 976=0, 977=0, 978=0, 979=0, 980=0, 981=0, 982=null, 983=null, 984=null, 985=0, 986=0, 987=null, 988=0, 989=0, 990=0, 991=null, 992=0, 993=null, 994=0, 995=null, 996=0, 997=null, 998=null, 999=0, 1000=0, 1001=0, 1002=null, 1003=0, 1004=null, 1005=null, 1006=0, 1007=0, 1008=0, 1009=null, 1010=0, 1011=0, 1012=null, 1013=null, 1014=null, 1015=0, 1016=0, 1017=null, 1018=0, 1019=0, 1020=null, 1021=0, 1022=0, 1023=0}}, topVer=AffinityTopologyVersion [topVer=8, minorTopVer=0], errs=null, compress=true, resTopVer=null, partCnt=4, super=GridDhtPartitionsAbstractMessage [exchId=null, lastVer=null, super=GridCacheMessage [msgId=217270, depInfo=null, err=null, skipPrepare=false]]]]] class org.apache.ignite.IgniteCheckedException: Failed to connect to node (is node still alive?). Make sure that each ComputeTask and cache Transaction has a timeout set in order to prevent parties from waiting forever in case of network issues [nodeId=1f4fa760-efcc-4184-bd0d-73a73f53e2e7, addrs=[/127.0.0.1:47102]] at org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.createTcpClient(TcpCommunicationSpi.java:3459) at org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.createNioClient(TcpCommunicationSpi.java:2987) at org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.reserveClient(TcpCommunicationSpi.java:2870) at org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.sendMessage0(TcpCommunicationSpi.java:2713) at org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.sendMessage(TcpCommunicationSpi.java:2672) at org.apache.ignite.internal.managers.communication.GridIoManager.send(GridIoManager.java:1656) at org.apache.ignite.internal.managers.communication.GridIoManager.sendToGridTopic(GridIoManager.java:1731) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.sendNoRetry(GridCacheIoManager.java:1282) at org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager.sendAllPartitions(GridCachePartitionExchangeManager.java:1120) at org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager.refreshPartitions(GridCachePartitionExchangeManager.java:1079) at org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$ResendTimeoutObject$1.run(GridCachePartitionExchangeManager.java:2955) at org.apache.ignite.internal.util.IgniteUtils.wrapThreadLoader(IgniteUtils.java:6873) at org.apache.ignite.internal.processors.closure.GridClosureProcessor$1.body(GridClosureProcessor.java:827) at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:120) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Suppressed: class org.apache.ignite.IgniteCheckedException: Failed to connect to address [addr=/127.0.0.1:47102, err=Connection refused: no further information] at org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.createTcpClient(TcpCommunicationSpi.java:3462) ... 16 more Caused by: java.net.ConnectException: Connection refused: no further information at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) at sun.nio.ch.SocketAdaptor.connect(SocketAdaptor.java:111) at org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.createTcpClient(TcpCommunicationSpi.java:3299) ... 16 more