Nov 02, 2021 11:39:35 AM org.apache.catalina.startup.VersionLoggerListener log INFO: Server version name: Apache Tomcat/10.0.2 Nov 02, 2021 11:39:35 AM org.apache.catalina.startup.VersionLoggerListener log INFO: Server built: Jan 28 2021 18:48:46 UTC Nov 02, 2021 11:39:35 AM org.apache.catalina.startup.VersionLoggerListener log INFO: Server version number: 10.0.2.0 Nov 02, 2021 11:39:35 AM org.apache.catalina.startup.VersionLoggerListener log INFO: OS Name: Windows 10 Nov 02, 2021 11:39:35 AM org.apache.catalina.startup.VersionLoggerListener log INFO: OS Version: 10.0 Nov 02, 2021 11:39:35 AM org.apache.catalina.startup.VersionLoggerListener log INFO: Architecture: amd64 Nov 02, 2021 11:39:35 AM org.apache.catalina.startup.VersionLoggerListener log INFO: Java Home: C:\Program Files\Java\openjdk-1.8.0.265-3.b01\jre Nov 02, 2021 11:39:35 AM org.apache.catalina.startup.VersionLoggerListener log INFO: JVM Version: 1.8.0_265-b01 Nov 02, 2021 11:39:35 AM org.apache.catalina.startup.VersionLoggerListener log INFO: JVM Vendor: Red Hat, Inc. Nov 02, 2021 11:39:35 AM org.apache.catalina.startup.VersionLoggerListener log INFO: CATALINA_BASE: C:\eclipse-jee-2020-12-R-win32-x86_64\eclipse\workspace\.metadata\.plugins\org.eclipse.wst.server.core\tmp0 Nov 02, 2021 11:39:35 AM org.apache.catalina.startup.VersionLoggerListener log INFO: CATALINA_HOME: C:\apache-tomcat-10.0.2 Nov 02, 2021 11:39:35 AM org.apache.catalina.startup.VersionLoggerListener log INFO: Command line argument: -Dcatalina.base=C:\eclipse-jee-2020-12-R-win32-x86_64\eclipse\workspace\.metadata\.plugins\org.eclipse.wst.server.core\tmp0 Nov 02, 2021 11:39:35 AM org.apache.catalina.startup.VersionLoggerListener log INFO: Command line argument: -Dcatalina.home=C:\apache-tomcat-10.0.2 Nov 02, 2021 11:39:35 AM org.apache.catalina.startup.VersionLoggerListener log INFO: Command line argument: -Dwtp.deploy=C:\eclipse-jee-2020-12-R-win32-x86_64\eclipse\workspace\.metadata\.plugins\org.eclipse.wst.server.core\tmp0\wtpwebapps Nov 02, 2021 11:39:35 AM org.apache.catalina.startup.VersionLoggerListener log INFO: Command line argument: -Djava.endorsed.dirs=C:\apache-tomcat-10.0.2\endorsed Nov 02, 2021 11:39:35 AM org.apache.catalina.startup.VersionLoggerListener log INFO: Command line argument: -Dfile.encoding=Cp1252 Nov 02, 2021 11:39:35 AM org.apache.catalina.core.AprLifecycleListener lifecycleEvent INFO: The Apache Tomcat Native library which allows using OpenSSL was not found on the java.library.path: [C:\Program Files\Java\openjdk-1.8.0.265-3.b01\jre\bin;C:\WINDOWS\Sun\Java\bin;C:\WINDOWS\system32;C:\WINDOWS;C:/eclipse-jee-2020-12-R-win32-x86_64/eclipse//plugins/org.eclipse.justj.openjdk.hotspot.jre.full.win32.x86_64_15.0.1.v20201027-0507/jre/bin/server;C:/eclipse-jee-2020-12-R-win32-x86_64/eclipse//plugins/org.eclipse.justj.openjdk.hotspot.jre.full.win32.x86_64_15.0.1.v20201027-0507/jre/bin;C:\tibco\as\4.6\lib;C:\tibco\as\4.6\bin;C:\tibco\ftl\6.5\bin;C:\tibco\ftl\6.5\lib;C:\tibco\as\2.4\lib;C:\tibco\as\2.4\bin;C:\Python\Python36\Lib;C:\Python\Python36\Scripts;C:\Python\Python36;C:\Python\Python36\DLLs;C:\Python\Python36\libs;-C:\Program Files (x86)\Common Files\Oracle\Java\javapath;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Program Files\Git\cmd;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;C:\WINDOWS\System32\WindowsPowerShell\v1.0\;C:\WINDOWS\System32\OpenSSH\;C:\apache-ant-1.8.2\bin;C:\Program Files\Java\openjdk-1.8.0.265-3.b01\bin;C:\Go\bin;C:\mingw-w64\x86_64-6.3.0-posix-seh-rt_v5-rev2\mingw64\bin;C:\tibco\as\2.4\lib;C:\tibco\as\2.4\bin;C:\Program Files\7-Zip;C:\Program Files\Docker\Docker\resources\bin;C:\ProgramData\DockerDesktop\version-bin;C:\Program Files (x86)\Windows Kits\10\Windows Performance Toolkit\;C:\Program Files (x86)\Nmap;C:\Users\nchikkal\AppData\Local\Microsoft\WindowsApps;;C:\eclipse-jee-2020-12-R-win32-x86_64\eclipse;;.] Nov 02, 2021 11:39:35 AM org.apache.coyote.AbstractProtocol init INFO: Initializing ProtocolHandler ["http-nio-8080"] Nov 02, 2021 11:39:35 AM org.apache.catalina.startup.Catalina load INFO: Server initialization in [954] milliseconds Nov 02, 2021 11:39:35 AM org.apache.catalina.core.StandardService startInternal INFO: Starting service [Catalina] Nov 02, 2021 11:39:35 AM org.apache.catalina.core.StandardEngine startInternal INFO: Starting Servlet engine: [Apache Tomcat/10.0.2] Nov 02, 2021 11:39:48 AM org.apache.jasper.servlet.TldScanner scanJars INFO: At least one JAR was scanned for TLDs yet contained no TLDs. Enable debug logging for this logger for a complete list of JARs that were scanned but no TLDs were found in them. Skipping unneeded JARs during scanning can improve startup time and JSP compilation time. Nov 02, 2021 11:39:49 AM org.apache.catalina.util.SessionIdGeneratorBase createSecureRandom WARNING: Creation of SecureRandom instance for session ID generation using [SHA1PRNG] took [378] milliseconds. Nov 02, 2021 11:40:01 AM org.apache.jasper.servlet.TldScanner scanJars INFO: At least one JAR was scanned for TLDs yet contained no TLDs. Enable debug logging for this logger for a complete list of JARs that were scanned but no TLDs were found in them. Skipping unneeded JARs during scanning can improve startup time and JSP compilation time. Nov 02, 2021 11:40:01 AM com.support.ignite.server.RadarServer contextInitialized INFO: ==============================Starting Radar Server=========================================: Nov 02, 2021 11:40:01 AM java.util.logging.LogManager$RootLogger log WARNING: Failed to resolve default logging config file: config/java.util.logging.properties [11:40:01] __________ ________________ [11:40:01] / _/ ___/ |/ / _/_ __/ __/ [11:40:01] _/ // (7 7 // / / / / _/ [11:40:01] /___/\___/_/|_/___/ /_/ /___/ [11:40:01] [11:40:01] ver. 2.11.0#20210911-sha1:8f3f07d3 [11:40:01] 2021 Copyright(C) Apache Software Foundation [11:40:01] [11:40:01] Ignite documentation: http://ignite.apache.org [11:40:01] [11:40:01] Quiet mode. [11:40:01] ^-- Logging by 'JavaLogger [quiet=true, config=null]' [11:40:01] ^-- To see **FULL** console log here add -DIGNITE_QUIET=false or "-v" to ignite.{sh|bat} [11:40:01] [11:40:01] OS: Windows 10 10.0 amd64 [11:40:01] VM information: OpenJDK Runtime Environment 1.8.0_265-b01 Red Hat, Inc. OpenJDK 64-Bit Server VM 25.265-b01 [11:40:01] Please set system property '-Djava.net.preferIPv4Stack=true' to avoid possible problems in mixed environments. [11:40:01] Initial heap size is 256MB (should be no less than 512MB, use -Xms512m -Xmx512m). [11:40:01] Configured plugins: [11:40:01] ^-- None [11:40:01] [11:40:01] Configured failure handler: [hnd=StopNodeOrHaltFailureHandler [tryStop=false, timeout=0, super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [11:40:02] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [11:40:02] Security status [authentication=off, sandbox=off, tls/ssl=off] [11:40:05] Encryption keys loaded from metastore. [grps=, masterKeyName=null] [11:40:05] Data Regions Started: 5 [11:40:05] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [11:40:05] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=100MB, allocTotal=0MB] [11:40:05] ^-- default region [type=default, persistence=true, lazyAlloc=true, [11:40:05] ... initCfg=256MB, maxCfg=3268MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [11:40:05] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [11:40:05] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=100MB, allocTotal=0MB] [11:40:05] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [11:40:05] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=100MB, allocTotal=0MB] [11:40:05] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [11:40:05] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [11:40:05] ^-- Ignite persistence [used=0MB] [11:40:32] Default character encoding is windows-1252. Specify UTF-8 character encoding by setting -Dfile.encoding=UTF-8 JVM parameter. Differing character encodings across cluster may lead to erratic behavior. [11:40:32] Performance suggestions for grid 'RADAR_CACHE' (fix if possible) [11:40:32] To disable, set -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true [11:40:32] ^-- Enable G1 Garbage Collector (add '-XX:+UseG1GC' to JVM options) [11:40:32] ^-- Specify JVM heap max size (add '-Xmx[g|G|m|M|k|K]' to JVM options) [11:40:32] ^-- Set max direct memory size if getting 'OOME: Direct buffer memory' (add '-XX:MaxDirectMemorySize=[g|G|m|M|k|K]' to JVM options) [11:40:32] Refer to this page for more performance suggestions: https://apacheignite.readme.io/docs/jvm-and-system-tuning [11:40:32] [11:40:32] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [11:40:32] [11:40:32] Ignite node started OK (id=56b06d8e, instance name=RADAR_CACHE) [11:40:32] Topology snapshot [ver=1, locNode=56b06d8e, servers=1, clients=0, state=INACTIVE, CPUs=4, offheap=3.2GB, heap=3.5GB] [11:40:32] ^-- Baseline [id=0, size=1, online=1, offline=0] [11:40:32] ^-- All baseline nodes are online, will start auto-activation Staring Ignite Cluster is Active Nov 02, 2021 11:40:32 AM org.apache.ignite.logger.java.JavaLogger error SEVERE: Failed to activate node components [nodeId=56b06d8e-c665-4cb8-bc40-5c9546c57370, client=false, topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], newState=ACTIVE] java.lang.IllegalStateException: Duplicate key at org.apache.ignite.cache.QueryEntity.checkIndexes(QueryEntity.java:234) at org.apache.ignite.cache.QueryEntity.makePatch(QueryEntity.java:185) at org.apache.ignite.internal.processors.query.QuerySchema.makePatch(QuerySchema.java:143) at org.apache.ignite.internal.processors.query.QuerySchema.makePatch(QuerySchema.java:101) at org.apache.ignite.internal.processors.cache.GridCacheProcessor.prepareCacheContext(GridCacheProcessor.java:2004) at org.apache.ignite.internal.processors.cache.GridCacheProcessor.lambda$null$6a5b31b9$1(GridCacheProcessor.java:1862) at org.apache.ignite.internal.processors.cache.GridCacheProcessor.lambda$prepareStartCachesIfPossible$14(GridCacheProcessor.java:1803) at org.apache.ignite.internal.processors.cache.GridCacheProcessor.lambda$prepareStartCaches$926b6886$1(GridCacheProcessor.java:1859) at org.apache.ignite.internal.util.IgniteUtils.doInParallel(IgniteUtils.java:11375) at org.apache.ignite.internal.util.IgniteUtils.doInParallel(IgniteUtils.java:11277) at org.apache.ignite.internal.processors.cache.GridCacheProcessor.prepareStartCaches(GridCacheProcessor.java:1854) at org.apache.ignite.internal.processors.cache.GridCacheProcessor.prepareStartCachesIfPossible(GridCacheProcessor.java:1801) at org.apache.ignite.internal.processors.cache.CacheAffinitySharedManager.processCacheStartRequests(CacheAffinitySharedManager.java:999) at org.apache.ignite.internal.processors.cache.CacheAffinitySharedManager.onCacheChangeRequest(CacheAffinitySharedManager.java:885) at org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture.onClusterStateChangeRequest(GridDhtPartitionsExchangeFuture.java:1323) at org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture.init(GridDhtPartitionsExchangeFuture.java:942) at org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$ExchangeWorker.body0(GridCachePartitionExchangeManager.java:3383) at org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$ExchangeWorker.body(GridCachePartitionExchangeManager.java:3205) at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) Suppressed: java.lang.IllegalStateException: Duplicate key at org.apache.ignite.cache.QueryEntity.checkIndexes(QueryEntity.java:234) at org.apache.ignite.cache.QueryEntity.makePatch(QueryEntity.java:185) at org.apache.ignite.internal.processors.query.QuerySchema.makePatch(QuerySchema.java:143) at org.apache.ignite.internal.processors.query.QuerySchema.makePatch(QuerySchema.java:101) at org.apache.ignite.internal.processors.cache.GridCacheProcessor.prepareCacheContext(GridCacheProcessor.java:2004) at org.apache.ignite.internal.processors.cache.GridCacheProcessor.lambda$null$6a5b31b9$1(GridCacheProcessor.java:1862) at org.apache.ignite.internal.processors.cache.GridCacheProcessor.lambda$prepareStartCachesIfPossible$14(GridCacheProcessor.java:1803) at org.apache.ignite.internal.processors.cache.GridCacheProcessor.lambda$prepareStartCaches$926b6886$1(GridCacheProcessor.java:1859) at org.apache.ignite.internal.util.IgniteUtils.lambda$null$1(IgniteUtils.java:11356) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ... 1 more Suppressed: java.lang.IllegalStateException: Duplicate key at org.apache.ignite.cache.QueryEntity.checkIndexes(QueryEntity.java:234) at org.apache.ignite.cache.QueryEntity.makePatch(QueryEntity.java:185) at org.apache.ignite.internal.processors.query.QuerySchema.makePatch(QuerySchema.java:143) at org.apache.ignite.internal.processors.query.QuerySchema.makePatch(QuerySchema.java:101) at org.apache.ignite.internal.processors.cache.GridCacheProcessor.prepareCacheContext(GridCacheProcessor.java:2004) at org.apache.ignite.internal.processors.cache.GridCacheProcessor.lambda$null$6a5b31b9$1(GridCacheProcessor.java:1862) at org.apache.ignite.internal.processors.cache.GridCacheProcessor.lambda$prepareStartCachesIfPossible$14(GridCacheProcessor.java:1803) at org.apache.ignite.internal.processors.cache.GridCacheProcessor.lambda$prepareStartCaches$926b6886$1(GridCacheProcessor.java:1859) at org.apache.ignite.internal.util.IgniteUtils.lambda$null$1(IgniteUtils.java:11356) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ... 1 more Suppressed: java.lang.IllegalStateException: Duplicate key at org.apache.ignite.cache.QueryEntity.checkIndexes(QueryEntity.java:234) at org.apache.ignite.cache.QueryEntity.makePatch(QueryEntity.java:185) at org.apache.ignite.internal.processors.query.QuerySchema.makePatch(QuerySchema.java:143) at org.apache.ignite.internal.processors.query.QuerySchema.makePatch(QuerySchema.java:101) at org.apache.ignite.internal.processors.cache.GridCacheProcessor.prepareCacheContext(GridCacheProcessor.java:2004) at org.apache.ignite.internal.processors.cache.GridCacheProcessor.lambda$null$6a5b31b9$1(GridCacheProcessor.java:1862) at org.apache.ignite.internal.processors.cache.GridCacheProcessor.lambda$prepareStartCachesIfPossible$14(GridCacheProcessor.java:1803) at org.apache.ignite.internal.processors.cache.GridCacheProcessor.lambda$prepareStartCaches$926b6886$1(GridCacheProcessor.java:1859) at org.apache.ignite.internal.util.IgniteUtils.lambda$null$1(IgniteUtils.java:11356) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ... 1 more Suppressed: java.lang.IllegalStateException: Duplicate key ... 20 more Nov 02, 2021 11:40:32 AM org.apache.ignite.logger.java.JavaLogger error SEVERE: Failed to reinitialize local partitions (rebalancing will be stopped): GridDhtPartitionExchangeId [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], discoEvt=DiscoveryCustomEvent [customMsg=ChangeGlobalStateMessage [id=6ad9581ec71-4a678f2a-8e81-4749-a431-849ca1b99c0b, reqId=2cc2c65b-79fb-48e4-8f44-ad1b1ef393cf, initiatingNodeId=56b06d8e-c665-4cb8-bc40-5c9546c57370, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-1346868359, branchingType='Cluster activation', baselineNodes=[RADAR_CACHE_SERVER]], forceChangeBaselineTopology=false, timestamp=1635871232437, forceDeactivation=true], affTopVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], super=DiscoveryEvent [evtNode=TcpDiscoveryNode [id=56b06d8e-c665-4cb8-bc40-5c9546c57370, consistentId=RADAR_CACHE_SERVER, addrs=ArrayList [0:0:0:0:0:0:0:1, 10.98.97.68, 127.0.0.1, 172.22.240.1, 172.26.160.1, 192.168.86.80], sockAddrs=HashSet [nchikkal-PC.mshome.net/172.22.240.1:47500, nchikkal-PC/10.98.97.68:47500, /0:0:0:0:0:0:0:1:47500, host.docker.internal/192.168.86.80:47500, /127.0.0.1:47500, /172.26.160.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1635871208065, loc=true, ver=2.11.0#20210911-sha1:8f3f07d3, isClient=false], topVer=1, msgTemplate=null, span=o.a.i.i.processors.tracing.NoopSpan@4fb47026, nodeId8=56b06d8e, msg=null, type=DISCOVERY_CUSTOM_EVT, tstamp=1635871232463]], nodeId=56b06d8e, evt=DISCOVERY_CUSTOM_EVT] java.lang.NullPointerException at org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture.distributedExchange(GridDhtPartitionsExchangeFuture.java:1623) at org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture.init(GridDhtPartitionsExchangeFuture.java:1021) at org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$ExchangeWorker.body0(GridCachePartitionExchangeManager.java:3383) at org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$ExchangeWorker.body(GridCachePartitionExchangeManager.java:3205) at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) Nov 02, 2021 11:40:32 AM java.util.logging.LogManager$RootLogger log SEVERE: Critical system error detected. Will be handled accordingly to configured handler [hnd=StopNodeOrHaltFailureHandler [tryStop=false, timeout=0, super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], failureCtx=FailureContext [type=SYSTEM_WORKER_TERMINATION, err=class o.a.i.IgniteException: Failed to wait for initialization topology [err=null]]] class org.apache.ignite.IgniteException: Failed to wait for initialization topology [err=null] at org.apache.ignite.internal.processors.cache.GridCacheSharedTtlCleanupManager$CleanupWorker.body(GridCacheSharedTtlCleanupManager.java:168) at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) Caused by: class org.apache.ignite.IgniteCheckedException: null at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7628) at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:191) at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) at org.apache.ignite.internal.processors.cache.GridCacheSharedTtlCleanupManager$CleanupWorker.body(GridCacheSharedTtlCleanupManager.java:164) ... 2 more Caused by: java.lang.NullPointerException at org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture.distributedExchange(GridDhtPartitionsExchangeFuture.java:1623) at org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture.init(GridDhtPartitionsExchangeFuture.java:1021) at org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$ExchangeWorker.body0(GridCachePartitionExchangeManager.java:3383) at org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$ExchangeWorker.body(GridCachePartitionExchangeManager.java:3205) ... 2 more Nov 02, 2021 11:40:32 AM org.apache.ignite.logger.java.JavaLogger error SEVERE: No deadlocked threads detected. Nov 02, 2021 11:40:32 AM org.apache.ignite.logger.java.JavaLogger error SEVERE: Failed to wait for completion of partition map exchange (preloading will not start): GridDhtPartitionsExchangeFuture [firstDiscoEvt=DiscoveryCustomEvent [customMsg=null, affTopVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], super=DiscoveryEvent [evtNode=TcpDiscoveryNode [id=56b06d8e-c665-4cb8-bc40-5c9546c57370, consistentId=RADAR_CACHE_SERVER, addrs=ArrayList [0:0:0:0:0:0:0:1, 10.98.97.68, 127.0.0.1, 172.22.240.1, 172.26.160.1, 192.168.86.80], sockAddrs=HashSet [nchikkal-PC.mshome.net/172.22.240.1:47500, nchikkal-PC/10.98.97.68:47500, /0:0:0:0:0:0:0:1:47500, host.docker.internal/192.168.86.80:47500, /127.0.0.1:47500, /172.26.160.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1635871208065, loc=true, ver=2.11.0#20210911-sha1:8f3f07d3, isClient=false], topVer=1, msgTemplate=null, span=o.a.i.i.processors.tracing.NoopSpan@4fb47026, nodeId8=56b06d8e, msg=null, type=DISCOVERY_CUSTOM_EVT, tstamp=1635871232463]], crd=TcpDiscoveryNode [id=56b06d8e-c665-4cb8-bc40-5c9546c57370, consistentId=RADAR_CACHE_SERVER, addrs=ArrayList [0:0:0:0:0:0:0:1, 10.98.97.68, 127.0.0.1, 172.22.240.1, 172.26.160.1, 192.168.86.80], sockAddrs=HashSet [nchikkal-PC.mshome.net/172.22.240.1:47500, nchikkal-PC/10.98.97.68:47500, /0:0:0:0:0:0:0:1:47500, host.docker.internal/192.168.86.80:47500, /127.0.0.1:47500, /172.26.160.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1635871208065, loc=true, ver=2.11.0#20210911-sha1:8f3f07d3, isClient=false], exchId=GridDhtPartitionExchangeId [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], discoEvt=DiscoveryCustomEvent [customMsg=null, affTopVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], super=DiscoveryEvent [evtNode=TcpDiscoveryNode [id=56b06d8e-c665-4cb8-bc40-5c9546c57370, consistentId=RADAR_CACHE_SERVER, addrs=ArrayList [0:0:0:0:0:0:0:1, 10.98.97.68, 127.0.0.1, 172.22.240.1, 172.26.160.1, 192.168.86.80], sockAddrs=HashSet [nchikkal-PC.mshome.net/172.22.240.1:47500, nchikkal-PC/10.98.97.68:47500, /0:0:0:0:0:0:0:1:47500, host.docker.internal/192.168.86.80:47500, /127.0.0.1:47500, /172.26.160.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1635871208065, loc=true, ver=2.11.0#20210911-sha1:8f3f07d3, isClient=false], topVer=1, msgTemplate=null, span=o.a.i.i.processors.tracing.NoopSpan@4fb47026, nodeId8=56b06d8e, msg=null, type=DISCOVERY_CUSTOM_EVT, tstamp=1635871232463]], nodeId=56b06d8e, evt=DISCOVERY_CUSTOM_EVT], added=true, exchangeType=ALL, initFut=GridFutureAdapter [ignoreInterrupts=false, state=DONE, res=false, hash=1074454583], init=false, lastVer=null, partReleaseFut=null, exchActions=ExchangeActions [startCaches=[ignite-sys-cache, SQL_PUBLIC_LOGDATATHREADIDS, SQL_PUBLIC_LOGANALYZERSOCIAL, SQL_PUBLIC_PRODUCTS, SQL_PUBLIC_LOGGERUSERSPACES, SQL_PUBLIC_LOGDATA, SQL_PUBLIC_LARGEFILEINFO, SQL_PUBLIC_PRODUCT_METADATA, SQL_PUBLIC_LOGDATATHREADMAPCOUNTSPACE, SQL_PUBLIC_FILETYPES, RADAR_CACHE, SQL_PUBLIC_LOGDATAKEYWORDS, SQL_PUBLIC_LOGDATAKEYMAPCOUNTSPACE, SQL_PUBLIC_SEARCHEDKEYWORDLOG, SQL_PUBLIC_LOGDATAFORIMAGES, SQL_PUBLIC_LOGDATADATETIMECOUNTSPACE], stopCaches=null, startGrps=[RADAR_CACHE, SQL_PUBLIC_LOGDATAKEYMAPCOUNTSPACE, SQL_PUBLIC_LOGDATA, SQL_PUBLIC_LOGANALYZERSOCIAL, SQL_PUBLIC_LOGDATADATETIMECOUNTSPACE, SQL_PUBLIC_LOGDATATHREADMAPCOUNTSPACE, SQL_PUBLIC_SEARCHEDKEYWORDLOG, SQL_PUBLIC_PRODUCT_METADATA, ignite-sys-cache, SQL_PUBLIC_FILETYPES, SQL_PUBLIC_LARGEFILEINFO, SQL_PUBLIC_LOGDATAKEYWORDS, SQL_PUBLIC_LOGDATATHREADIDS, SQL_PUBLIC_PRODUCTS, SQL_PUBLIC_LOGDATAFORIMAGES, SQL_PUBLIC_LOGGERUSERSPACES], stopGrps=[], resetParts=null, stateChangeRequest=StateChangeRequest [msg=ChangeGlobalStateMessage [id=6ad9581ec71-4a678f2a-8e81-4749-a431-849ca1b99c0b, reqId=2cc2c65b-79fb-48e4-8f44-ad1b1ef393cf, initiatingNodeId=56b06d8e-c665-4cb8-bc40-5c9546c57370, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-1346868359, branchingType='Cluster activation', baselineNodes=[RADAR_CACHE_SERVER]], forceChangeBaselineTopology=false, timestamp=1635871232437, forceDeactivation=true], prevBltHistItem=o.a.i.i.processors.cluster.BaselineTopologyHistoryItem@1714785b, prevState=INACTIVE, topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]]], affChangeMsg=null, centralizedAff=false, forceAffReassignment=true, exchangeLocE=java.lang.IllegalStateException: Duplicate key, cacheChangeFailureMsgSent=false, done=true, state=CRD, registerCachesFuture=null, startTime=1635871232474, initTime=1635871232562, rebalanced=false, affinityReassign=false, span=o.a.i.i.processors.tracing.NoopSpan@4fb47026, evtLatch=0, remaining=HashSet [], mergedJoinExchMsgs=null, awaitMergedMsgs=0, super=GridFutureAdapter [ignoreInterrupts=false, state=DONE, res=java.lang.NullPointerException, hash=115609183]] class org.apache.ignite.IgniteCheckedException: null at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7628) at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:209) at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:160) at org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$ExchangeWorker.body0(GridCachePartitionExchangeManager.java:3411) at org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$ExchangeWorker.body(GridCachePartitionExchangeManager.java:3205) at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.NullPointerException at org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture.distributedExchange(GridDhtPartitionsExchangeFuture.java:1623) at org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture.init(GridDhtPartitionsExchangeFuture.java:1021) at org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$ExchangeWorker.body0(GridCachePartitionExchangeManager.java:3383) ... 3 more Nov 02, 2021 11:40:32 AM org.apache.ignite.logger.java.JavaLogger error SEVERE: Thread dump at 2021/11/02 11:40:32 CDT Thread [name="dms-writer-thread-#79%RADAR_CACHE%", id=103, state=WAITING, blockCnt=0, waitCnt=1] Lock [object=java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@689e700b, ownerName=null, ownerId=-1] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at o.a.i.i.processors.metastorage.persistence.DmsDataWriterWorker.body(DmsDataWriterWorker.java:202) at o.a.i.i.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) Thread [name="wal-segment-syncer-#78%RADAR_CACHE%", id=102, state=TIMED_WAITING, blockCnt=0, waitCnt=1] at java.lang.Thread.sleep(Native Method) at o.a.i.i.util.IgniteUtils.sleep(IgniteUtils.java:8025) at o.a.i.i.processors.cache.persistence.wal.filehandle.FileHandleManagerImpl$WalSegmentSyncer.body(FileHandleManagerImpl.java:622) at o.a.i.i.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) Thread [name="wal-file-cleaner%RADAR_CACHE-#77%RADAR_CACHE%", id=101, state=WAITING, blockCnt=0, waitCnt=1] Lock [object=o.a.i.i.processors.cache.persistence.wal.aware.SegmentArchiveSizeStorage@597325bf, ownerName=null, ownerId=-1] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at o.a.i.i.processors.cache.persistence.wal.aware.SegmentArchiveSizeStorage.awaitExceedMaxSize(SegmentArchiveSizeStorage.java:79) at o.a.i.i.processors.cache.persistence.wal.aware.SegmentAware.awaitExceedMaxArchiveSize(SegmentAware.java:354) at o.a.i.i.processors.cache.persistence.wal.FileWriteAheadLogManager$FileCleaner.body(FileWriteAheadLogManager.java:3157) at o.a.i.i.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) Thread [name="wal-file-archiver%RADAR_CACHE-#76%RADAR_CACHE%", id=100, state=WAITING, blockCnt=1, waitCnt=2] Lock [object=o.a.i.i.processors.cache.persistence.wal.aware.SegmentCurrentStateStorage@67bb2177, ownerName=null, ownerId=-1] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at o.a.i.i.processors.cache.persistence.wal.aware.SegmentCurrentStateStorage.awaitSegment(SegmentCurrentStateStorage.java:61) at o.a.i.i.processors.cache.persistence.wal.aware.SegmentCurrentStateStorage.waitNextSegmentForArchivation(SegmentCurrentStateStorage.java:76) at o.a.i.i.processors.cache.persistence.wal.aware.SegmentAware.waitNextSegmentForArchivation(SegmentAware.java:102) at o.a.i.i.processors.cache.persistence.wal.FileWriteAheadLogManager$FileArchiver.body(FileWriteAheadLogManager.java:1860) at o.a.i.i.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) Thread [name="session-timeout-worker-#41%RADAR_CACHE%", id=61, state=TIMED_WAITING, blockCnt=0, waitCnt=1] at java.lang.Thread.sleep(Native Method) at o.a.i.i.processors.rest.GridRestProcessor$4.body(GridRestProcessor.java:486) at o.a.i.i.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) Thread [name="services-deployment-worker-#75%RADAR_CACHE%", id=98, state=WAITING, blockCnt=0, waitCnt=1] Lock [object=java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@3a9158aa, ownerName=null, ownerId=-1] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at o.a.i.i.processors.service.ServiceDeploymentManager$ServicesDeploymentWorker.body(ServiceDeploymentManager.java:466) at o.a.i.i.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) Thread [name="grid-nio-worker-client-listener-3-#40%RADAR_CACHE%", id=60, state=RUNNABLE, blockCnt=0, waitCnt=0] at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method) at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:314) at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:293) at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:174) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) - locked o.a.i.i.util.nio.SelectedSelectionKeySet@211469db - locked java.util.Collections$UnmodifiableSet@618afe9b - locked sun.nio.ch.WindowsSelectorImpl@5f04db44 at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at o.a.i.i.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2264) at o.a.i.i.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) at o.a.i.i.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) Thread [name="grid-nio-worker-client-listener-2-#39%RADAR_CACHE%", id=59, state=RUNNABLE, blockCnt=0, waitCnt=0] at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method) at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:314) at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:293) at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:174) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) - locked o.a.i.i.util.nio.SelectedSelectionKeySet@6fe08c06 - locked java.util.Collections$UnmodifiableSet@6db87a90 - locked sun.nio.ch.WindowsSelectorImpl@5bf03f9a at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at o.a.i.i.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2264) at o.a.i.i.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) at o.a.i.i.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) Thread [name="grid-nio-worker-client-listener-1-#38%RADAR_CACHE%", id=58, state=RUNNABLE, blockCnt=0, waitCnt=0] at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method) at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:314) at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:293) at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:174) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) - locked o.a.i.i.util.nio.SelectedSelectionKeySet@2257015b - locked java.util.Collections$UnmodifiableSet@493c29ab - locked sun.nio.ch.WindowsSelectorImpl@677eb6e6 at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at o.a.i.i.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2264) at o.a.i.i.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) at o.a.i.i.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) Thread [name="grid-nio-worker-client-listener-0-#37%RADAR_CACHE%", id=57, state=RUNNABLE, blockCnt=0, waitCnt=0] at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method) at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:314) at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:293) at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:174) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) - locked o.a.i.i.util.nio.SelectedSelectionKeySet@3d28597c - locked java.util.Collections$UnmodifiableSet@276fda5b - locked sun.nio.ch.WindowsSelectorImpl@fb6de6c at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at o.a.i.i.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2264) at o.a.i.i.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) at o.a.i.i.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) Thread [name="nio-acceptor-client-listener-#74%RADAR_CACHE%", id=97, state=RUNNABLE, blockCnt=0, waitCnt=0] at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method) at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:314) at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:293) at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:174) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) - locked sun.nio.ch.Util$3@1ded80fa - locked java.util.Collections$UnmodifiableSet@6271d982 - locked sun.nio.ch.WindowsSelectorImpl@3b956a95 at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at o.a.i.i.util.nio.GridNioServer$GridNioAcceptWorker.accept(GridNioServer.java:3074) at o.a.i.i.util.nio.GridNioServer$GridNioAcceptWorker.body(GridNioServer.java:3022) at o.a.i.i.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) Thread [name="exchange-worker-#73%RADAR_CACHE%", id=96, state=RUNNABLE, blockCnt=1, waitCnt=2] at o.a.i.i.util.tostring.GridToStringBuilder.getClassDescriptor(GridToStringBuilder.java:1852) at o.a.i.i.util.tostring.GridToStringBuilder.toStringImpl0(GridToStringBuilder.java:1090) at o.a.i.i.util.tostring.GridToStringBuilder.toStringImpl(GridToStringBuilder.java:1052) at o.a.i.i.util.tostring.GridToStringBuilder.toString(GridToStringBuilder.java:838) at o.a.i.i.processors.cache.StateChangeRequest.toString(StateChangeRequest.java:138) at java.lang.String.valueOf(String.java:2994) at java.lang.StringBuilder.append(StringBuilder.java:131) at o.a.i.i.processors.cache.ExchangeActions.toString(ExchangeActions.java:505) at java.lang.String.valueOf(String.java:2994) at java.lang.StringBuilder.append(StringBuilder.java:131) at o.a.i.i.processors.cache.GridCachePartitionExchangeManager.onClusterStateChangeFinish(GridCachePartitionExchangeManager.java:782) at o.a.i.i.processors.cache.GridCachePartitionExchangeManager.lambda$onDiscoveryEvent$c7b9d989$1(GridCachePartitionExchangeManager.java:635) at o.a.i.i.processors.cache.GridCachePartitionExchangeManager$$Lambda$672/1205925683.apply(Unknown Source) at o.a.i.i.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) at o.a.i.i.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) at o.a.i.i.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) at o.a.i.i.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) at o.a.i.i.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) at o.a.i.i.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture.onDone(GridDhtPartitionsExchangeFuture.java:2576) at o.a.i.i.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture.onDone(GridDhtPartitionsExchangeFuture.java:157) at o.a.i.i.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) at o.a.i.i.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture.init(GridDhtPartitionsExchangeFuture.java:1100) at o.a.i.i.processors.cache.GridCachePartitionExchangeManager$ExchangeWorker.body0(GridCachePartitionExchangeManager.java:3383) at o.a.i.i.processors.cache.GridCachePartitionExchangeManager$ExchangeWorker.body(GridCachePartitionExchangeManager.java:3205) at o.a.i.i.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) Thread [name="ignite-update-notifier-timer", id=95, state=TIMED_WAITING, blockCnt=1, waitCnt=2] at java.lang.Thread.sleep(Native Method) at o.a.i.i.processors.cluster.ClusterProcessor$UpdateNotifierTimerTask.safeRun(ClusterProcessor.java:1009) at o.a.i.i.util.GridTimerTask.run(GridTimerTask.java:34) at java.util.TimerThread.mainLoop(Timer.java:555) at java.util.TimerThread.run(Timer.java:505) Thread [name="upd-ver-checker", id=94, state=TIMED_WAITING, blockCnt=0, waitCnt=1] at java.lang.Thread.sleep(Native Method) at o.a.i.i.processors.cluster.GridUpdateNotifier$1.run(GridUpdateNotifier.java:115) at java.lang.Thread.run(Thread.java:748) Thread [name="disco-event-worker-#72%RADAR_CACHE%", id=93, state=WAITING, blockCnt=1, waitCnt=2] Lock [object=java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@2e99635, ownerName=null, ownerId=-1] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at o.a.i.i.managers.discovery.GridDiscoveryManager$DiscoveryWorker.body0(GridDiscoveryManager.java:3000) at o.a.i.i.managers.discovery.GridDiscoveryManager$DiscoveryWorker.body(GridDiscoveryManager.java:2971) at o.a.i.i.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) Thread [name="tcp-disco-ip-finder-cleaner-#12%RADAR_CACHE%-#71%RADAR_CACHE%", id=92, state=TIMED_WAITING, blockCnt=0, waitCnt=1] at java.lang.Thread.sleep(Native Method) at o.a.i.spi.discovery.tcp.ServerImpl$IpFinderCleaner.body(ServerImpl.java:2251) at o.a.i.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) Thread [name="tcp-disco-multicast-addr-sender-#7-#66", id=87, state=RUNNABLE, blockCnt=10, waitCnt=3] at java.net.TwoStacksPlainDatagramSocketImpl.receive0(Native Method) - locked java.net.TwoStacksPlainDatagramSocketImpl@73722cc2 at java.net.TwoStacksPlainDatagramSocketImpl.receive(TwoStacksPlainDatagramSocketImpl.java:114) - locked java.net.TwoStacksPlainDatagramSocketImpl@73722cc2 at java.net.DatagramSocket.receive(DatagramSocket.java:812) - locked java.net.DatagramPacket@1f2356e7 - locked java.net.MulticastSocket@f724654 at o.a.i.spi.discovery.tcp.ipfinder.multicast.TcpDiscoveryMulticastIpFinder$AddressSender.body(TcpDiscoveryMulticastIpFinder.java:890) at o.a.i.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) Thread [name="tcp-disco-multicast-addr-sender-#6-#65", id=86, state=RUNNABLE, blockCnt=5, waitCnt=3] at java.net.TwoStacksPlainDatagramSocketImpl.receive0(Native Method) - locked java.net.TwoStacksPlainDatagramSocketImpl@416421b1 at java.net.TwoStacksPlainDatagramSocketImpl.receive(TwoStacksPlainDatagramSocketImpl.java:114) - locked java.net.TwoStacksPlainDatagramSocketImpl@416421b1 at java.net.DatagramSocket.receive(DatagramSocket.java:812) - locked java.net.DatagramPacket@23920163 - locked java.net.MulticastSocket@2683ef98 at o.a.i.spi.discovery.tcp.ipfinder.multicast.TcpDiscoveryMulticastIpFinder$AddressSender.body(TcpDiscoveryMulticastIpFinder.java:890) at o.a.i.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) Thread [name="tcp-disco-multicast-addr-sender-#5-#64", id=85, state=RUNNABLE, blockCnt=4, waitCnt=1] at java.net.TwoStacksPlainDatagramSocketImpl.receive0(Native Method) - locked java.net.TwoStacksPlainDatagramSocketImpl@3b5e4dfa at java.net.TwoStacksPlainDatagramSocketImpl.receive(TwoStacksPlainDatagramSocketImpl.java:114) - locked java.net.TwoStacksPlainDatagramSocketImpl@3b5e4dfa at java.net.DatagramSocket.receive(DatagramSocket.java:812) - locked java.net.DatagramPacket@5b579a89 - locked java.net.MulticastSocket@68fd0199 at o.a.i.spi.discovery.tcp.ipfinder.multicast.TcpDiscoveryMulticastIpFinder$AddressSender.body(TcpDiscoveryMulticastIpFinder.java:890) at o.a.i.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) Thread [name="tcp-disco-multicast-addr-sender-#4-#63", id=84, state=RUNNABLE, blockCnt=4, waitCnt=2] at java.net.TwoStacksPlainDatagramSocketImpl.receive0(Native Method) - locked java.net.TwoStacksPlainDatagramSocketImpl@513bcc31 at java.net.TwoStacksPlainDatagramSocketImpl.receive(TwoStacksPlainDatagramSocketImpl.java:114) - locked java.net.TwoStacksPlainDatagramSocketImpl@513bcc31 at java.net.DatagramSocket.receive(DatagramSocket.java:812) - locked java.net.DatagramPacket@18437a71 - locked java.net.MulticastSocket@7fa73822 at o.a.i.spi.discovery.tcp.ipfinder.multicast.TcpDiscoveryMulticastIpFinder$AddressSender.body(TcpDiscoveryMulticastIpFinder.java:890) at o.a.i.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) Thread [name="tcp-disco-srvr-[:47500]-#3%RADAR_CACHE%-#62%RADAR_CACHE%", id=83, state=RUNNABLE, blockCnt=0, waitCnt=0] at java.net.DualStackPlainSocketImpl.accept0(Native Method) at java.net.DualStackPlainSocketImpl.socketAccept(DualStackPlainSocketImpl.java:131) at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:409) at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:199) - locked java.net.SocksSocketImpl@7f561f86 at java.net.ServerSocket.implAccept(ServerSocket.java:560) at java.net.ServerSocket.accept(ServerSocket.java:528) at o.a.i.spi.discovery.tcp.ServerImpl$TcpServer.body(ServerImpl.java:6665) at o.a.i.i.util.worker.GridWorker.run(GridWorker.java:120) at o.a.i.spi.discovery.tcp.ServerImpl$TcpServerThread.body(ServerImpl.java:6588) at o.a.i.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) Thread [name="tcp-disco-msg-worker-[crd]-#2%RADAR_CACHE%-#61%RADAR_CACHE%", id=82, state=TIMED_WAITING, blockCnt=0, waitCnt=1581] Lock [object=java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@70031e19, ownerName=null, ownerId=-1] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at java.util.concurrent.LinkedBlockingDeque.pollFirst(LinkedBlockingDeque.java:522) at java.util.concurrent.LinkedBlockingDeque.poll(LinkedBlockingDeque.java:684) at o.a.i.spi.discovery.tcp.ServerImpl$MessageWorker.body(ServerImpl.java:8113) at o.a.i.spi.discovery.tcp.ServerImpl$RingMessageWorker.body(ServerImpl.java:3099) at o.a.i.i.util.worker.GridWorker.run(GridWorker.java:120) at o.a.i.spi.discovery.tcp.ServerImpl$MessageWorkerThread.body(ServerImpl.java:8049) at o.a.i.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) Thread [name="disco-notifier-worker-#60%RADAR_CACHE%", id=81, state=WAITING, blockCnt=1, waitCnt=3] Lock [object=java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@7310629a, ownerName=null, ownerId=-1] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at o.a.i.i.managers.discovery.GridDiscoveryManager$DiscoveryMessageNotifierWorker.body0(GridDiscoveryManager.java:2746) at o.a.i.i.managers.discovery.GridDiscoveryManager$DiscoveryMessageNotifierWorker.body(GridDiscoveryManager.java:2791) at o.a.i.i.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) Thread [name="sys-#59%RADAR_CACHE%", id=80, state=TIMED_WAITING, blockCnt=0, waitCnt=3] Lock [object=java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@35b022f2, ownerName=null, ownerId=-1] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Thread [name="sys-#58%RADAR_CACHE%", id=79, state=TIMED_WAITING, blockCnt=0, waitCnt=3] Lock [object=java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@35b022f2, ownerName=null, ownerId=-1] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Thread [name="sys-#57%RADAR_CACHE%", id=78, state=TIMED_WAITING, blockCnt=0, waitCnt=4] Lock [object=java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@35b022f2, ownerName=null, ownerId=-1] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Thread [name="sys-#56%RADAR_CACHE%", id=77, state=RUNNABLE, blockCnt=1, waitCnt=3] at java.util.concurrent.locks.ReentrantLock$NonfairSync.tryAcquire(ReentrantLock.java:213) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:863) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2083) at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Locked synchronizers: java.util.concurrent.locks.ReentrantLock$NonfairSync@7a55b1ed Thread [name="sys-#55%RADAR_CACHE%", id=76, state=TIMED_WAITING, blockCnt=2, waitCnt=3] Lock [object=java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@35b022f2, ownerName=null, ownerId=-1] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Thread [name="sys-#54%RADAR_CACHE%", id=75, state=RUNNABLE, blockCnt=0, waitCnt=1] at sun.nio.fs.WindowsNativeDispatcher.CreateFile0(Native Method) at sun.nio.fs.WindowsNativeDispatcher.CreateFile(WindowsNativeDispatcher.java:71) at sun.nio.fs.WindowsChannelFactory.open(WindowsChannelFactory.java:302) at sun.nio.fs.WindowsChannelFactory.newFileChannel(WindowsChannelFactory.java:162) at sun.nio.fs.WindowsFileSystemProvider.checkReadAccess(WindowsFileSystemProvider.java:325) at sun.nio.fs.WindowsFileSystemProvider.checkAccess(WindowsFileSystemProvider.java:362) at java.nio.file.Files.exists(Files.java:2385) at o.a.i.i.processors.cache.persistence.file.FilePageStoreManager.storeCacheData(FilePageStoreManager.java:524) at o.a.i.i.processors.cache.GridLocalConfigManager.saveCacheConfiguration(GridLocalConfigManager.java:96) at o.a.i.i.processors.cache.GridCacheProcessor.saveCacheConfiguration(GridCacheProcessor.java:4034) at o.a.i.i.processors.cache.CachesRegistry$1.run(CachesRegistry.java:305) at o.a.i.i.util.IgniteUtils.wrapThreadLoader(IgniteUtils.java:7182) at o.a.i.i.processors.closure.GridClosureProcessor$1.body(GridClosureProcessor.java:829) at o.a.i.i.util.worker.GridWorker.run(GridWorker.java:120) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Locked synchronizers: java.util.concurrent.ThreadPoolExecutor$Worker@28958def Thread [name="sys-#53%RADAR_CACHE%", id=74, state=TIMED_WAITING, blockCnt=2, waitCnt=3] Lock [object=java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@35b022f2, ownerName=null, ownerId=-1] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Thread [name="sys-#52%RADAR_CACHE%", id=73, state=TIMED_WAITING, blockCnt=1, waitCnt=3] Lock [object=java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@35b022f2, ownerName=null, ownerId=-1] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Thread [name="Thread-6", id=72, state=TIMED_WAITING, blockCnt=0, waitCnt=10] Lock [object=java.util.concurrent.SynchronousQueue$TransferStack@124e8b68, ownerName=null, ownerId=-1] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Thread [name="ttl-cleanup-worker-#51%RADAR_CACHE%", id=71, state=RUNNABLE, blockCnt=0, waitCnt=2] at sun.management.ThreadImpl.dumpThreads0(Native Method) at sun.management.ThreadImpl.dumpAllThreads(ThreadImpl.java:454) at o.a.i.i.util.IgniteUtils.dumpThreads(IgniteUtils.java:1471) at o.a.i.i.processors.failure.FailureProcessor.process(FailureProcessor.java:192) - locked o.a.i.i.processors.failure.FailureProcessor@62ba3f09 at o.a.i.i.processors.failure.FailureProcessor.process(FailureProcessor.java:155) at o.a.i.i.processors.cache.GridCacheSharedTtlCleanupManager$CleanupWorker.body(GridCacheSharedTtlCleanupManager.java:238) at o.a.i.i.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) Thread [name="grid-data-loader-flusher-#47%RADAR_CACHE%", id=67, state=WAITING, blockCnt=0, waitCnt=1] Lock [object=java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@5629361e, ownerName=null, ownerId=-1] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.DelayQueue.take(DelayQueue.java:211) at o.a.i.i.processors.datastreamer.DataStreamProcessor$2.body(DataStreamProcessor.java:109) at o.a.i.i.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) Thread [name="grid-nio-worker-tcp-rest-3-#45%RADAR_CACHE%", id=65, state=RUNNABLE, blockCnt=0, waitCnt=0] at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method) at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:314) at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:293) at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:174) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) - locked o.a.i.i.util.nio.SelectedSelectionKeySet@1a42fef - locked java.util.Collections$UnmodifiableSet@67d7e178 - locked sun.nio.ch.WindowsSelectorImpl@54a6c8fc at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at o.a.i.i.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2264) at o.a.i.i.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) at o.a.i.i.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) Thread [name="grid-nio-worker-tcp-rest-2-#44%RADAR_CACHE%", id=64, state=RUNNABLE, blockCnt=0, waitCnt=0] at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method) at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:314) at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:293) at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:174) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) - locked o.a.i.i.util.nio.SelectedSelectionKeySet@4ba08db0 - locked java.util.Collections$UnmodifiableSet@6bdb087c - locked sun.nio.ch.WindowsSelectorImpl@335fe85e at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at o.a.i.i.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2264) at o.a.i.i.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) at o.a.i.i.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) Thread [name="grid-nio-worker-tcp-rest-1-#43%RADAR_CACHE%", id=63, state=RUNNABLE, blockCnt=0, waitCnt=0] at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method) at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:314) at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:293) at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:174) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) - locked o.a.i.i.util.nio.SelectedSelectionKeySet@515c37e1 - locked java.util.Collections$UnmodifiableSet@1edefd77 - locked sun.nio.ch.WindowsSelectorImpl@2d758e38 at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at o.a.i.i.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2264) at o.a.i.i.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) at o.a.i.i.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) Thread [name="grid-nio-worker-tcp-rest-0-#42%RADAR_CACHE%", id=62, state=RUNNABLE, blockCnt=0, waitCnt=0] at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method) at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:314) at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:293) at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:174) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) - locked o.a.i.i.util.nio.SelectedSelectionKeySet@61248ed0 - locked java.util.Collections$UnmodifiableSet@51775e2a - locked sun.nio.ch.WindowsSelectorImpl@38ab3436 at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at o.a.i.i.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2264) at o.a.i.i.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) at o.a.i.i.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) Thread [name="nio-acceptor-tcp-rest-#46%RADAR_CACHE%", id=66, state=RUNNABLE, blockCnt=0, waitCnt=0] at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method) at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:314) at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:293) at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:174) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) - locked sun.nio.ch.Util$3@392e7955 - locked java.util.Collections$UnmodifiableSet@7c3932ae - locked sun.nio.ch.WindowsSelectorImpl@17d4a50d at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at o.a.i.i.util.nio.GridNioServer$GridNioAcceptWorker.accept(GridNioServer.java:3074) at o.a.i.i.util.nio.GridNioServer$GridNioAcceptWorker.body(GridNioServer.java:3022) at o.a.i.i.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) Thread [name="long-qry-#36%RADAR_CACHE%", id=56, state=TIMED_WAITING, blockCnt=0, waitCnt=29] at java.lang.Thread.sleep(Native Method) at o.a.i.i.util.IgniteUtils.sleep(IgniteUtils.java:8025) at o.a.i.i.processors.query.h2.LongRunningQueryManager$1.body(LongRunningQueryManager.java:93) at o.a.i.i.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) Thread [name="page-lock-tracker-timeout", id=55, state=TIMED_WAITING, blockCnt=0, waitCnt=1] at java.lang.Thread.sleep(Native Method) at o.a.i.i.util.worker.CycleThread.run(CycleThread.java:47) Thread [name="binary-metadata-writer-#35%RADAR_CACHE%", id=54, state=WAITING, blockCnt=0, waitCnt=2] Lock [object=java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@76bf3945, ownerName=null, ownerId=-1] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at o.a.i.i.processors.cache.binary.BinaryMetadataFileStore$BinaryMetadataAsyncWriter.body0(BinaryMetadataFileStore.java:460) at o.a.i.i.processors.cache.binary.BinaryMetadataFileStore$BinaryMetadataAsyncWriter.body(BinaryMetadataFileStore.java:441) at o.a.i.i.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) Thread [name="Thread-5", id=53, state=RUNNABLE, blockCnt=0, waitCnt=0] at sun.nio.ch.Iocp.getQueuedCompletionStatus(Native Method) at sun.nio.ch.Iocp.access$300(Iocp.java:46) at sun.nio.ch.Iocp$EventHandlerTask.run(Iocp.java:333) at sun.nio.ch.AsynchronousChannelGroupImpl$1.run(AsynchronousChannelGroupImpl.java:112) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Locked synchronizers: java.util.concurrent.ThreadPoolExecutor$Worker@4b779a64 Thread [name="Thread-4", id=52, state=RUNNABLE, blockCnt=0, waitCnt=0] at sun.nio.ch.Iocp.getQueuedCompletionStatus(Native Method) at sun.nio.ch.Iocp.access$300(Iocp.java:46) at sun.nio.ch.Iocp$EventHandlerTask.run(Iocp.java:333) at sun.nio.ch.AsynchronousChannelGroupImpl$1.run(AsynchronousChannelGroupImpl.java:112) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Locked synchronizers: java.util.concurrent.ThreadPoolExecutor$Worker@6a87241b Thread [name="Thread-3", id=51, state=RUNNABLE, blockCnt=0, waitCnt=0] at sun.nio.ch.Iocp.getQueuedCompletionStatus(Native Method) at sun.nio.ch.Iocp.access$300(Iocp.java:46) at sun.nio.ch.Iocp$EventHandlerTask.run(Iocp.java:333) at sun.nio.ch.AsynchronousChannelGroupImpl$1.run(AsynchronousChannelGroupImpl.java:112) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Locked synchronizers: java.util.concurrent.ThreadPoolExecutor$Worker@47fceeda Thread [name="Thread-2", id=50, state=RUNNABLE, blockCnt=1, waitCnt=0] at sun.nio.ch.Iocp.getQueuedCompletionStatus(Native Method) at sun.nio.ch.Iocp.access$300(Iocp.java:46) at sun.nio.ch.Iocp$EventHandlerTask.run(Iocp.java:333) at sun.nio.ch.AsynchronousChannelGroupImpl$1.run(AsynchronousChannelGroupImpl.java:112) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Locked synchronizers: java.util.concurrent.ThreadPoolExecutor$Worker@73395545 Thread [name="Thread-1", id=49, state=RUNNABLE, blockCnt=0, waitCnt=0] at sun.nio.ch.Iocp.getQueuedCompletionStatus(Native Method) at sun.nio.ch.Iocp.access$300(Iocp.java:46) at sun.nio.ch.Iocp$EventHandlerTask.run(Iocp.java:333) at java.lang.Thread.run(Thread.java:748) Thread [name="tcp-comm-worker-#1%RADAR_CACHE%-#28%RADAR_CACHE%", id=42, state=TIMED_WAITING, blockCnt=0, waitCnt=1] Lock [object=java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@3c911216, ownerName=null, ownerId=-1] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) at o.a.i.spi.communication.tcp.internal.CommunicationWorker.body(CommunicationWorker.java:167) at o.a.i.i.util.worker.GridWorker.run(GridWorker.java:120) at o.a.i.spi.communication.tcp.TcpCommunicationSpi$6.body(TcpCommunicationSpi.java:928) at o.a.i.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) Thread [name="grid-nio-worker-tcp-comm-3-#26%TcpCommunicationSpi%", id=40, state=RUNNABLE, blockCnt=0, waitCnt=0] at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method) at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:314) at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:293) at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:174) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) - locked o.a.i.i.util.nio.SelectedSelectionKeySet@908fb68 - locked java.util.Collections$UnmodifiableSet@3bc6cb89 - locked sun.nio.ch.WindowsSelectorImpl@34bca8a5 at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at o.a.i.i.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2264) at o.a.i.i.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) at o.a.i.i.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) Thread [name="grid-nio-worker-tcp-comm-2-#25%TcpCommunicationSpi%", id=39, state=RUNNABLE, blockCnt=0, waitCnt=0] at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method) at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:314) at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:293) at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:174) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) - locked o.a.i.i.util.nio.SelectedSelectionKeySet@90d86 - locked java.util.Collections$UnmodifiableSet@4e947554 - locked sun.nio.ch.WindowsSelectorImpl@4303758c at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at o.a.i.i.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2264) at o.a.i.i.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) at o.a.i.i.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) Thread [name="grid-nio-worker-tcp-comm-1-#24%TcpCommunicationSpi%", id=38, state=RUNNABLE, blockCnt=0, waitCnt=0] at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method) at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:314) at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:293) at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:174) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) - locked o.a.i.i.util.nio.SelectedSelectionKeySet@122b14c9 - locked java.util.Collections$UnmodifiableSet@5a864e37 - locked sun.nio.ch.WindowsSelectorImpl@37d5bee6 at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at o.a.i.i.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2264) at o.a.i.i.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) at o.a.i.i.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) Thread [name="grid-nio-worker-tcp-comm-0-#23%TcpCommunicationSpi%", id=37, state=RUNNABLE, blockCnt=0, waitCnt=0] at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method) at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:314) at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:293) at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:174) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) - locked o.a.i.i.util.nio.SelectedSelectionKeySet@6fa21285 - locked java.util.Collections$UnmodifiableSet@2565cee4 - locked sun.nio.ch.WindowsSelectorImpl@4d7acb89 at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at o.a.i.i.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2264) at o.a.i.i.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) at o.a.i.i.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) Thread [name="nio-acceptor-tcp-comm-#27%TcpCommunicationSpi%", id=41, state=RUNNABLE, blockCnt=0, waitCnt=0] at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method) at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:314) at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:293) at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:174) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) - locked sun.nio.ch.Util$3@57427e4e - locked java.util.Collections$UnmodifiableSet@280b6819 - locked sun.nio.ch.WindowsSelectorImpl@23128112 at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at o.a.i.i.util.nio.GridNioServer$GridNioAcceptWorker.accept(GridNioServer.java:3074) at o.a.i.i.util.nio.GridNioServer$GridNioAcceptWorker.body(GridNioServer.java:3022) at o.a.i.i.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) Thread [name="grid-timeout-worker-#22%RADAR_CACHE%", id=36, state=TIMED_WAITING, blockCnt=2, waitCnt=91] Lock [object=java.lang.Object@382f307a, ownerName=null, ownerId=-1] at java.lang.Object.wait(Native Method) at o.a.i.i.processors.timeout.GridTimeoutProcessor$TimeoutWorker.body(GridTimeoutProcessor.java:269) at o.a.i.i.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) Thread [name="ignite-clock", id=35, state=TIMED_WAITING, blockCnt=0, waitCnt=1982] at java.lang.Thread.sleep(Native Method) at o.a.i.i.util.IgniteUtils$25.run(IgniteUtils.java:3508) at java.lang.Thread.run(Thread.java:748) Thread [name="pub-#21%RADAR_CACHE%", id=34, state=TIMED_WAITING, blockCnt=0, waitCnt=1] Lock [object=java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@7c5b993f, ownerName=null, ownerId=-1] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Thread [name="pub-#20%RADAR_CACHE%", id=33, state=TIMED_WAITING, blockCnt=0, waitCnt=1] Lock [object=java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@7c5b993f, ownerName=null, ownerId=-1] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Thread [name="pub-#19%RADAR_CACHE%", id=32, state=TIMED_WAITING, blockCnt=1, waitCnt=1] Lock [object=java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@7c5b993f, ownerName=null, ownerId=-1] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Thread [name="pub-#18%RADAR_CACHE%", id=31, state=TIMED_WAITING, blockCnt=1, waitCnt=1] Lock [object=java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@7c5b993f, ownerName=null, ownerId=-1] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Thread [name="pub-#17%RADAR_CACHE%", id=30, state=TIMED_WAITING, blockCnt=0, waitCnt=1] Lock [object=java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@7c5b993f, ownerName=null, ownerId=-1] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Thread [name="jvm-pause-detector-worker", id=29, state=TIMED_WAITING, blockCnt=0, waitCnt=496] at java.lang.Thread.sleep(Native Method) at o.a.i.i.LongJVMPauseDetector$1.run(LongJVMPauseDetector.java:124) Thread [name="data-streamer-stripe-7-#16%RADAR_CACHE%", id=28, state=WAITING, blockCnt=0, waitCnt=1] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304) at o.a.i.i.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:744) at o.a.i.i.util.StripedExecutor$Stripe.body(StripedExecutor.java:555) at o.a.i.i.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) Thread [name="data-streamer-stripe-6-#15%RADAR_CACHE%", id=27, state=WAITING, blockCnt=0, waitCnt=1] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304) at o.a.i.i.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:744) at o.a.i.i.util.StripedExecutor$Stripe.body(StripedExecutor.java:555) at o.a.i.i.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) Thread [name="data-streamer-stripe-5-#14%RADAR_CACHE%", id=26, state=WAITING, blockCnt=0, waitCnt=1] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304) at o.a.i.i.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:744) at o.a.i.i.util.StripedExecutor$Stripe.body(StripedExecutor.java:555) at o.a.i.i.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) Thread [name="data-streamer-stripe-4-#13%RADAR_CACHE%", id=25, state=WAITING, blockCnt=0, waitCnt=1] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304) at o.a.i.i.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:744) at o.a.i.i.util.StripedExecutor$Stripe.body(StripedExecutor.java:555) at o.a.i.i.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) Thread [name="data-streamer-stripe-3-#12%RADAR_CACHE%", id=24, state=WAITING, blockCnt=0, waitCnt=1] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304) at o.a.i.i.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:744) at o.a.i.i.util.StripedExecutor$Stripe.body(StripedExecutor.java:555) at o.a.i.i.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) Thread [name="data-streamer-stripe-2-#11%RADAR_CACHE%", id=23, state=WAITING, blockCnt=1, waitCnt=1] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304) at o.a.i.i.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:744) at o.a.i.i.util.StripedExecutor$Stripe.body(StripedExecutor.java:555) at o.a.i.i.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) Thread [name="data-streamer-stripe-1-#10%RADAR_CACHE%", id=22, state=WAITING, blockCnt=1, waitCnt=1] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304) at o.a.i.i.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:744) at o.a.i.i.util.StripedExecutor$Stripe.body(StripedExecutor.java:555) at o.a.i.i.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) Thread [name="data-streamer-stripe-0-#9%RADAR_CACHE%", id=21, state=WAITING, blockCnt=0, waitCnt=1] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304) at o.a.i.i.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:744) at o.a.i.i.util.StripedExecutor$Stripe.body(StripedExecutor.java:555) at o.a.i.i.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) Thread [name="sys-stripe-7-#8%RADAR_CACHE%", id=20, state=WAITING, blockCnt=12, waitCnt=681] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304) at o.a.i.i.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:744) at o.a.i.i.util.StripedExecutor$Stripe.body(StripedExecutor.java:555) at o.a.i.i.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) Thread [name="sys-stripe-6-#7%RADAR_CACHE%", id=19, state=WAITING, blockCnt=9, waitCnt=666] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304) at o.a.i.i.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:744) at o.a.i.i.util.StripedExecutor$Stripe.body(StripedExecutor.java:555) at o.a.i.i.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) Thread [name="sys-stripe-5-#6%RADAR_CACHE%", id=18, state=WAITING, blockCnt=14, waitCnt=694] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304) at o.a.i.i.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:744) at o.a.i.i.util.StripedExecutor$Stripe.body(StripedExecutor.java:555) at o.a.i.i.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) Thread [name="sys-stripe-4-#5%RADAR_CACHE%", id=17, state=WAITING, blockCnt=12, waitCnt=666] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304) at o.a.i.i.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:744) at o.a.i.i.util.StripedExecutor$Stripe.body(StripedExecutor.java:555) at o.a.i.i.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) Thread [name="sys-stripe-3-#4%RADAR_CACHE%", id=16, state=WAITING, blockCnt=12, waitCnt=677] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304) at o.a.i.i.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:744) at o.a.i.i.util.StripedExecutor$Stripe.body(StripedExecutor.java:555) at o.a.i.i.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) Thread [name="sys-stripe-2-#3%RADAR_CACHE%", id=15, state=WAITING, blockCnt=14, waitCnt=665] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304) at o.a.i.i.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:744) at o.a.i.i.util.StripedExecutor$Stripe.body(StripedExecutor.java:555) at o.a.i.i.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) Thread [name="sys-stripe-1-#2%RADAR_CACHE%", id=14, state=WAITING, blockCnt=11, waitCnt=682] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304) at o.a.i.i.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:744) at o.a.i.i.util.StripedExecutor$Stripe.body(StripedExecutor.java:555) at o.a.i.i.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) Thread [name="sys-stripe-0-#1%RADAR_CACHE%", id=13, state=WAITING, blockCnt=14, waitCnt=682] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304) at o.a.i.i.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:744) at o.a.i.i.util.StripedExecutor$Stripe.body(StripedExecutor.java:555) at o.a.i.i.util.worker.GridWorker.run(GridWorker.java:120) at java.lang.Thread.run(Thread.java:748) Thread [name="GC Daemon", id=12, state=TIMED_WAITING, blockCnt=0, waitCnt=1] Lock [object=sun.misc.GC$LatencyLock@fe37d0d, ownerName=null, ownerId=-1] at java.lang.Object.wait(Native Method) at sun.misc.GC$Daemon.run(GC.java:117) Thread [name="Abandoned connection cleanup thread", id=11, state=TIMED_WAITING, blockCnt=0, waitCnt=518] Lock [object=java.lang.ref.ReferenceQueue$Lock@38ce67f2, ownerName=null, ownerId=-1] at java.lang.Object.wait(Native Method) at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) at com.mysql.jdbc.AbandonedConnectionCleanupThread.run(AbandonedConnectionCleanupThread.java:41) Thread [name="Attach Listener", id=5, state=RUNNABLE, blockCnt=0, waitCnt=0] Thread [name="Signal Dispatcher", id=4, state=RUNNABLE, blockCnt=0, waitCnt=0] Thread [name="Finalizer", id=3, state=WAITING, blockCnt=4100, waitCnt=17] Lock [object=java.lang.ref.ReferenceQueue$Lock@79a33c71, ownerName=null, ownerId=-1] at java.lang.Object.wait(Native Method) at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:216) Thread [name="Reference Handler", id=2, state=WAITING, blockCnt=141, waitCnt=16] Lock [object=java.lang.ref.Reference$Lock@5991c01b, ownerName=null, ownerId=-1] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at java.lang.ref.Reference.tryHandlePending(Reference.java:191) at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:153) Thread [name="main", id=1, state=WAITING, blockCnt=17, waitCnt=173] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304) at o.a.i.i.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:178) at o.a.i.i.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) at o.a.i.i.cluster.IgniteClusterImpl.state(IgniteClusterImpl.java:379) at com.support.ignite.server.RadarServer.contextInitialized(RadarServer.java:75) at org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:4665) at org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:5126) - locked org.apache.catalina.core.StandardContext@5a955565 at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183) - locked org.apache.catalina.core.StandardContext@5a955565 at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1384) at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1374) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.tomcat.util.threads.InlineExecutorService.execute(InlineExecutorService.java:75) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:134) at org.apache.catalina.core.ContainerBase.startInternal(ContainerBase.java:909) - locked org.apache.catalina.core.StandardHost@41e36e46 at org.apache.catalina.core.StandardHost.startInternal(StandardHost.java:843) - locked org.apache.catalina.core.StandardHost@41e36e46 at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183) - locked org.apache.catalina.core.StandardHost@41e36e46 at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1384) at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1374) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.tomcat.util.threads.InlineExecutorService.execute(InlineExecutorService.java:75) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:134) at org.apache.catalina.core.ContainerBase.startInternal(ContainerBase.java:909) - locked org.apache.catalina.core.StandardEngine@4d0ec531 at org.apache.catalina.core.StandardEngine.startInternal(StandardEngine.java:262) - locked org.apache.catalina.core.StandardEngine@4d0ec531 at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183) - locked org.apache.catalina.core.StandardEngine@4d0ec531 at org.apache.catalina.core.StandardService.startInternal(StandardService.java:434) - locked org.apache.catalina.core.StandardEngine@4d0ec531 at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183) - locked org.apache.catalina.core.StandardService@634ca95 at org.apache.catalina.core.StandardServer.startInternal(StandardServer.java:930) - locked java.lang.Object@66142e96 at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183) - locked org.apache.catalina.core.StandardServer@1d082e88 at org.apache.catalina.startup.Catalina.start(Catalina.java:795) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:342) at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:473) Nov 02, 2021 11:40:32 AM java.util.logging.LogManager$RootLogger log SEVERE: JVM will be halted immediately due to the failure: [failureCtx=FailureContext [type=SYSTEM_WORKER_TERMINATION, err=class o.a.i.IgniteException: Failed to wait for initialization topology [err=null]]]