Container: container_e76_1487862040010_131981_01_000040 on hostName_8041 =========================================================================================== LogType:stderr Log Upload Time:Wed Mar 01 04:14:58 -0600 2017 LogLength:57543 Log Contents: 17/03/01 04:11:02 INFO executor.CoarseGrainedExecutorBackend: Registered signal handlers for [TERM, HUP, INT] 17/03/01 04:11:03 INFO spark.SecurityManager: Changing view acls to: userName 17/03/01 04:11:03 INFO spark.SecurityManager: Changing modify acls to: userName 17/03/01 04:11:03 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(userName); users with modify permissions: Set(userName) 17/03/01 04:11:03 INFO slf4j.Slf4jLogger: Slf4jLogger started 17/03/01 04:11:03 INFO Remoting: Starting remoting 17/03/01 04:11:03 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://driverPropsFetcher@hostName:50265] 17/03/01 04:11:03 INFO Remoting: Remoting now listens on addresses: [akka.tcp://driverPropsFetcher@hostName:50265] 17/03/01 04:11:03 INFO util.Utils: Successfully started service 'driverPropsFetcher' on port 50265. 17/03/01 04:11:04 INFO spark.SecurityManager: Changing view acls to: userName 17/03/01 04:11:04 INFO spark.SecurityManager: Changing modify acls to: userName 17/03/01 04:11:04 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(userName); users with modify permissions: Set(userName) 17/03/01 04:11:04 INFO remote.RemoteActorRefProvider$RemotingTerminator: Shutting down remote daemon. 17/03/01 04:11:04 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remote daemon shut down; proceeding with flushing remote transports. 17/03/01 04:11:04 INFO slf4j.Slf4jLogger: Slf4jLogger started 17/03/01 04:11:04 INFO Remoting: Starting remoting 17/03/01 04:11:04 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://sparkExecutor@hostName:36607] 17/03/01 04:11:04 INFO Remoting: Remoting now listens on addresses: [akka.tcp://sparkExecutor@hostName:36607] 17/03/01 04:11:04 INFO util.Utils: Successfully started service 'sparkExecutor' on port 36607. 17/03/01 04:11:04 INFO Remoting: Remoting shut down 17/03/01 04:11:04 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remoting shut down. 17/03/01 04:11:04 INFO storage.DiskBlockManager: Created local directory at /data/1/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-3dcec641-4608-46ba-8202-b9e2fe220019 17/03/01 04:11:04 INFO storage.DiskBlockManager: Created local directory at /data/2/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-28ba6ab3-c5cd-4752-9998-9bd5fe71a42f 17/03/01 04:11:04 INFO storage.DiskBlockManager: Created local directory at /data/3/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-0f6d295b-6b35-4e66-8256-7e69babc3b67 17/03/01 04:11:04 INFO storage.DiskBlockManager: Created local directory at /data/4/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-0286f5ef-ea22-4d7d-b00a-f5a27395a8cc 17/03/01 04:11:04 INFO storage.DiskBlockManager: Created local directory at /data/5/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-0eab5382-0049-4c83-a5b4-0647ac45a8d9 17/03/01 04:11:04 INFO storage.DiskBlockManager: Created local directory at /data/6/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-67d931bf-cd8a-4401-b804-c691fac053d8 17/03/01 04:11:04 INFO storage.DiskBlockManager: Created local directory at /data/7/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-8fcce679-258f-4775-b62f-9619c6f5dbf5 17/03/01 04:11:04 INFO storage.DiskBlockManager: Created local directory at /data/8/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-b47d3cdd-20fd-4089-85ee-45c8196f50fc 17/03/01 04:11:04 INFO storage.DiskBlockManager: Created local directory at /data/9/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-e4fa2c62-1d3b-43f8-86ee-9b7650307d01 17/03/01 04:11:04 INFO storage.DiskBlockManager: Created local directory at /data/10/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-87937df4-784f-4d04-980a-1a7a5b6ecb4f 17/03/01 04:11:04 INFO storage.DiskBlockManager: Created local directory at /data/11/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-d5a24cd9-7554-45e8-b446-ad70d94f15ad 17/03/01 04:11:04 INFO storage.DiskBlockManager: Created local directory at /data/12/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-e8564788-5790-4820-b5c4-929ba49d2aba 17/03/01 04:11:04 INFO storage.MemoryStore: MemoryStore started with capacity 7.8 GB 17/03/01 04:11:04 INFO executor.CoarseGrainedExecutorBackend: Connecting to driver: akka.tcp://sparkDriver@ipaddress:38995/user/CoarseGrainedScheduler 17/03/01 04:11:04 INFO executor.CoarseGrainedExecutorBackend: Successfully registered with driver 17/03/01 04:11:04 INFO executor.Executor: Starting executor ID 37 on host hostName 17/03/01 04:11:04 INFO util.Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 56472. 17/03/01 04:11:04 INFO netty.NettyBlockTransferService: Server created on 56472 17/03/01 04:11:04 INFO storage.BlockManagerMaster: Trying to register BlockManager 17/03/01 04:11:04 INFO storage.BlockManagerMaster: Registered BlockManager 17/03/01 04:12:03 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 54 17/03/01 04:12:03 INFO executor.Executor: Running task 28.0 in stage 2.0 (TID 54) 17/03/01 04:12:03 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 84 17/03/01 04:12:03 INFO storage.MemoryStore: ensureFreeSpace(9240) called with curMem=0, maxMem=8334920908 17/03/01 04:12:03 INFO storage.MemoryStore: Block broadcast_84_piece0 stored as bytes in memory (estimated size 9.0 KB, free 7.8 GB) 17/03/01 04:12:03 INFO broadcast.TorrentBroadcast: Reading broadcast variable 84 took 163 ms 17/03/01 04:12:03 INFO storage.MemoryStore: ensureFreeSpace(32704) called with curMem=9240, maxMem=8334920908 17/03/01 04:12:03 INFO storage.MemoryStore: Block broadcast_84 stored as values in memory (estimated size 31.9 KB, free 7.8 GB) 17/03/01 04:12:04 INFO codegen.GenerateMutableProjection: Code generated in 103.431734 ms 17/03/01 04:12:04 INFO codegen.GenerateUnsafeProjection: Code generated in 12.678921 ms 17/03/01 04:12:04 INFO codegen.GenerateMutableProjection: Code generated in 15.523665 ms 17/03/01 04:12:04 INFO codegen.GenerateUnsafeRowJoiner: Code generated in 9.055931 ms 17/03/01 04:12:04 INFO codegen.GenerateUnsafeProjection: Code generated in 8.669359 ms 17/03/01 04:12:04 INFO rdd.HadoopRDD: Input split: avro path/part-r-00013-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:0+80349426 17/03/01 04:12:04 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 58 17/03/01 04:12:04 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=41944, maxMem=8334920908 17/03/01 04:12:04 INFO storage.MemoryStore: Block broadcast_58_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:12:04 INFO broadcast.TorrentBroadcast: Reading broadcast variable 58 took 13 ms 17/03/01 04:12:04 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=66587, maxMem=8334920908 17/03/01 04:12:04 INFO storage.MemoryStore: Block broadcast_58 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:12:05 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 17/03/01 04:12:05 INFO Configuration.deprecation: mapred.tip.id is deprecated. Instead, use mapreduce.task.id 17/03/01 04:12:05 INFO Configuration.deprecation: mapred.task.id is deprecated. Instead, use mapreduce.task.attempt.id 17/03/01 04:12:05 INFO Configuration.deprecation: mapred.task.is.map is deprecated. Instead, use mapreduce.task.ismap 17/03/01 04:12:05 INFO Configuration.deprecation: mapred.task.partition is deprecated. Instead, use mapreduce.task.partition 17/03/01 04:12:05 INFO Configuration.deprecation: mapred.job.id is deprecated. Instead, use mapreduce.job.id 17/03/01 04:12:05 WARN security.UserGroupInformation: PriviledgedActionException as:userName (auth:SIMPLE) cause:org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:12:05 WARN ipc.Client: Exception encountered while connecting to the server : org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:12:05 WARN security.UserGroupInformation: PriviledgedActionException as:userName (auth:SIMPLE) cause:org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:12:09 INFO executor.Executor: Finished task 28.0 in stage 2.0 (TID 54). 2495 bytes result sent to driver 17/03/01 04:12:16 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 80 17/03/01 04:12:16 INFO executor.Executor: Running task 29.0 in stage 2.0 (TID 80) 17/03/01 04:12:20 INFO executor.Executor: Finished task 29.0 in stage 2.0 (TID 80). 2495 bytes result sent to driver 17/03/01 04:12:38 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 158 17/03/01 04:12:38 INFO executor.Executor: Running task 36.0 in stage 4.0 (TID 158) 17/03/01 04:12:38 INFO spark.MapOutputTrackerWorker: Updating epoch to 1 and clearing cache 17/03/01 04:12:38 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 86 17/03/01 04:12:38 INFO storage.MemoryStore: ensureFreeSpace(2290) called with curMem=413659, maxMem=8334920908 17/03/01 04:12:38 INFO storage.MemoryStore: Block broadcast_86_piece0 stored as bytes in memory (estimated size 2.2 KB, free 7.8 GB) 17/03/01 04:12:38 INFO broadcast.TorrentBroadcast: Reading broadcast variable 86 took 9 ms 17/03/01 04:12:38 INFO storage.MemoryStore: ensureFreeSpace(6544) called with curMem=415949, maxMem=8334920908 17/03/01 04:12:38 INFO storage.MemoryStore: Block broadcast_86 stored as values in memory (estimated size 6.4 KB, free 7.8 GB) 17/03/01 04:12:38 INFO resolver.CompanyResolverSparkTest: testing worker[ipaddress:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509] 17/03/01 04:12:38 ERROR : Failed to resolve default logging config file: config/java.util.logging.properties Console logging handler is not configured. 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: >>> __________ ________________ >>> / _/ ___/ |/ / _/_ __/ __/ >>> _/ // (7 7 // / / / / _/ >>> /___/\___/_/|_/___/ /_/ /___/ >>> >>> ver. 1.8.0#20161205-sha1:9ca40dbe >>> 2016 Copyright(C) Apache Software Foundation >>> >>> Ignite documentation: http://ignite.apache.org 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Config URL: n/a 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Daemon mode: off 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: OS: Linux 2.6.32-431.5.1.el6.x86_64 amd64 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: OS user: userName 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: PID: 18702 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Language runtime: Java Platform API Specification ver. 1.8 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM information: Java(TM) SE Runtime Environment 1.8.0_60-b27 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.60-b23 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM total memory: 14.0GB 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Remote Management [restart: off, REST: on, JMX (remote: off)] 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: IGNITE_HOME=null 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM arguments: [-XX:OnOutOfMemoryError=kill %p, -Xms15360m, -Xmx15360m, -Djava.io.tmpdir=/data/2/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/container_e76_1487862040010_131981_01_000040/tmp, -Dspark.driver.port=38995, -Dspark.ui.port=0, -Dspark.yarn.app.container.log.dir=/data/6/yarn/log/container/application_1487862040010_131981/container_e76_1487862040010_131981_01_000040] 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Configured caches ['ignite-marshaller-sys-cache', 'ignite-sys-cache', 'ignite-atomics-sys-cache'] 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: Configured plugins: 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: ^-- None 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: IPC shared memory server endpoint started [port=48100, tokDir=/data/2/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/container_e76_1487862040010_131981_01_000040/tmp/ignite/work/ipc/shmem/e2cba212-89dd-48dd-8d7e-821b5725fe03-18702] 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: Successfully bound shared memory communication to TCP port [port=48100, locHost=0.0.0.0/0.0.0.0] 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: Successfully bound to TCP port [port=47100, locHost=0.0.0.0/0.0.0.0] 17/03/01 04:12:38 WARN noop.NoopCheckpointSpi: Checkpoints are disabled (to enable configure any GridCheckpointSpi implementation) 17/03/01 04:12:38 WARN collision.GridCollisionManager: Collision resolution is disabled (all jobs will be activated upon arrival). 17/03/01 04:12:38 WARN noop.NoopSwapSpaceSpi: Swap space is disabled. To enable use FileSwapSpaceSpi. 17/03/01 04:12:39 INFO internal.IgniteKernal%WCA: Security status [authentication=off, tls/ssl=off] 17/03/01 04:12:39 INFO tcp.GridTcpRestProtocol: Command protocol successfully started [name=TCP binary, host=0.0.0.0/0.0.0.0, port=11211] 17/03/01 04:12:39 INFO internal.IgniteKernal%WCA: Non-loopback local IPs: 8 17/03/01 04:12:39 INFO internal.IgniteKernal%WCA: Enabled local MACs: 90B11C42FADD 17/03/01 04:12:39 INFO tcp.TcpDiscoverySpi: Successfully bound to TCP port [port=47500, localHost=0.0.0.0/0.0.0.0, locNodeId=e2cba212-89dd-48dd-8d7e-821b5725fe03] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=f9ce8dd7-2060-4c34-b597-d7bee86ebedb, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=21, intOrder=21, lastExchangeTime=1488363161680, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=21, servers=21, clients=0, CPUs=856, heap=340.0GB] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=6b1889dd-9de5-4f1b-8ec9-c123c7df8ea2, addrs=[, 127.0.0.1], sockAddrs=[hostName/:47500, /127.0.0.1:47500], discPort=47500, order=22, intOrder=22, lastExchangeTime=1488363161690, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=22, servers=22, clients=0, CPUs=896, heap=350.0GB] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=9fb6e583-cea0-4f78-b403-b403a8bc9a0e, addrs=[7, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/7:47500], discPort=47500, order=23, intOrder=23, lastExchangeTime=1488363161701, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=23, servers=23, clients=0, CPUs=936, heap=370.0GB] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=20860cae-2881-4311-a3f5-edaa160ef37f, addrs=[7, 127.0.0.1], sockAddrs=[hostName/7:47500, /127.0.0.1:47500], discPort=47500, order=24, intOrder=24, lastExchangeTime=1488363161701, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=24, servers=24, clients=0, CPUs=976, heap=380.0GB] 17/03/01 04:12:42 INFO cache.GridCacheProcessor: Started cache [name=ignite-sys-cache, mode=REPLICATED] 17/03/01 04:12:42 INFO cache.GridCacheProcessor: Started cache [name=ignite-atomics-sys-cache, mode=PARTITIONED] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=0d675d57-b9b9-4cff-a994-77337d618bbe, addrs=[4, 127.0.0.1], sockAddrs=[hostName/4:47500, /127.0.0.1:47500], discPort=47500, order=25, intOrder=25, lastExchangeTime=1488363161711, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=25, servers=25, clients=0, CPUs=1016, heap=400.0GB] 17/03/01 04:12:42 INFO cache.GridCacheProcessor: Started cache [name=WCAIgniteCache, mode=PARTITIONED] 17/03/01 04:12:42 INFO cache.GridCacheProcessor: Started cache [name=ignite-marshaller-sys-cache, mode=REPLICATED] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=a6343860-6e84-4d9c-9b87-84ffd76280cd, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=26, intOrder=26, lastExchangeTime=1488363161721, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=26, servers=26, clients=0, CPUs=1056, heap=410.0GB] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=479b18e6-54af-4313-85f7-c7525f6229a4, addrs=[, 127.0.0.1], sockAddrs=[hostName/:47500, /127.0.0.1:47500], discPort=47500, order=27, intOrder=27, lastExchangeTime=1488363161731, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=27, servers=27, clients=0, CPUs=1104, heap=430.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=20, minorTopVer=0], evt=NODE_JOINED, node=e2cba212-89dd-48dd-8d7e-821b5725fe03] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=058a99e8-3b65-4ec9-84b0-6f3502c2afce, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=28, intOrder=28, lastExchangeTime=1488363161741, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=28, servers=28, clients=0, CPUs=1144, heap=440.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=21, minorTopVer=0], evt=NODE_JOINED, node=f9ce8dd7-2060-4c34-b597-d7bee86ebedb] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=57c09d88-a4dc-4179-98b4-1144fd97d8cc, addrs=[35, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/35:47500], discPort=47500, order=29, intOrder=29, lastExchangeTime=1488363161751, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=29, servers=29, clients=0, CPUs=1192, heap=460.0GB] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=58298821-7aa9-4b58-ba15-e7f1ef2830fb, addrs=[3, 127.0.0.1], sockAddrs=[hostName/3:47500, /127.0.0.1:47500], discPort=47500, order=30, intOrder=30, lastExchangeTime=1488363161761, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=30, servers=30, clients=0, CPUs=1232, heap=470.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=22, minorTopVer=0], evt=NODE_JOINED, node=6b1889dd-9de5-4f1b-8ec9-c123c7df8ea2] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4d5de2f3-d975-4b28-b593-0cc0481cdc74, addrs=[03, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/03:47500], discPort=47500, order=31, intOrder=31, lastExchangeTime=1488363161771, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=31, servers=31, clients=0, CPUs=1280, heap=490.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=23, minorTopVer=0], evt=NODE_JOINED, node=9fb6e583-cea0-4f78-b403-b403a8bc9a0e] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=fa09caab-f4dc-43b6-ac8b-4a4bae6e7da6, addrs=[01, 127.0.0.1], sockAddrs=[hostName/01:47500, /127.0.0.1:47500], discPort=47500, order=32, intOrder=32, lastExchangeTime=1488363161781, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=32, servers=32, clients=0, CPUs=1320, heap=500.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=24, minorTopVer=0], evt=NODE_JOINED, node=20860cae-2881-4311-a3f5-edaa160ef37f] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=af5837f0-25ec-4f3d-a1c1-90c09dc424cb, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=33, intOrder=33, lastExchangeTime=1488363161811, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=33, servers=33, clients=0, CPUs=1360, heap=520.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=25, minorTopVer=0], evt=NODE_JOINED, node=0d675d57-b9b9-4cff-a994-77337d618bbe] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=e9e49d2d-5eeb-474f-8757-e447efc8ca8f, addrs=[6, 127.0.0.1], sockAddrs=[hostName/6:47500, /127.0.0.1:47500], discPort=47500, order=34, intOrder=34, lastExchangeTime=1488363161821, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=34, servers=34, clients=0, CPUs=1400, heap=530.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=26, minorTopVer=0], evt=NODE_JOINED, node=a6343860-6e84-4d9c-9b87-84ffd76280cd] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4b90e5a3-253a-435b-84ca-6b592610cf0c, addrs=[4, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/4:47500], discPort=47500, order=35, intOrder=35, lastExchangeTime=1488363161832, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=35, servers=35, clients=0, CPUs=1432, heap=550.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=27, minorTopVer=0], evt=NODE_JOINED, node=479b18e6-54af-4313-85f7-c7525f6229a4] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=8fd4eea2-2a45-4563-ae87-1848fd388a98, addrs=[3, 127.0.0.1], sockAddrs=[hostName/3:47500, /127.0.0.1:47500], discPort=47500, order=36, intOrder=36, lastExchangeTime=1488363161832, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=36, servers=36, clients=0, CPUs=1472, heap=560.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=28, minorTopVer=0], evt=NODE_JOINED, node=058a99e8-3b65-4ec9-84b0-6f3502c2afce] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=d7b45a02-0411-4028-acdf-f004e592f294, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=37, intOrder=37, lastExchangeTime=1488363161983, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=37, servers=37, clients=0, CPUs=1512, heap=580.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=29, minorTopVer=0], evt=NODE_JOINED, node=57c09d88-a4dc-4179-98b4-1144fd97d8cc] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=cf4e6e83-207e-42da-a55c-5621bc20b891, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=38, intOrder=38, lastExchangeTime=1488363162739, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=38, servers=38, clients=0, CPUs=1552, heap=590.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=30, minorTopVer=0], evt=NODE_JOINED, node=58298821-7aa9-4b58-ba15-e7f1ef2830fb] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=d8926a2c-2c00-4445-beb4-633c2d656c41, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=39, intOrder=39, lastExchangeTime=1488363162749, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=39, servers=39, clients=0, CPUs=1584, heap=610.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=31, minorTopVer=0], evt=NODE_JOINED, node=4d5de2f3-d975-4b28-b593-0cc0481cdc74] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4136a0c9-14d5-42b3-9a60-81689c800438, addrs=[3, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/3:47500], discPort=47500, order=40, intOrder=40, lastExchangeTime=1488363162961, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=40, servers=40, clients=0, CPUs=1624, heap=620.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=32, minorTopVer=0], evt=NODE_JOINED, node=fa09caab-f4dc-43b6-ac8b-4a4bae6e7da6] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=694a80b8-02a3-44c9-a2dd-45bed7d20a50, addrs=[1, 127.0.0.1], sockAddrs=[hostName/1:47500, /127.0.0.1:47500], discPort=47500, order=41, intOrder=41, lastExchangeTime=1488363162971, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=41, servers=41, clients=0, CPUs=1664, heap=640.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=33, minorTopVer=0], evt=NODE_JOINED, node=af5837f0-25ec-4f3d-a1c1-90c09dc424cb] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=34, minorTopVer=0], evt=NODE_JOINED, node=e9e49d2d-5eeb-474f-8757-e447efc8ca8f] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=35, minorTopVer=0], evt=NODE_JOINED, node=4b90e5a3-253a-435b-84ca-6b592610cf0c] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=36, minorTopVer=0], evt=NODE_JOINED, node=8fd4eea2-2a45-4563-ae87-1848fd388a98] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=37, minorTopVer=0], evt=NODE_JOINED, node=d7b45a02-0411-4028-acdf-f004e592f294] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=38, minorTopVer=0], evt=NODE_JOINED, node=cf4e6e83-207e-42da-a55c-5621bc20b891] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=39, minorTopVer=0], evt=NODE_JOINED, node=d8926a2c-2c00-4445-beb4-633c2d656c41] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=40, minorTopVer=0], evt=NODE_JOINED, node=4136a0c9-14d5-42b3-9a60-81689c800438] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-sys-cache, waitList=[]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-marshaller-sys-cache, waitList=[]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-atomics-sys-cache, waitList=[ignite-sys-cache, ignite-marshaller-sys-cache]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=WCAIgniteCache, waitList=[ignite-sys-cache, ignite-marshaller-sys-cache, ignite-atomics-sys-cache]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Rebalancing required [top=AffinityTopologyVersion [topVer=41, minorTopVer=0], evt=NODE_JOINED, node=694a80b8-02a3-44c9-a2dd-45bed7d20a50] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-marshaller-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=20, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=22] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=100, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=22] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-marshaller-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=20 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=20 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-atomics-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=23, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=22] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-atomics-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=0 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=WCAIgniteCache, mode=ASYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=23, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=22] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=WCAIgniteCache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=0 ms] 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: >>> +----------------------------------------------------------------------+ >>> Ignite ver. 1.8.0#20161205-sha1:9ca40dbeb7d559fcb299bdb6f5c90cdf8ce7e533 >>> +----------------------------------------------------------------------+ >>> OS name: Linux 2.6.32-431.5.1.el6.x86_64 amd64 >>> CPU(s): 32 >>> Heap: 15.0GB >>> VM name: 18702@hostName >>> Grid name: WCA >>> Local node [ID=E2CBA212-89DD-48DD-8D7E-821B5725FE03, order=20, clientMode=false] >>> Local node addresses: [hostName/8, /127.0.0.1] >>> Local ports: TCP:11211 TCP:47100 TCP:47500 TCP:48100 17/03/01 04:12:47 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=20, servers=20, clients=0, CPUs=816, heap=320.0GB] 17/03/01 04:12:47 INFO resolver.CompanyResolverSparkTest: Started ignite node on executor 17/03/01 04:12:47 INFO executor.Executor: Finished task 36.0 in stage 4.0 (TID 158). 931 bytes result sent to driver 17/03/01 04:12:49 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 163 17/03/01 04:12:49 INFO executor.Executor: Running task 28.0 in stage 5.0 (TID 163) 17/03/01 04:12:49 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 128 17/03/01 04:12:49 INFO storage.MemoryStore: ensureFreeSpace(7311) called with curMem=8834, maxMem=8334920908 17/03/01 04:12:49 INFO storage.MemoryStore: Block broadcast_128_piece0 stored as bytes in memory (estimated size 7.1 KB, free 7.8 GB) 17/03/01 04:12:49 INFO broadcast.TorrentBroadcast: Reading broadcast variable 128 took 7 ms 17/03/01 04:12:49 INFO storage.MemoryStore: ensureFreeSpace(28168) called with curMem=16145, maxMem=8334920908 17/03/01 04:12:49 INFO storage.MemoryStore: Block broadcast_128 stored as values in memory (estimated size 27.5 KB, free 7.8 GB) 17/03/01 04:12:49 INFO rdd.HadoopRDD: Input split: avro path/part-r-00013-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:0+80349426 17/03/01 04:12:49 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 102 17/03/01 04:12:49 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=44313, maxMem=8334920908 17/03/01 04:12:49 INFO storage.MemoryStore: Block broadcast_102_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:12:49 INFO broadcast.TorrentBroadcast: Reading broadcast variable 102 took 7 ms 17/03/01 04:12:49 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=68956, maxMem=8334920908 17/03/01 04:12:49 INFO storage.MemoryStore: Block broadcast_102 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:12:49 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=41, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, node=6172ee3a-eb33-4bf5-9080-c255f52caed8] 17/03/01 04:13:01 INFO executor.Executor: Finished task 28.0 in stage 5.0 (TID 163). 2098 bytes result sent to driver 17/03/01 04:13:01 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 208 17/03/01 04:13:01 INFO executor.Executor: Running task 65.0 in stage 5.0 (TID 208) 17/03/01 04:13:01 INFO rdd.HadoopRDD: Input split: avro path/part-r-00011-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:91130664+91130665 17/03/01 04:13:01 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 120 17/03/01 04:13:01 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=407194, maxMem=8334920908 17/03/01 04:13:01 INFO storage.MemoryStore: Block broadcast_120_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:13:01 INFO broadcast.TorrentBroadcast: Reading broadcast variable 120 took 12 ms 17/03/01 04:13:02 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=431837, maxMem=8334920908 17/03/01 04:13:02 INFO storage.MemoryStore: Block broadcast_120 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:13:15 INFO executor.Executor: Finished task 65.0 in stage 5.0 (TID 208). 2098 bytes result sent to driver 17/03/01 04:13:33 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 233 17/03/01 04:13:33 INFO executor.Executor: Running task 9.0 in stage 5.0 (TID 233) 17/03/01 04:13:33 INFO rdd.HadoopRDD: Input split: avro path/part-r-00023-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:37464516+37464516 17/03/01 04:13:33 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 92 17/03/01 04:13:33 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=778909, maxMem=8334920908 17/03/01 04:13:33 INFO storage.MemoryStore: Block broadcast_92_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:13:33 INFO broadcast.TorrentBroadcast: Reading broadcast variable 92 took 29 ms 17/03/01 04:13:33 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=803552, maxMem=8334920908 17/03/01 04:13:33 INFO storage.MemoryStore: Block broadcast_92 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:13:44 INFO executor.Executor: Finished task 9.0 in stage 5.0 (TID 233). 2098 bytes result sent to driver 17/03/01 04:13:47 INFO internal.IgniteKernal%WCA: Metrics for local node (to disable set 'metricsLogFrequency' to 0) ^-- Node [id=e2cba212, name=WCA, uptime=00:01:00:000] ^-- H/N/C [hosts=41, nodes=41, CPUs=1664] ^-- CPU [cur=4.2%, avg=6.13%, GC=0.27%] ^-- Heap [used=1540MB, free=89.41%, comm=14544MB] ^-- Non heap [used=119MB, free=-1%, comm=123MB] ^-- Public thread pool [active=0, idle=0, qSize=0] ^-- System thread pool [active=0, idle=64, qSize=0] ^-- Outbound messages queue [size=0] 17/03/01 04:13:52 INFO cluster.GridUpdateNotifier: Update status is not available. 17/03/01 04:14:00 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 272 17/03/01 04:14:00 INFO executor.Executor: Running task 28.0 in stage 7.0 (TID 272) 17/03/01 04:14:00 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 131 17/03/01 04:14:00 INFO storage.MemoryStore: ensureFreeSpace(2732) called with curMem=1150624, maxMem=8334920908 17/03/01 04:14:00 INFO storage.MemoryStore: Block broadcast_131_piece0 stored as bytes in memory (estimated size 2.7 KB, free 7.8 GB) 17/03/01 04:14:00 INFO broadcast.TorrentBroadcast: Reading broadcast variable 131 took 30 ms 17/03/01 04:14:00 INFO storage.MemoryStore: ensureFreeSpace(7336) called with curMem=1153356, maxMem=8334920908 17/03/01 04:14:00 INFO storage.MemoryStore: Block broadcast_131 stored as values in memory (estimated size 7.2 KB, free 7.8 GB) 17/03/01 04:14:00 INFO dao.CompanyDAO: testing[ipaddress:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509] 17/03/01 04:14:00 INFO dao.CompanyDAO: input company name inside Contains searchBAILEY AND WYANT P L L C AND BAILEY JOSEPH AND SLOTNICK MEMBER 17/03/01 04:14:22 INFO dao.CompanyDAO: look up time contains-5206 17/03/01 04:14:22 INFO executor.Executor: Finished task 28.0 in stage 7.0 (TID 272). 969 bytes result sent to driver 17/03/01 04:14:47 INFO internal.IgniteKernal%WCA: Metrics for local node (to disable set 'metricsLogFrequency' to 0) ^-- Node [id=e2cba212, name=WCA, uptime=00:02:00:033] ^-- H/N/C [hosts=41, nodes=41, CPUs=1664] ^-- CPU [cur=0.3%, avg=4.34%, GC=0%] ^-- Heap [used=4366MB, free=70.09%, comm=14602MB] ^-- Non heap [used=125MB, free=-1%, comm=126MB] ^-- Public thread pool [active=0, idle=0, qSize=0] ^-- System thread pool [active=0, idle=64, qSize=0] ^-- Outbound messages queue [size=0] 17/03/01 04:14:49 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 326 17/03/01 04:14:49 INFO executor.Executor: Running task 13.0 in stage 8.0 (TID 326) 17/03/01 04:14:49 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 132 17/03/01 04:14:49 INFO storage.MemoryStore: ensureFreeSpace(887) called with curMem=1160692, maxMem=8334920908 17/03/01 04:14:49 INFO storage.MemoryStore: Block broadcast_132_piece0 stored as bytes in memory (estimated size 887.0 B, free 7.8 GB) 17/03/01 04:14:49 INFO broadcast.TorrentBroadcast: Reading broadcast variable 132 took 131 ms 17/03/01 04:14:49 INFO storage.MemoryStore: ensureFreeSpace(1216) called with curMem=1161579, maxMem=8334920908 17/03/01 04:14:49 INFO storage.MemoryStore: Block broadcast_132 stored as values in memory (estimated size 1216.0 B, free 7.8 GB) 17/03/01 04:14:49 INFO tcp.GridTcpRestProtocol: Command protocol successfully stopped: TCP binary 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=4136a0c9-14d5-42b3-9a60-81689c800438, addrs=[3, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/3:47500], discPort=47500, order=40, intOrder=40, lastExchangeTime=1488363162961, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=42, servers=40, clients=0, CPUs=1624, heap=620.0GB] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=cf4e6e83-207e-42da-a55c-5621bc20b891, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=38, intOrder=38, lastExchangeTime=1488363162739, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=43, servers=39, clients=0, CPUs=1584, heap=610.0GB] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=d8926a2c-2c00-4445-beb4-633c2d656c41, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=39, intOrder=39, lastExchangeTime=1488363162749, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=44, servers=38, clients=0, CPUs=1552, heap=590.0GB] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=e9e49d2d-5eeb-474f-8757-e447efc8ca8f, addrs=[6, 127.0.0.1], sockAddrs=[hostName/6:47500, /127.0.0.1:47500], discPort=47500, order=34, intOrder=34, lastExchangeTime=1488363161821, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=45, servers=37, clients=0, CPUs=1512, heap=580.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=57c09d88-a4dc-4179-98b4-1144fd97d8cc, addrs=[35, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/35:47500], discPort=47500, order=29, intOrder=29, lastExchangeTime=1488363161751, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=46, servers=36, clients=0, CPUs=1464, heap=560.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=0d675d57-b9b9-4cff-a994-77337d618bbe, addrs=[4, 127.0.0.1], sockAddrs=[hostName/4:47500, /127.0.0.1:47500], discPort=47500, order=25, intOrder=25, lastExchangeTime=1488363161711, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=47, servers=35, clients=0, CPUs=1424, heap=550.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=a6343860-6e84-4d9c-9b87-84ffd76280cd, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=26, intOrder=26, lastExchangeTime=1488363161721, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=48, servers=34, clients=0, CPUs=1384, heap=530.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=9fb6e583-cea0-4f78-b403-b403a8bc9a0e, addrs=[7, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/7:47500], discPort=47500, order=23, intOrder=23, lastExchangeTime=1488363161701, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=49, servers=33, clients=0, CPUs=1344, heap=520.0GB] 17/03/01 04:14:51 WARN tcp.TcpDiscoverySpi: Failed to ping node (status check will be initiated): 8fd4eea2-2a45-4563-ae87-1848fd388a98 17/03/01 04:14:52 INFO cache.GridCacheProcessor: Stopped cache: ignite-marshaller-sys-cache 17/03/01 04:14:52 INFO cache.GridCacheProcessor: Stopped cache: ignite-sys-cache 17/03/01 04:14:52 INFO cache.GridCacheProcessor: Stopped cache: ignite-atomics-sys-cache 17/03/01 04:14:52 INFO cache.GridCacheProcessor: Stopped cache: WCAIgniteCache 17/03/01 04:14:52 INFO internal.IgniteKernal%WCA: >>> +---------------------------------------------------------------------------------+ >>> Ignite ver. 1.8.0#20161205-sha1:9ca40dbeb7d559fcb299bdb6f5c90cdf8ce7e533 stopped OK >>> +---------------------------------------------------------------------------------+ >>> Grid name: WCA >>> Grid uptime: 00:02:05:352 17/03/01 04:14:52 INFO executor.Executor: Finished task 13.0 in stage 8.0 (TID 326). 931 bytes result sent to driver 17/03/01 04:14:53 INFO executor.CoarseGrainedExecutorBackend: Driver commanded a shutdown 17/03/01 04:14:53 INFO storage.MemoryStore: MemoryStore cleared 17/03/01 04:14:53 INFO storage.BlockManager: BlockManager stopped 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Shutting down remote daemon. 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remote daemon shut down; proceeding with flushing remote transports. 17/03/01 04:14:53 INFO Remoting: Remoting shut down 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remoting shut down. 17/03/01 04:14:53 INFO util.ShutdownHookManager: Shutdown hook called LogType:stdout Log Upload Time:Wed Mar 01 04:14:58 -0600 2017 LogLength:3636 Log Contents: rEnd of the programe - [04:12:38] __________ ________________ [04:12:38] / _/ ___/ |/ / _/_ __/ __/ [04:12:38] _/ // (7 7 // / / / / _/ [04:12:38] /___/\___/_/|_/___/ /_/ /___/ [04:12:38] [04:12:38] ver. 1.8.0#20161205-sha1:9ca40dbe [04:12:38] 2016 Copyright(C) Apache Software Foundation [04:12:38] [04:12:38] Ignite documentation: http://ignite.apache.org [04:12:38] [04:12:38] Quiet mode. [04:12:38] ^-- To see **FULL** console log here add -DIGNITE_QUIET=false or "-v" to ignite.{sh|bat} [04:12:38] [04:12:38] OS: Linux 2.6.32-431.5.1.el6.x86_64 amd64 [04:12:38] VM information: Java(TM) SE Runtime Environment 1.8.0_60-b27 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.60-b23 [04:12:38] Configured plugins: [04:12:38] ^-- None [04:12:38] [04:12:39] Security status [authentication=off, tls/ssl=off] [04:12:42] Topology snapshot [ver=21, servers=21, clients=0, CPUs=856, heap=340.0GB] [04:12:42] Topology snapshot [ver=22, servers=22, clients=0, CPUs=896, heap=350.0GB] [04:12:42] Topology snapshot [ver=23, servers=23, clients=0, CPUs=936, heap=370.0GB] [04:12:42] Topology snapshot [ver=24, servers=24, clients=0, CPUs=976, heap=380.0GB] [04:12:42] Topology snapshot [ver=25, servers=25, clients=0, CPUs=1016, heap=400.0GB] [04:12:42] Topology snapshot [ver=26, servers=26, clients=0, CPUs=1056, heap=410.0GB] [04:12:42] Topology snapshot [ver=27, servers=27, clients=0, CPUs=1104, heap=430.0GB] [04:12:43] Topology snapshot [ver=28, servers=28, clients=0, CPUs=1144, heap=440.0GB] [04:12:43] Topology snapshot [ver=29, servers=29, clients=0, CPUs=1192, heap=460.0GB] [04:12:43] Topology snapshot [ver=30, servers=30, clients=0, CPUs=1232, heap=470.0GB] [04:12:43] Topology snapshot [ver=31, servers=31, clients=0, CPUs=1280, heap=490.0GB] [04:12:43] Topology snapshot [ver=32, servers=32, clients=0, CPUs=1320, heap=500.0GB] [04:12:44] Topology snapshot [ver=33, servers=33, clients=0, CPUs=1360, heap=520.0GB] [04:12:44] Topology snapshot [ver=34, servers=34, clients=0, CPUs=1400, heap=530.0GB] [04:12:44] Topology snapshot [ver=35, servers=35, clients=0, CPUs=1432, heap=550.0GB] [04:12:44] Topology snapshot [ver=36, servers=36, clients=0, CPUs=1472, heap=560.0GB] [04:12:44] Topology snapshot [ver=37, servers=37, clients=0, CPUs=1512, heap=580.0GB] [04:12:44] Topology snapshot [ver=38, servers=38, clients=0, CPUs=1552, heap=590.0GB] [04:12:45] Topology snapshot [ver=39, servers=39, clients=0, CPUs=1584, heap=610.0GB] [04:12:45] Topology snapshot [ver=40, servers=40, clients=0, CPUs=1624, heap=620.0GB] [04:12:45] Topology snapshot [ver=41, servers=41, clients=0, CPUs=1664, heap=640.0GB] [04:12:47] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [04:12:47] [04:12:47] Ignite node started OK (id=e2cba212, grid=WCA) [04:12:47] Topology snapshot [ver=20, servers=20, clients=0, CPUs=816, heap=320.0GB] [04:14:49] Topology snapshot [ver=42, servers=40, clients=0, CPUs=1624, heap=620.0GB] [04:14:49] Topology snapshot [ver=43, servers=39, clients=0, CPUs=1584, heap=610.0GB] [04:14:49] Topology snapshot [ver=44, servers=38, clients=0, CPUs=1552, heap=590.0GB] [04:14:49] Topology snapshot [ver=45, servers=37, clients=0, CPUs=1512, heap=580.0GB] [04:14:51] Topology snapshot [ver=46, servers=36, clients=0, CPUs=1464, heap=560.0GB] [04:14:51] Topology snapshot [ver=47, servers=35, clients=0, CPUs=1424, heap=550.0GB] [04:14:51] Topology snapshot [ver=48, servers=34, clients=0, CPUs=1384, heap=530.0GB] [04:14:51] Topology snapshot [ver=49, servers=33, clients=0, CPUs=1344, heap=520.0GB] [04:14:52] Ignite node stopped OK [name=WCA, uptime=00:02:05:352] Container: container_e76_1487862040010_131981_01_000005 on hostName_8041 =========================================================================================== LogType:stderr Log Upload Time:Wed Mar 01 04:14:58 -0600 2017 LogLength:160311 Log Contents: 17/03/01 04:10:59 INFO executor.CoarseGrainedExecutorBackend: Registered signal handlers for [TERM, HUP, INT] 17/03/01 04:11:00 INFO spark.SecurityManager: Changing view acls to: userName 17/03/01 04:11:00 INFO spark.SecurityManager: Changing modify acls to: userName 17/03/01 04:11:00 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(userName); users with modify permissions: Set(userName) 17/03/01 04:11:01 INFO slf4j.Slf4jLogger: Slf4jLogger started 17/03/01 04:11:01 INFO Remoting: Starting remoting 17/03/01 04:11:01 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://driverPropsFetcher@hostName:39942] 17/03/01 04:11:01 INFO Remoting: Remoting now listens on addresses: [akka.tcp://driverPropsFetcher@hostName:39942] 17/03/01 04:11:01 INFO util.Utils: Successfully started service 'driverPropsFetcher' on port 39942. 17/03/01 04:11:01 INFO spark.SecurityManager: Changing view acls to: userName 17/03/01 04:11:01 INFO spark.SecurityManager: Changing modify acls to: userName 17/03/01 04:11:01 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(userName); users with modify permissions: Set(userName) 17/03/01 04:11:01 INFO remote.RemoteActorRefProvider$RemotingTerminator: Shutting down remote daemon. 17/03/01 04:11:01 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remote daemon shut down; proceeding with flushing remote transports. 17/03/01 04:11:01 INFO slf4j.Slf4jLogger: Slf4jLogger started 17/03/01 04:11:01 INFO Remoting: Starting remoting 17/03/01 04:11:01 INFO Remoting: Remoting shut down 17/03/01 04:11:01 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remoting shut down. 17/03/01 04:11:01 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://sparkExecutor@hostName:50995] 17/03/01 04:11:01 INFO Remoting: Remoting now listens on addresses: [akka.tcp://sparkExecutor@hostName:50995] 17/03/01 04:11:01 INFO util.Utils: Successfully started service 'sparkExecutor' on port 50995. 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/1/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-1f8b08a2-f1fa-428a-ae2e-0f9e7f82fb56 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/2/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-72359b00-740e-4938-9c3a-a26bdd74f6ae 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/3/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-d2b377e2-526a-4009-8618-94df98698d97 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/4/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-53de5dc9-a573-48de-95ef-2f5a4d1471cc 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/5/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-1976b44a-4c02-420e-b881-6609343d91de 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/6/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-1f59fd70-cda7-42ce-ad05-67b774b73102 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/7/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-2e583a12-a919-46bb-8bc9-e60b043d8a8a 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/8/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-bc466bcb-a51c-4513-a6c3-0ec6fe1b1f89 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/9/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-3f2e106f-5bae-43df-af87-fcbf0f72b19b 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/10/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-1891b145-7756-43d6-84d6-471c4e962ee7 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/11/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-b11c24d6-2083-4276-a549-4807efb9015a 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/12/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-f56afc9d-ef6b-4ba6-af67-62ed5a2a7670 17/03/01 04:11:01 INFO storage.MemoryStore: MemoryStore started with capacity 7.8 GB 17/03/01 04:11:01 INFO executor.CoarseGrainedExecutorBackend: Connecting to driver: akka.tcp://sparkDriver@ipaddress:38995/user/CoarseGrainedScheduler 17/03/01 04:11:01 INFO executor.CoarseGrainedExecutorBackend: Successfully registered with driver 17/03/01 04:11:01 INFO executor.Executor: Starting executor ID 3 on host hostName 17/03/01 04:11:01 INFO util.Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 56293. 17/03/01 04:11:01 INFO netty.NettyBlockTransferService: Server created on 56293 17/03/01 04:11:01 INFO storage.BlockManagerMaster: Trying to register BlockManager 17/03/01 04:11:01 INFO storage.BlockManagerMaster: Registered BlockManager 17/03/01 04:11:02 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 15 17/03/01 04:11:02 INFO executor.Executor: Running task 15.0 in stage 0.0 (TID 15) 17/03/01 04:11:02 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 0 17/03/01 04:11:02 INFO storage.MemoryStore: ensureFreeSpace(1310) called with curMem=0, maxMem=8334920908 17/03/01 04:11:02 INFO storage.MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 1310.0 B, free 7.8 GB) 17/03/01 04:11:02 INFO broadcast.TorrentBroadcast: Reading broadcast variable 0 took 237 ms 17/03/01 04:11:02 INFO storage.MemoryStore: ensureFreeSpace(2064) called with curMem=1310, maxMem=8334920908 17/03/01 04:11:02 INFO storage.MemoryStore: Block broadcast_0 stored as values in memory (estimated size 2.0 KB, free 7.8 GB) 17/03/01 04:11:02 INFO resolver.CompanyResolverSparkTest: Ranjit exec test 17/03/01 04:11:02 INFO executor.Executor: Finished task 15.0 in stage 0.0 (TID 15). 972 bytes result sent to driver 17/03/01 04:12:03 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 49 17/03/01 04:12:03 INFO executor.Executor: Running task 18.0 in stage 2.0 (TID 49) 17/03/01 04:12:03 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 84 17/03/01 04:12:03 INFO storage.MemoryStore: ensureFreeSpace(9240) called with curMem=3374, maxMem=8334920908 17/03/01 04:12:03 INFO storage.MemoryStore: Block broadcast_84_piece0 stored as bytes in memory (estimated size 9.0 KB, free 7.8 GB) 17/03/01 04:12:03 INFO broadcast.TorrentBroadcast: Reading broadcast variable 84 took 9 ms 17/03/01 04:12:03 INFO storage.MemoryStore: ensureFreeSpace(32704) called with curMem=12614, maxMem=8334920908 17/03/01 04:12:03 INFO storage.MemoryStore: Block broadcast_84 stored as values in memory (estimated size 31.9 KB, free 7.8 GB) 17/03/01 04:12:04 INFO codegen.GenerateMutableProjection: Code generated in 103.015076 ms 17/03/01 04:12:04 INFO codegen.GenerateUnsafeProjection: Code generated in 12.018473 ms 17/03/01 04:12:04 INFO codegen.GenerateMutableProjection: Code generated in 16.427265 ms 17/03/01 04:12:04 INFO codegen.GenerateUnsafeRowJoiner: Code generated in 8.608928 ms 17/03/01 04:12:04 INFO codegen.GenerateUnsafeProjection: Code generated in 9.704793 ms 17/03/01 04:12:04 INFO rdd.HadoopRDD: Input split: avro path/part-r-00026-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:0+37540068 17/03/01 04:12:04 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 53 17/03/01 04:12:04 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=45318, maxMem=8334920908 17/03/01 04:12:04 INFO storage.MemoryStore: Block broadcast_53_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:12:04 INFO broadcast.TorrentBroadcast: Reading broadcast variable 53 took 12 ms 17/03/01 04:12:04 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=69961, maxMem=8334920908 17/03/01 04:12:04 INFO storage.MemoryStore: Block broadcast_53 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:12:04 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 17/03/01 04:12:04 INFO Configuration.deprecation: mapred.tip.id is deprecated. Instead, use mapreduce.task.id 17/03/01 04:12:04 INFO Configuration.deprecation: mapred.task.id is deprecated. Instead, use mapreduce.task.attempt.id 17/03/01 04:12:04 INFO Configuration.deprecation: mapred.task.is.map is deprecated. Instead, use mapreduce.task.ismap 17/03/01 04:12:04 INFO Configuration.deprecation: mapred.task.partition is deprecated. Instead, use mapreduce.task.partition 17/03/01 04:12:04 INFO Configuration.deprecation: mapred.job.id is deprecated. Instead, use mapreduce.job.id 17/03/01 04:12:04 WARN security.UserGroupInformation: PriviledgedActionException as:userName (auth:SIMPLE) cause:org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:12:04 WARN ipc.Client: Exception encountered while connecting to the server : org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:12:04 WARN security.UserGroupInformation: PriviledgedActionException as:userName (auth:SIMPLE) cause:org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:12:07 INFO executor.Executor: Finished task 18.0 in stage 2.0 (TID 49). 2494 bytes result sent to driver 17/03/01 04:12:07 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 62 17/03/01 04:12:07 INFO executor.Executor: Running task 19.0 in stage 2.0 (TID 62) 17/03/01 04:12:07 INFO rdd.HadoopRDD: Input split: avro path/part-r-00026-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:37540068+37540069 17/03/01 04:12:09 INFO executor.Executor: Finished task 19.0 in stage 2.0 (TID 62). 2494 bytes result sent to driver 17/03/01 04:12:38 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 145 17/03/01 04:12:38 INFO executor.Executor: Running task 23.0 in stage 4.0 (TID 145) 17/03/01 04:12:38 INFO spark.MapOutputTrackerWorker: Updating epoch to 1 and clearing cache 17/03/01 04:12:38 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 86 17/03/01 04:12:38 INFO storage.MemoryStore: ensureFreeSpace(2290) called with curMem=417033, maxMem=8334920908 17/03/01 04:12:38 INFO storage.MemoryStore: Block broadcast_86_piece0 stored as bytes in memory (estimated size 2.2 KB, free 7.8 GB) 17/03/01 04:12:38 INFO broadcast.TorrentBroadcast: Reading broadcast variable 86 took 12 ms 17/03/01 04:12:38 INFO storage.MemoryStore: ensureFreeSpace(6544) called with curMem=419323, maxMem=8334920908 17/03/01 04:12:38 INFO storage.MemoryStore: Block broadcast_86 stored as values in memory (estimated size 6.4 KB, free 7.8 GB) 17/03/01 04:12:38 INFO resolver.CompanyResolverSparkTest: testing worker[ipaddress:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509] 17/03/01 04:12:38 ERROR : Failed to resolve default logging config file: config/java.util.logging.properties Console logging handler is not configured. 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: >>> __________ ________________ >>> / _/ ___/ |/ / _/_ __/ __/ >>> _/ // (7 7 // / / / / _/ >>> /___/\___/_/|_/___/ /_/ /___/ >>> >>> ver. 1.8.0#20161205-sha1:9ca40dbe >>> 2016 Copyright(C) Apache Software Foundation >>> >>> Ignite documentation: http://ignite.apache.org 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Config URL: n/a 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Daemon mode: off 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: OS: Linux 2.6.32-431.5.1.el6.x86_64 amd64 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: OS user: userName 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: PID: 44151 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Language runtime: Java Platform API Specification ver. 1.8 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM information: Java(TM) SE Runtime Environment 1.8.0_60-b27 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.60-b23 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM total memory: 14.0GB 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Remote Management [restart: off, REST: on, JMX (remote: off)] 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: IGNITE_HOME=null 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM arguments: [-XX:OnOutOfMemoryError=kill %p, -Xms15360m, -Xmx15360m, -Djava.io.tmpdir=/data/11/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/container_e76_1487862040010_131981_01_000005/tmp, -Dspark.driver.port=38995, -Dspark.ui.port=0, -Dspark.yarn.app.container.log.dir=/data/11/yarn/log/container/application_1487862040010_131981/container_e76_1487862040010_131981_01_000005] 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Configured caches ['ignite-marshaller-sys-cache', 'ignite-sys-cache', 'ignite-atomics-sys-cache'] 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: Configured plugins: 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: ^-- None 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: IPC shared memory server endpoint started [port=48100, tokDir=/data/11/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/container_e76_1487862040010_131981_01_000005/tmp/ignite/work/ipc/shmem/6b1889dd-9de5-4f1b-8ec9-c123c7df8ea2-44151] 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: Successfully bound shared memory communication to TCP port [port=48100, locHost=0.0.0.0/0.0.0.0] 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: Successfully bound to TCP port [port=47100, locHost=0.0.0.0/0.0.0.0] 17/03/01 04:12:39 WARN noop.NoopCheckpointSpi: Checkpoints are disabled (to enable configure any GridCheckpointSpi implementation) 17/03/01 04:12:39 WARN collision.GridCollisionManager: Collision resolution is disabled (all jobs will be activated upon arrival). 17/03/01 04:12:39 WARN noop.NoopSwapSpaceSpi: Swap space is disabled. To enable use FileSwapSpaceSpi. 17/03/01 04:12:39 INFO internal.IgniteKernal%WCA: Security status [authentication=off, tls/ssl=off] 17/03/01 04:12:39 INFO tcp.GridTcpRestProtocol: Command protocol successfully started [name=TCP binary, host=0.0.0.0/0.0.0.0, port=11211] 17/03/01 04:12:39 INFO internal.IgniteKernal%WCA: Non-loopback local IPs: 17/03/01 04:12:39 INFO internal.IgniteKernal%WCA: Enabled local MACs: 44A84210B322 17/03/01 04:12:39 INFO tcp.TcpDiscoverySpi: Successfully bound to TCP port [port=47500, localHost=0.0.0.0/0.0.0.0, locNodeId=6b1889dd-9de5-4f1b-8ec9-c123c7df8ea2] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=9fb6e583-cea0-4f78-b403-b403a8bc9a0e, addrs=[7, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/7:47500], discPort=47500, order=23, intOrder=23, lastExchangeTime=1488363161973, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=23, servers=23, clients=0, CPUs=936, heap=370.0GB] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=20860cae-2881-4311-a3f5-edaa160ef37f, addrs=[7, 127.0.0.1], sockAddrs=[hostName/7:47500, /127.0.0.1:47500], discPort=47500, order=24, intOrder=24, lastExchangeTime=1488363161983, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=24, servers=24, clients=0, CPUs=976, heap=380.0GB] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=0d675d57-b9b9-4cff-a994-77337d618bbe, addrs=[4, 127.0.0.1], sockAddrs=[hostName/4:47500, /127.0.0.1:47500], discPort=47500, order=25, intOrder=25, lastExchangeTime=1488363161993, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=25, servers=25, clients=0, CPUs=1016, heap=400.0GB] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=a6343860-6e84-4d9c-9b87-84ffd76280cd, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=26, intOrder=26, lastExchangeTime=1488363162003, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=26, servers=26, clients=0, CPUs=1056, heap=410.0GB] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=479b18e6-54af-4313-85f7-c7525f6229a4, addrs=[, 127.0.0.1], sockAddrs=[hostName/:47500, /127.0.0.1:47500], discPort=47500, order=27, intOrder=27, lastExchangeTime=1488363162013, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=27, servers=27, clients=0, CPUs=1104, heap=430.0GB] 17/03/01 04:12:42 INFO cache.GridCacheProcessor: Started cache [name=ignite-sys-cache, mode=REPLICATED] 17/03/01 04:12:42 INFO cache.GridCacheProcessor: Started cache [name=ignite-atomics-sys-cache, mode=PARTITIONED] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=058a99e8-3b65-4ec9-84b0-6f3502c2afce, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=28, intOrder=28, lastExchangeTime=1488363162034, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=28, servers=28, clients=0, CPUs=1144, heap=440.0GB] 17/03/01 04:12:43 INFO cache.GridCacheProcessor: Started cache [name=WCAIgniteCache, mode=PARTITIONED] 17/03/01 04:12:43 INFO cache.GridCacheProcessor: Started cache [name=ignite-marshaller-sys-cache, mode=REPLICATED] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=57c09d88-a4dc-4179-98b4-1144fd97d8cc, addrs=[35, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/35:47500], discPort=47500, order=29, intOrder=29, lastExchangeTime=1488363162044, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=29, servers=29, clients=0, CPUs=1192, heap=460.0GB] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=58298821-7aa9-4b58-ba15-e7f1ef2830fb, addrs=[3, 127.0.0.1], sockAddrs=[hostName/3:47500, /127.0.0.1:47500], discPort=47500, order=30, intOrder=30, lastExchangeTime=1488363162054, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=30, servers=30, clients=0, CPUs=1232, heap=470.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=22, minorTopVer=0], evt=NODE_JOINED, node=6b1889dd-9de5-4f1b-8ec9-c123c7df8ea2] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4d5de2f3-d975-4b28-b593-0cc0481cdc74, addrs=[03, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/03:47500], discPort=47500, order=31, intOrder=31, lastExchangeTime=1488363162054, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=31, servers=31, clients=0, CPUs=1280, heap=490.0GB] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=fa09caab-f4dc-43b6-ac8b-4a4bae6e7da6, addrs=[01, 127.0.0.1], sockAddrs=[hostName/01:47500, /127.0.0.1:47500], discPort=47500, order=32, intOrder=32, lastExchangeTime=1488363162075, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=32, servers=32, clients=0, CPUs=1320, heap=500.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=23, minorTopVer=0], evt=NODE_JOINED, node=9fb6e583-cea0-4f78-b403-b403a8bc9a0e] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=24, minorTopVer=0], evt=NODE_JOINED, node=20860cae-2881-4311-a3f5-edaa160ef37f] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=af5837f0-25ec-4f3d-a1c1-90c09dc424cb, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=33, intOrder=33, lastExchangeTime=1488363162085, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=33, servers=33, clients=0, CPUs=1360, heap=520.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=25, minorTopVer=0], evt=NODE_JOINED, node=0d675d57-b9b9-4cff-a994-77337d618bbe] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=e9e49d2d-5eeb-474f-8757-e447efc8ca8f, addrs=[6, 127.0.0.1], sockAddrs=[hostName/6:47500, /127.0.0.1:47500], discPort=47500, order=34, intOrder=34, lastExchangeTime=1488363162095, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=34, servers=34, clients=0, CPUs=1400, heap=530.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=26, minorTopVer=0], evt=NODE_JOINED, node=a6343860-6e84-4d9c-9b87-84ffd76280cd] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4b90e5a3-253a-435b-84ca-6b592610cf0c, addrs=[4, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/4:47500], discPort=47500, order=35, intOrder=35, lastExchangeTime=1488363162095, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=35, servers=35, clients=0, CPUs=1432, heap=550.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=27, minorTopVer=0], evt=NODE_JOINED, node=479b18e6-54af-4313-85f7-c7525f6229a4] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=8fd4eea2-2a45-4563-ae87-1848fd388a98, addrs=[3, 127.0.0.1], sockAddrs=[hostName/3:47500, /127.0.0.1:47500], discPort=47500, order=36, intOrder=36, lastExchangeTime=1488363162105, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=36, servers=36, clients=0, CPUs=1472, heap=560.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=28, minorTopVer=0], evt=NODE_JOINED, node=058a99e8-3b65-4ec9-84b0-6f3502c2afce] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=d7b45a02-0411-4028-acdf-f004e592f294, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=37, intOrder=37, lastExchangeTime=1488363162156, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=37, servers=37, clients=0, CPUs=1512, heap=580.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=29, minorTopVer=0], evt=NODE_JOINED, node=57c09d88-a4dc-4179-98b4-1144fd97d8cc] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=cf4e6e83-207e-42da-a55c-5621bc20b891, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=38, intOrder=38, lastExchangeTime=1488363162755, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=38, servers=38, clients=0, CPUs=1552, heap=590.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=30, minorTopVer=0], evt=NODE_JOINED, node=58298821-7aa9-4b58-ba15-e7f1ef2830fb] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=d8926a2c-2c00-4445-beb4-633c2d656c41, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=39, intOrder=39, lastExchangeTime=1488363162755, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=39, servers=39, clients=0, CPUs=1584, heap=610.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=31, minorTopVer=0], evt=NODE_JOINED, node=4d5de2f3-d975-4b28-b593-0cc0481cdc74] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4136a0c9-14d5-42b3-9a60-81689c800438, addrs=[3, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/3:47500], discPort=47500, order=40, intOrder=40, lastExchangeTime=1488363162972, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=40, servers=40, clients=0, CPUs=1624, heap=620.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=32, minorTopVer=0], evt=NODE_JOINED, node=fa09caab-f4dc-43b6-ac8b-4a4bae6e7da6] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=694a80b8-02a3-44c9-a2dd-45bed7d20a50, addrs=[1, 127.0.0.1], sockAddrs=[hostName/1:47500, /127.0.0.1:47500], discPort=47500, order=41, intOrder=41, lastExchangeTime=1488363162982, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=41, servers=41, clients=0, CPUs=1664, heap=640.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=33, minorTopVer=0], evt=NODE_JOINED, node=af5837f0-25ec-4f3d-a1c1-90c09dc424cb] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=34, minorTopVer=0], evt=NODE_JOINED, node=e9e49d2d-5eeb-474f-8757-e447efc8ca8f] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=35, minorTopVer=0], evt=NODE_JOINED, node=4b90e5a3-253a-435b-84ca-6b592610cf0c] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=36, minorTopVer=0], evt=NODE_JOINED, node=8fd4eea2-2a45-4563-ae87-1848fd388a98] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=37, minorTopVer=0], evt=NODE_JOINED, node=d7b45a02-0411-4028-acdf-f004e592f294] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=38, minorTopVer=0], evt=NODE_JOINED, node=cf4e6e83-207e-42da-a55c-5621bc20b891] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=39, minorTopVer=0], evt=NODE_JOINED, node=d8926a2c-2c00-4445-beb4-633c2d656c41] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=40, minorTopVer=0], evt=NODE_JOINED, node=4136a0c9-14d5-42b3-9a60-81689c800438] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-sys-cache, waitList=[]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-marshaller-sys-cache, waitList=[]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-atomics-sys-cache, waitList=[ignite-sys-cache, ignite-marshaller-sys-cache]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=WCAIgniteCache, waitList=[ignite-sys-cache, ignite-marshaller-sys-cache, ignite-atomics-sys-cache]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Rebalancing required [top=AffinityTopologyVersion [topVer=41, minorTopVer=0], evt=NODE_JOINED, node=694a80b8-02a3-44c9-a2dd-45bed7d20a50] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-marshaller-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=20, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=20] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=100, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=20] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-marshaller-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=20 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=20 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-atomics-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=24, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=20] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-atomics-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=10 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=WCAIgniteCache, mode=ASYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=24, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=20] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=WCAIgniteCache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=10 ms] 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: >>> +----------------------------------------------------------------------+ >>> Ignite ver. 1.8.0#20161205-sha1:9ca40dbeb7d559fcb299bdb6f5c90cdf8ce7e533 >>> +----------------------------------------------------------------------+ >>> OS name: Linux 2.6.32-431.5.1.el6.x86_64 amd64 >>> CPU(s): 40 >>> Heap: 15.0GB >>> VM name: 44151@hostName >>> Grid name: WCA >>> Local node [ID=6B1889DD-9DE5-4F1B-8EC9-C123C7DF8EA2, order=22, clientMode=false] >>> Local node addresses: [hostName/, /127.0.0.1] >>> Local ports: TCP:11211 TCP:47100 TCP:47500 TCP:48100 17/03/01 04:12:47 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=22, servers=22, clients=0, CPUs=896, heap=350.0GB] 17/03/01 04:12:47 INFO resolver.CompanyResolverSparkTest: Started ignite node on executor 17/03/01 04:12:47 INFO executor.Executor: Finished task 23.0 in stage 4.0 (TID 145). 931 bytes result sent to driver 17/03/01 04:12:49 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 178 17/03/01 04:12:49 INFO executor.Executor: Running task 18.0 in stage 5.0 (TID 178) 17/03/01 04:12:49 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 128 17/03/01 04:12:49 INFO storage.MemoryStore: ensureFreeSpace(7311) called with curMem=12208, maxMem=8334920908 17/03/01 04:12:49 INFO storage.MemoryStore: Block broadcast_128_piece0 stored as bytes in memory (estimated size 7.1 KB, free 7.8 GB) 17/03/01 04:12:49 INFO broadcast.TorrentBroadcast: Reading broadcast variable 128 took 8 ms 17/03/01 04:12:49 INFO storage.MemoryStore: ensureFreeSpace(28168) called with curMem=19519, maxMem=8334920908 17/03/01 04:12:49 INFO storage.MemoryStore: Block broadcast_128 stored as values in memory (estimated size 27.5 KB, free 7.8 GB) 17/03/01 04:12:49 INFO rdd.HadoopRDD: Input split: avro path/part-r-00026-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:0+37540068 17/03/01 04:12:49 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 97 17/03/01 04:12:49 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=47687, maxMem=8334920908 17/03/01 04:12:49 INFO storage.MemoryStore: Block broadcast_97_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:12:49 INFO broadcast.TorrentBroadcast: Reading broadcast variable 97 took 7 ms 17/03/01 04:12:49 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=72330, maxMem=8334920908 17/03/01 04:12:49 INFO storage.MemoryStore: Block broadcast_97 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:12:49 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=41, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, node=6172ee3a-eb33-4bf5-9080-c255f52caed8] 17/03/01 04:12:56 INFO executor.Executor: Finished task 18.0 in stage 5.0 (TID 178). 2098 bytes result sent to driver 17/03/01 04:13:33 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 240 17/03/01 04:13:33 INFO executor.Executor: Running task 68.0 in stage 5.0 (TID 240) 17/03/01 04:13:33 INFO rdd.HadoopRDD: Input split: avro path/part-r-00033-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:0+21475201 17/03/01 04:13:33 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 122 17/03/01 04:13:33 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=407194, maxMem=8334920908 17/03/01 04:13:33 INFO storage.MemoryStore: Block broadcast_122_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:13:34 INFO broadcast.TorrentBroadcast: Reading broadcast variable 122 took 68 ms 17/03/01 04:13:34 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=431837, maxMem=8334920908 17/03/01 04:13:34 INFO storage.MemoryStore: Block broadcast_122 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:13:43 INFO executor.Executor: Finished task 68.0 in stage 5.0 (TID 240). 2098 bytes result sent to driver 17/03/01 04:13:47 INFO internal.IgniteKernal%WCA: Metrics for local node (to disable set 'metricsLogFrequency' to 0) ^-- Node [id=6b1889dd, name=WCA, uptime=00:01:00:007] ^-- H/N/C [hosts=41, nodes=41, CPUs=1664] ^-- CPU [cur=2.27%, avg=3.99%, GC=0%] ^-- Heap [used=3761MB, free=74.35%, comm=14664MB] ^-- Non heap [used=120MB, free=-1%, comm=122MB] ^-- Public thread pool [active=0, idle=0, qSize=0] ^-- System thread pool [active=0, idle=80, qSize=0] ^-- Outbound messages queue [size=0] 17/03/01 04:13:53 INFO cluster.GridUpdateNotifier: Update status is not available. 17/03/01 04:14:00 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 242 17/03/01 04:14:00 INFO executor.Executor: Running task 0.0 in stage 6.0 (TID 242) 17/03/01 04:14:00 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 130 17/03/01 04:14:00 INFO storage.MemoryStore: ensureFreeSpace(1829) called with curMem=778909, maxMem=8334920908 17/03/01 04:14:00 INFO storage.MemoryStore: Block broadcast_130_piece0 stored as bytes in memory (estimated size 1829.0 B, free 7.8 GB) 17/03/01 04:14:00 INFO broadcast.TorrentBroadcast: Reading broadcast variable 130 took 44 ms 17/03/01 04:14:00 INFO storage.MemoryStore: ensureFreeSpace(3160) called with curMem=780738, maxMem=8334920908 17/03/01 04:14:00 INFO storage.MemoryStore: Block broadcast_130 stored as values in memory (estimated size 3.1 KB, free 7.8 GB) 17/03/01 04:14:00 INFO rdd.HadoopRDD: Input split: hdfs://Venus/project/ecpcibermuda/companyNamesample/test.txt:0+8229 17/03/01 04:14:00 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 129 17/03/01 04:14:00 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=783898, maxMem=8334920908 17/03/01 04:14:00 INFO storage.MemoryStore: Block broadcast_129_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:14:00 INFO broadcast.TorrentBroadcast: Reading broadcast variable 129 took 46 ms 17/03/01 04:14:00 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=808541, maxMem=8334920908 17/03/01 04:14:00 INFO storage.MemoryStore: Block broadcast_129 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:14:00 INFO executor.Executor: Finished task 0.0 in stage 6.0 (TID 242). 10458 bytes result sent to driver 17/03/01 04:14:00 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 248 17/03/01 04:14:00 INFO executor.Executor: Running task 4.0 in stage 7.0 (TID 248) 17/03/01 04:14:00 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 131 17/03/01 04:14:00 INFO storage.MemoryStore: ensureFreeSpace(2732) called with curMem=1155613, maxMem=8334920908 17/03/01 04:14:00 INFO storage.MemoryStore: Block broadcast_131_piece0 stored as bytes in memory (estimated size 2.7 KB, free 7.8 GB) 17/03/01 04:14:00 INFO broadcast.TorrentBroadcast: Reading broadcast variable 131 took 38 ms 17/03/01 04:14:00 INFO storage.MemoryStore: ensureFreeSpace(7336) called with curMem=1158345, maxMem=8334920908 17/03/01 04:14:00 INFO storage.MemoryStore: Block broadcast_131 stored as values in memory (estimated size 7.2 KB, free 7.8 GB) 17/03/01 04:14:26 INFO executor.Executor: Finished task 4.0 in stage 7.0 (TID 248). 969 bytes result sent to driver 17/03/01 04:14:47 INFO internal.IgniteKernal%WCA: Metrics for local node (to disable set 'metricsLogFrequency' to 0) ^-- Node [id=6b1889dd, name=WCA, uptime=00:02:00:027] ^-- H/N/C [hosts=41, nodes=41, CPUs=1664] ^-- CPU [cur=0.27%, avg=3.01%, GC=0%] ^-- Heap [used=4270MB, free=70.58%, comm=14515MB] ^-- Non heap [used=125MB, free=-1%, comm=127MB] ^-- Public thread pool [active=0, idle=0, qSize=0] ^-- System thread pool [active=0, idle=80, qSize=0] ^-- Outbound messages queue [size=0] 17/03/01 04:14:49 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 339 17/03/01 04:14:49 INFO executor.Executor: Running task 26.0 in stage 8.0 (TID 339) 17/03/01 04:14:49 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 132 17/03/01 04:14:49 INFO storage.MemoryStore: ensureFreeSpace(887) called with curMem=788977, maxMem=8334920908 17/03/01 04:14:49 INFO storage.MemoryStore: Block broadcast_132_piece0 stored as bytes in memory (estimated size 887.0 B, free 7.8 GB) 17/03/01 04:14:49 INFO broadcast.TorrentBroadcast: Reading broadcast variable 132 took 155 ms 17/03/01 04:14:49 INFO storage.MemoryStore: ensureFreeSpace(1216) called with curMem=789864, maxMem=8334920908 17/03/01 04:14:49 INFO storage.MemoryStore: Block broadcast_132 stored as values in memory (estimated size 1216.0 B, free 7.8 GB) 17/03/01 04:14:49 INFO tcp.GridTcpRestProtocol: Command protocol successfully stopped: TCP binary 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=4136a0c9-14d5-42b3-9a60-81689c800438, addrs=[3, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/3:47500], discPort=47500, order=40, intOrder=40, lastExchangeTime=1488363162972, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=42, servers=40, clients=0, CPUs=1624, heap=620.0GB] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=cf4e6e83-207e-42da-a55c-5621bc20b891, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=38, intOrder=38, lastExchangeTime=1488363162755, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=43, servers=39, clients=0, CPUs=1584, heap=610.0GB] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=d8926a2c-2c00-4445-beb4-633c2d656c41, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=39, intOrder=39, lastExchangeTime=1488363162755, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=44, servers=38, clients=0, CPUs=1552, heap=590.0GB] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=e9e49d2d-5eeb-474f-8757-e447efc8ca8f, addrs=[6, 127.0.0.1], sockAddrs=[hostName/6:47500, /127.0.0.1:47500], discPort=47500, order=34, intOrder=34, lastExchangeTime=1488363162095, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=45, servers=37, clients=0, CPUs=1512, heap=580.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=57c09d88-a4dc-4179-98b4-1144fd97d8cc, addrs=[35, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/35:47500], discPort=47500, order=29, intOrder=29, lastExchangeTime=1488363162044, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=46, servers=36, clients=0, CPUs=1464, heap=560.0GB] 17/03/01 04:14:51 WARN tcp.TcpDiscoverySpi: Failed to ping node (status check will be initiated): 8fd4eea2-2a45-4563-ae87-1848fd388a98 17/03/01 04:14:52 INFO cache.GridCacheProcessor: Stopped cache: ignite-marshaller-sys-cache 17/03/01 04:14:52 INFO cache.GridCacheProcessor: Stopped cache: ignite-sys-cache 17/03/01 04:14:52 INFO cache.GridCacheProcessor: Stopped cache: ignite-atomics-sys-cache 17/03/01 04:14:52 INFO cache.GridCacheProcessor: Stopped cache: WCAIgniteCache 17/03/01 04:14:52 INFO internal.IgniteKernal%WCA: >>> +---------------------------------------------------------------------------------+ >>> Ignite ver. 1.8.0#20161205-sha1:9ca40dbeb7d559fcb299bdb6f5c90cdf8ce7e533 stopped OK >>> +---------------------------------------------------------------------------------+ >>> Grid name: WCA >>> Grid uptime: 00:02:05:344 17/03/01 04:14:52 INFO executor.Executor: Finished task 26.0 in stage 8.0 (TID 339). 931 bytes result sent to driver 17/03/01 04:14:53 INFO executor.CoarseGrainedExecutorBackend: Driver commanded a shutdown 17/03/01 04:14:53 INFO storage.MemoryStore: MemoryStore cleared 17/03/01 04:14:53 INFO storage.BlockManager: BlockManager stopped 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Shutting down remote daemon. 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remote daemon shut down; proceeding with flushing remote transports. 17/03/01 04:14:53 INFO Remoting: Remoting shut down 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remoting shut down. 17/03/01 04:14:53 INFO util.ShutdownHookManager: Shutdown hook called LogType:stdout Log Upload Time:Wed Mar 01 04:14:58 -0600 2017 LogLength:3208 Log Contents: rEnd of the programe - [04:12:38] __________ ________________ [04:12:38] / _/ ___/ |/ / _/_ __/ __/ [04:12:38] _/ // (7 7 // / / / / _/ [04:12:38] /___/\___/_/|_/___/ /_/ /___/ [04:12:38] [04:12:38] ver. 1.8.0#20161205-sha1:9ca40dbe [04:12:38] 2016 Copyright(C) Apache Software Foundation [04:12:38] [04:12:38] Ignite documentation: http://ignite.apache.org [04:12:38] [04:12:38] Quiet mode. [04:12:38] ^-- To see **FULL** console log here add -DIGNITE_QUIET=false or "-v" to ignite.{sh|bat} [04:12:38] [04:12:38] OS: Linux 2.6.32-431.5.1.el6.x86_64 amd64 [04:12:38] VM information: Java(TM) SE Runtime Environment 1.8.0_60-b27 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.60-b23 [04:12:38] Configured plugins: [04:12:38] ^-- None [04:12:38] [04:12:39] Security status [authentication=off, tls/ssl=off] [04:12:42] Topology snapshot [ver=23, servers=23, clients=0, CPUs=936, heap=370.0GB] [04:12:42] Topology snapshot [ver=24, servers=24, clients=0, CPUs=976, heap=380.0GB] [04:12:42] Topology snapshot [ver=25, servers=25, clients=0, CPUs=1016, heap=400.0GB] [04:12:42] Topology snapshot [ver=26, servers=26, clients=0, CPUs=1056, heap=410.0GB] [04:12:42] Topology snapshot [ver=27, servers=27, clients=0, CPUs=1104, heap=430.0GB] [04:12:43] Topology snapshot [ver=28, servers=28, clients=0, CPUs=1144, heap=440.0GB] [04:12:43] Topology snapshot [ver=29, servers=29, clients=0, CPUs=1192, heap=460.0GB] [04:12:43] Topology snapshot [ver=30, servers=30, clients=0, CPUs=1232, heap=470.0GB] [04:12:43] Topology snapshot [ver=31, servers=31, clients=0, CPUs=1280, heap=490.0GB] [04:12:43] Topology snapshot [ver=32, servers=32, clients=0, CPUs=1320, heap=500.0GB] [04:12:44] Topology snapshot [ver=33, servers=33, clients=0, CPUs=1360, heap=520.0GB] [04:12:44] Topology snapshot [ver=34, servers=34, clients=0, CPUs=1400, heap=530.0GB] [04:12:44] Topology snapshot [ver=35, servers=35, clients=0, CPUs=1432, heap=550.0GB] [04:12:44] Topology snapshot [ver=36, servers=36, clients=0, CPUs=1472, heap=560.0GB] [04:12:44] Topology snapshot [ver=37, servers=37, clients=0, CPUs=1512, heap=580.0GB] [04:12:44] Topology snapshot [ver=38, servers=38, clients=0, CPUs=1552, heap=590.0GB] [04:12:45] Topology snapshot [ver=39, servers=39, clients=0, CPUs=1584, heap=610.0GB] [04:12:45] Topology snapshot [ver=40, servers=40, clients=0, CPUs=1624, heap=620.0GB] [04:12:45] Topology snapshot [ver=41, servers=41, clients=0, CPUs=1664, heap=640.0GB] [04:12:47] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [04:12:47] [04:12:47] Ignite node started OK (id=6b1889dd, grid=WCA) [04:12:47] Topology snapshot [ver=22, servers=22, clients=0, CPUs=896, heap=350.0GB] [04:14:49] Topology snapshot [ver=42, servers=40, clients=0, CPUs=1624, heap=620.0GB] [04:14:49] Topology snapshot [ver=43, servers=39, clients=0, CPUs=1584, heap=610.0GB] [04:14:49] Topology snapshot [ver=44, servers=38, clients=0, CPUs=1552, heap=590.0GB] [04:14:49] Topology snapshot [ver=45, servers=37, clients=0, CPUs=1512, heap=580.0GB] [04:14:51] Topology snapshot [ver=46, servers=36, clients=0, CPUs=1464, heap=560.0GB] [04:14:52] Ignite node stopped OK [name=WCA, uptime=00:02:05:344] Container: container_e76_1487862040010_131981_01_000026 on hostName_8041 =========================================================================================== LogType:stderr Log Upload Time:Wed Mar 01 04:14:58 -0600 2017 LogLength:165272 Log Contents: 17/03/01 04:10:59 INFO executor.CoarseGrainedExecutorBackend: Registered signal handlers for [TERM, HUP, INT] 17/03/01 04:11:00 INFO spark.SecurityManager: Changing view acls to: userName 17/03/01 04:11:00 INFO spark.SecurityManager: Changing modify acls to: userName 17/03/01 04:11:00 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(userName); users with modify permissions: Set(userName) 17/03/01 04:11:00 INFO slf4j.Slf4jLogger: Slf4jLogger started 17/03/01 04:11:00 INFO Remoting: Starting remoting 17/03/01 04:11:01 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://driverPropsFetcher@hostName:32867] 17/03/01 04:11:01 INFO Remoting: Remoting now listens on addresses: [akka.tcp://driverPropsFetcher@hostName:32867] 17/03/01 04:11:01 INFO util.Utils: Successfully started service 'driverPropsFetcher' on port 32867. 17/03/01 04:11:01 INFO spark.SecurityManager: Changing view acls to: userName 17/03/01 04:11:01 INFO remote.RemoteActorRefProvider$RemotingTerminator: Shutting down remote daemon. 17/03/01 04:11:01 INFO spark.SecurityManager: Changing modify acls to: userName 17/03/01 04:11:01 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(userName); users with modify permissions: Set(userName) 17/03/01 04:11:01 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remote daemon shut down; proceeding with flushing remote transports. 17/03/01 04:11:01 INFO slf4j.Slf4jLogger: Slf4jLogger started 17/03/01 04:11:01 INFO Remoting: Starting remoting 17/03/01 04:11:01 INFO Remoting: Remoting shut down 17/03/01 04:11:01 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remoting shut down. 17/03/01 04:11:01 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://sparkExecutor@hostName:43543] 17/03/01 04:11:01 INFO Remoting: Remoting now listens on addresses: [akka.tcp://sparkExecutor@hostName:43543] 17/03/01 04:11:01 INFO util.Utils: Successfully started service 'sparkExecutor' on port 43543. 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/1/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-6f05b07f-d201-4acd-baef-3f0c4f604b24 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/2/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-2eb7d5f3-04cd-410f-b50c-2f8cc3cfbd8a 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/3/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-26afbe3d-3e54-45a7-8dae-7072a687c908 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/4/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-2dc168af-e0e4-412d-9101-a1944e48aa48 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/5/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-8a1ef921-1f77-4f6f-83cd-4ac0d452b5e1 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/6/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-ae63bcd1-3a6e-481f-bf44-b70228db98e3 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/7/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-d377e97d-f80e-422c-ab0d-0f7b832266b5 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/8/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-9a4dc357-d1af-4724-a044-0d80f4c2a579 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/9/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-ed2226ff-176c-45ce-94f7-2b61268a0387 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/10/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-d460c73d-7872-4bd8-833f-6b671bf1c06b 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/11/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-75e349d9-75c0-419e-b29c-bd20757a17d7 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/12/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-5239e000-8abb-46a8-879e-246fc119a8da 17/03/01 04:11:01 INFO storage.MemoryStore: MemoryStore started with capacity 7.8 GB 17/03/01 04:11:01 INFO executor.CoarseGrainedExecutorBackend: Connecting to driver: akka.tcp://sparkDriver@ipaddress:38995/user/CoarseGrainedScheduler 17/03/01 04:11:01 INFO executor.CoarseGrainedExecutorBackend: Successfully registered with driver 17/03/01 04:11:01 INFO executor.Executor: Starting executor ID 23 on host hostName 17/03/01 04:11:01 INFO util.Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 44721. 17/03/01 04:11:01 INFO netty.NettyBlockTransferService: Server created on 44721 17/03/01 04:11:01 INFO storage.BlockManagerMaster: Trying to register BlockManager 17/03/01 04:11:01 INFO storage.BlockManagerMaster: Registered BlockManager 17/03/01 04:11:02 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 34 17/03/01 04:11:02 INFO executor.Executor: Running task 34.0 in stage 0.0 (TID 34) 17/03/01 04:11:02 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 0 17/03/01 04:11:02 INFO storage.MemoryStore: ensureFreeSpace(1310) called with curMem=0, maxMem=8334920908 17/03/01 04:11:02 INFO storage.MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 1310.0 B, free 7.8 GB) 17/03/01 04:11:02 INFO broadcast.TorrentBroadcast: Reading broadcast variable 0 took 232 ms 17/03/01 04:11:02 INFO storage.MemoryStore: ensureFreeSpace(2064) called with curMem=1310, maxMem=8334920908 17/03/01 04:11:02 INFO storage.MemoryStore: Block broadcast_0 stored as values in memory (estimated size 2.0 KB, free 7.8 GB) 17/03/01 04:11:02 INFO resolver.CompanyResolverSparkTest: Ranjit exec test 17/03/01 04:11:02 INFO executor.Executor: Finished task 34.0 in stage 0.0 (TID 34). 972 bytes result sent to driver 17/03/01 04:12:38 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 125 17/03/01 04:12:38 INFO executor.Executor: Running task 3.0 in stage 4.0 (TID 125) 17/03/01 04:12:38 INFO spark.MapOutputTrackerWorker: Updating epoch to 1 and clearing cache 17/03/01 04:12:38 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 86 17/03/01 04:12:38 INFO storage.MemoryStore: ensureFreeSpace(2290) called with curMem=3374, maxMem=8334920908 17/03/01 04:12:38 INFO storage.MemoryStore: Block broadcast_86_piece0 stored as bytes in memory (estimated size 2.2 KB, free 7.8 GB) 17/03/01 04:12:38 INFO broadcast.TorrentBroadcast: Reading broadcast variable 86 took 19 ms 17/03/01 04:12:38 INFO storage.MemoryStore: ensureFreeSpace(6544) called with curMem=5664, maxMem=8334920908 17/03/01 04:12:38 INFO storage.MemoryStore: Block broadcast_86 stored as values in memory (estimated size 6.4 KB, free 7.8 GB) 17/03/01 04:12:38 INFO resolver.CompanyResolverSparkTest: testing worker[ipaddress:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509] 17/03/01 04:12:38 ERROR : Failed to resolve default logging config file: config/java.util.logging.properties Console logging handler is not configured. 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: >>> __________ ________________ >>> / _/ ___/ |/ / _/_ __/ __/ >>> _/ // (7 7 // / / / / _/ >>> /___/\___/_/|_/___/ /_/ /___/ >>> >>> ver. 1.8.0#20161205-sha1:9ca40dbe >>> 2016 Copyright(C) Apache Software Foundation >>> >>> Ignite documentation: http://ignite.apache.org 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Config URL: n/a 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Daemon mode: off 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: OS: Linux 2.6.32-431.5.1.el6.x86_64 amd64 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: OS user: userName 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: PID: 38918 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Language runtime: Java Platform API Specification ver. 1.8 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM information: Java(TM) SE Runtime Environment 1.8.0_60-b27 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.60-b23 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM total memory: 14.0GB 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Remote Management [restart: off, REST: on, JMX (remote: off)] 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: IGNITE_HOME=null 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM arguments: [-XX:OnOutOfMemoryError=kill %p, -Xms15360m, -Xmx15360m, -Djava.io.tmpdir=/data/11/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/container_e76_1487862040010_131981_01_000026/tmp, -Dspark.driver.port=38995, -Dspark.ui.port=0, -Dspark.yarn.app.container.log.dir=/data/10/yarn/log/container/application_1487862040010_131981/container_e76_1487862040010_131981_01_000026] 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Configured caches ['ignite-marshaller-sys-cache', 'ignite-sys-cache', 'ignite-atomics-sys-cache'] 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: Configured plugins: 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: ^-- None 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: IPC shared memory server endpoint started [port=48100, tokDir=/data/11/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/container_e76_1487862040010_131981_01_000026/tmp/ignite/work/ipc/shmem/694a80b8-02a3-44c9-a2dd-45bed7d20a50-38918] 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: Successfully bound shared memory communication to TCP port [port=48100, locHost=0.0.0.0/0.0.0.0] 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: Successfully bound to TCP port [port=47100, locHost=0.0.0.0/0.0.0.0] 17/03/01 04:12:38 WARN noop.NoopCheckpointSpi: Checkpoints are disabled (to enable configure any GridCheckpointSpi implementation) 17/03/01 04:12:38 WARN collision.GridCollisionManager: Collision resolution is disabled (all jobs will be activated upon arrival). 17/03/01 04:12:38 WARN noop.NoopSwapSpaceSpi: Swap space is disabled. To enable use FileSwapSpaceSpi. 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Security status [authentication=off, tls/ssl=off] 17/03/01 04:12:39 INFO tcp.GridTcpRestProtocol: Command protocol successfully started [name=TCP binary, host=0.0.0.0/0.0.0.0, port=11211] 17/03/01 04:12:39 INFO internal.IgniteKernal%WCA: Non-loopback local IPs: 1 17/03/01 04:12:39 INFO internal.IgniteKernal%WCA: Enabled local MACs: 44A8421041F2 17/03/01 04:12:39 INFO tcp.TcpDiscoverySpi: Successfully bound to TCP port [port=47500, localHost=0.0.0.0/0.0.0.0, locNodeId=694a80b8-02a3-44c9-a2dd-45bed7d20a50] 17/03/01 04:12:46 INFO cache.GridCacheProcessor: Started cache [name=ignite-sys-cache, mode=REPLICATED] 17/03/01 04:12:46 INFO cache.GridCacheProcessor: Started cache [name=ignite-atomics-sys-cache, mode=PARTITIONED] 17/03/01 04:12:46 INFO cache.GridCacheProcessor: Started cache [name=WCAIgniteCache, mode=PARTITIONED] 17/03/01 04:12:46 INFO cache.GridCacheProcessor: Started cache [name=ignite-marshaller-sys-cache, mode=REPLICATED] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-sys-cache, waitList=[]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-marshaller-sys-cache, waitList=[]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-atomics-sys-cache, waitList=[ignite-sys-cache, ignite-marshaller-sys-cache]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=WCAIgniteCache, waitList=[ignite-sys-cache, ignite-marshaller-sys-cache, ignite-atomics-sys-cache]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Rebalancing required [top=AffinityTopologyVersion [topVer=41, minorTopVer=0], evt=NODE_JOINED, node=694a80b8-02a3-44c9-a2dd-45bed7d20a50] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-marshaller-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=20, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=1] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=100, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=1] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-marshaller-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=10 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=10 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-atomics-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=34, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=1] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-atomics-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=0 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=WCAIgniteCache, mode=ASYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=34, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=1] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=WCAIgniteCache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=0 ms] 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: >>> +----------------------------------------------------------------------+ >>> Ignite ver. 1.8.0#20161205-sha1:9ca40dbeb7d559fcb299bdb6f5c90cdf8ce7e533 >>> +----------------------------------------------------------------------+ >>> OS name: Linux 2.6.32-431.5.1.el6.x86_64 amd64 >>> CPU(s): 40 >>> Heap: 15.0GB >>> VM name: 38918@hostName >>> Grid name: WCA >>> Local node [ID=694A80B8-02A3-44C9-A2DD-45BED7D20A50, order=41, clientMode=false] >>> Local node addresses: [hostName/1, /127.0.0.1] >>> Local ports: TCP:11211 TCP:47100 TCP:47500 TCP:48100 17/03/01 04:12:47 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=41, servers=41, clients=0, CPUs=1664, heap=640.0GB] 17/03/01 04:12:47 INFO resolver.CompanyResolverSparkTest: Started ignite node on executor 17/03/01 04:12:47 INFO executor.Executor: Finished task 3.0 in stage 4.0 (TID 125). 931 bytes result sent to driver 17/03/01 04:12:49 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=41, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, node=6172ee3a-eb33-4bf5-9080-c255f52caed8] 17/03/01 04:13:47 INFO internal.IgniteKernal%WCA: Metrics for local node (to disable set 'metricsLogFrequency' to 0) ^-- Node [id=694a80b8, name=WCA, uptime=00:01:00:009] ^-- H/N/C [hosts=41, nodes=41, CPUs=1664] ^-- CPU [cur=5.43%, avg=3.73%, GC=0.2%] ^-- Heap [used=1367MB, free=90.72%, comm=14742MB] ^-- Non heap [used=86MB, free=-1%, comm=87MB] ^-- Public thread pool [active=0, idle=0, qSize=0] ^-- System thread pool [active=0, idle=80, qSize=0] ^-- Outbound messages queue [size=0] 17/03/01 04:13:55 INFO cluster.GridUpdateNotifier: Update status is not available. 17/03/01 04:14:00 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 249 17/03/01 04:14:00 INFO executor.Executor: Running task 5.0 in stage 7.0 (TID 249) 17/03/01 04:14:00 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 131 17/03/01 04:14:00 INFO storage.MemoryStore: ensureFreeSpace(2732) called with curMem=0, maxMem=8334920908 17/03/01 04:14:00 INFO storage.MemoryStore: Block broadcast_131_piece0 stored as bytes in memory (estimated size 2.7 KB, free 7.8 GB) 17/03/01 04:14:00 INFO broadcast.TorrentBroadcast: Reading broadcast variable 131 took 60 ms 17/03/01 04:14:00 INFO storage.MemoryStore: ensureFreeSpace(7336) called with curMem=2732, maxMem=8334920908 17/03/01 04:14:00 INFO storage.MemoryStore: Block broadcast_131 stored as values in memory (estimated size 7.2 KB, free 7.8 GB) 17/03/01 04:14:00 INFO dao.CompanyDAO: testing[ipaddress:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509] 17/03/01 04:14:00 INFO dao.CompanyDAO: input company name inside Contains searchRIVER CITY AIR CONDITIONING 17/03/01 04:14:09 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=e9e49d2d-5eeb-474f-8757-e447efc8ca8f, taskHash=0], locFut=null, sndId=e9e49d2d-5eeb-474f-8757-e447efc8ca8f, reqId=352, incMeta=false, all=false], node=694a80b8-02a3-44c9-a2dd-45bed7d20a50] java.lang.NullPointerException at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneFile.numBuffers(GridLuceneFile.java:109) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneInputStream.switchCurrentBuffer(GridLuceneInputStream.java:132) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneInputStream.seek(GridLuceneInputStream.java:224) at org.apache.lucene.index.CompoundFileReader$CSIndexInput.readInternal(CompoundFileReader.java:273) at org.apache.lucene.store.BufferedIndexInput.refill(BufferedIndexInput.java:229) at org.apache.lucene.store.BufferedIndexInput.readByte(BufferedIndexInput.java:39) at org.apache.lucene.store.DataInput.readInt(DataInput.java:84) at org.apache.lucene.store.BufferedIndexInput.readInt(BufferedIndexInput.java:169) at org.apache.lucene.store.DataInput.readLong(DataInput.java:126) at org.apache.lucene.store.BufferedIndexInput.readLong(BufferedIndexInput.java:182) at org.apache.lucene.index.FieldsReader.doc(FieldsReader.java:231) at org.apache.lucene.index.SegmentReader.document(SegmentReader.java:477) at org.apache.lucene.index.DirectoryReader.document(DirectoryReader.java:583) at org.apache.lucene.index.IndexReader.document(IndexReader.java:1115) at org.apache.lucene.search.IndexSearcher.doc(IndexSearcher.java:258) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneIndex$It.findNext(GridLuceneIndex.java:383) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneIndex$It.onNext(GridLuceneIndex.java:415) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneIndex$It.onNext(GridLuceneIndex.java:299) at org.apache.ignite.internal.util.GridCloseableIteratorAdapter.nextX(GridCloseableIteratorAdapter.java:41) at org.apache.ignite.internal.util.lang.GridIteratorAdapter.next(GridIteratorAdapter.java:35) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryManager.runQuery(GridCacheQueryManager.java:1512) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.processQueryRequest(GridCacheDistributedQueryManager.java:230) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$2.apply(GridCacheDistributedQueryManager.java:108) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$2.apply(GridCacheDistributedQueryManager.java:106) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.processMessage(GridCacheIoManager.java:827) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.onMessage0(GridCacheIoManager.java:369) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.handleMessage(GridCacheIoManager.java:293) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.access$000(GridCacheIoManager.java:95) at org.apache.ignite.internal.processors.cache.GridCacheIoManager$1.onMessage(GridCacheIoManager.java:238) at org.apache.ignite.internal.managers.communication.GridIoManager.invokeListener(GridIoManager.java:1082) at org.apache.ignite.internal.managers.communication.GridIoManager.processRegularMessage0(GridIoManager.java:710) at org.apache.ignite.internal.managers.communication.GridIoManager.access$1700(GridIoManager.java:102) at org.apache.ignite.internal.managers.communication.GridIoManager$5.run(GridIoManager.java:673) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 17/03/01 04:14:10 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=47c1a0d8-9d4d-4d0d-9b27-388bd7f49278, taskHash=0], locFut=null, sndId=47c1a0d8-9d4d-4d0d-9b27-388bd7f49278, reqId=369, incMeta=false, all=false], node=694a80b8-02a3-44c9-a2dd-45bed7d20a50] java.lang.NullPointerException at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneFile.numBuffers(GridLuceneFile.java:109) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneInputStream.switchCurrentBuffer(GridLuceneInputStream.java:132) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneInputStream.seek(GridLuceneInputStream.java:224) at org.apache.lucene.index.CompoundFileReader$CSIndexInput.readInternal(CompoundFileReader.java:273) at org.apache.lucene.store.BufferedIndexInput.refill(BufferedIndexInput.java:229) at org.apache.lucene.store.BufferedIndexInput.readByte(BufferedIndexInput.java:39) at org.apache.lucene.store.DataInput.readVInt(DataInput.java:105) at org.apache.lucene.store.BufferedIndexInput.readVInt(BufferedIndexInput.java:197) at org.apache.lucene.index.FieldsReader.doc(FieldsReader.java:235) at org.apache.lucene.index.SegmentReader.document(SegmentReader.java:477) at org.apache.lucene.index.DirectoryReader.document(DirectoryReader.java:583) at org.apache.lucene.index.IndexReader.document(IndexReader.java:1115) at org.apache.lucene.search.IndexSearcher.doc(IndexSearcher.java:258) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneIndex$It.findNext(GridLuceneIndex.java:383) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneIndex$It.onNext(GridLuceneIndex.java:415) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneIndex$It.onNext(GridLuceneIndex.java:299) at org.apache.ignite.internal.util.GridCloseableIteratorAdapter.nextX(GridCloseableIteratorAdapter.java:41) at org.apache.ignite.internal.util.lang.GridIteratorAdapter.next(GridIteratorAdapter.java:35) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryManager.runQuery(GridCacheQueryManager.java:1512) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.processQueryRequest(GridCacheDistributedQueryManager.java:230) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$2.apply(GridCacheDistributedQueryManager.java:108) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$2.apply(GridCacheDistributedQueryManager.java:106) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.processMessage(GridCacheIoManager.java:827) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.onMessage0(GridCacheIoManager.java:369) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.handleMessage(GridCacheIoManager.java:293) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.access$000(GridCacheIoManager.java:95) at org.apache.ignite.internal.processors.cache.GridCacheIoManager$1.onMessage(GridCacheIoManager.java:238) at org.apache.ignite.internal.managers.communication.GridIoManager.invokeListener(GridIoManager.java:1082) at org.apache.ignite.internal.managers.communication.GridIoManager.processRegularMessage0(GridIoManager.java:710) at org.apache.ignite.internal.managers.communication.GridIoManager.access$1700(GridIoManager.java:102) at org.apache.ignite.internal.managers.communication.GridIoManager$5.run(GridIoManager.java:673) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 17/03/01 04:14:10 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=90db2cab-26f6-463d-9755-d03d059a8723, taskHash=0], locFut=null, sndId=90db2cab-26f6-463d-9755-d03d059a8723, reqId=543, incMeta=false, all=false], node=694a80b8-02a3-44c9-a2dd-45bed7d20a50] java.lang.NullPointerException at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneFile.numBuffers(GridLuceneFile.java:109) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneInputStream.switchCurrentBuffer(GridLuceneInputStream.java:132) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneInputStream.seek(GridLuceneInputStream.java:224) at org.apache.lucene.index.CompoundFileReader$CSIndexInput.readInternal(CompoundFileReader.java:273) at org.apache.lucene.store.BufferedIndexInput.refill(BufferedIndexInput.java:229) at org.apache.lucene.store.BufferedIndexInput.readByte(BufferedIndexInput.java:39) at org.apache.lucene.store.DataInput.readInt(DataInput.java:84) at org.apache.lucene.store.BufferedIndexInput.readInt(BufferedIndexInput.java:169) at org.apache.lucene.store.DataInput.readLong(DataInput.java:126) at org.apache.lucene.store.BufferedIndexInput.readLong(BufferedIndexInput.java:182) at org.apache.lucene.index.FieldsReader.doc(FieldsReader.java:231) at org.apache.lucene.index.SegmentReader.document(SegmentReader.java:477) at org.apache.lucene.index.DirectoryReader.document(DirectoryReader.java:583) at org.apache.lucene.index.IndexReader.document(IndexReader.java:1115) at org.apache.lucene.search.IndexSearcher.doc(IndexSearcher.java:258) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneIndex$It.findNext(GridLuceneIndex.java:383) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneIndex$It.onNext(GridLuceneIndex.java:415) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneIndex$It.onNext(GridLuceneIndex.java:299) at org.apache.ignite.internal.util.GridCloseableIteratorAdapter.nextX(GridCloseableIteratorAdapter.java:41) at org.apache.ignite.internal.util.lang.GridIteratorAdapter.next(GridIteratorAdapter.java:35) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryManager.runQuery(GridCacheQueryManager.java:1512) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.processQueryRequest(GridCacheDistributedQueryManager.java:230) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$2.apply(GridCacheDistributedQueryManager.java:108) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$2.apply(GridCacheDistributedQueryManager.java:106) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.processMessage(GridCacheIoManager.java:827) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.onMessage0(GridCacheIoManager.java:369) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.handleMessage(GridCacheIoManager.java:293) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.access$000(GridCacheIoManager.java:95) at org.apache.ignite.internal.processors.cache.GridCacheIoManager$1.onMessage(GridCacheIoManager.java:238) at org.apache.ignite.internal.managers.communication.GridIoManager.invokeListener(GridIoManager.java:1082) at org.apache.ignite.internal.managers.communication.GridIoManager.processRegularMessage0(GridIoManager.java:710) at org.apache.ignite.internal.managers.communication.GridIoManager.access$1700(GridIoManager.java:102) at org.apache.ignite.internal.managers.communication.GridIoManager$5.run(GridIoManager.java:673) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 17/03/01 04:14:10 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=717de453-fc6b-4a46-91b2-b5c54ab8a4be, taskHash=0], locFut=null, sndId=717de453-fc6b-4a46-91b2-b5c54ab8a4be, reqId=297, incMeta=false, all=false], node=694a80b8-02a3-44c9-a2dd-45bed7d20a50] java.lang.NullPointerException 17/03/01 04:14:10 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=ddc47224-d030-4d1f-ba66-08f61368a395, taskHash=0], locFut=null, sndId=ddc47224-d030-4d1f-ba66-08f61368a395, reqId=411, incMeta=false, all=false], node=694a80b8-02a3-44c9-a2dd-45bed7d20a50] java.lang.NullPointerException 17/03/01 04:14:10 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=d4a9fe7f-de19-4df7-874c-a084da78562f, taskHash=0], locFut=null, sndId=d4a9fe7f-de19-4df7-874c-a084da78562f, reqId=382, incMeta=false, all=false], node=694a80b8-02a3-44c9-a2dd-45bed7d20a50] java.lang.NullPointerException 17/03/01 04:14:10 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=8fd4eea2-2a45-4563-ae87-1848fd388a98, taskHash=0], locFut=null, sndId=8fd4eea2-2a45-4563-ae87-1848fd388a98, reqId=268, incMeta=false, all=false], node=694a80b8-02a3-44c9-a2dd-45bed7d20a50] java.lang.NullPointerException 17/03/01 04:14:10 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=058a99e8-3b65-4ec9-84b0-6f3502c2afce, taskHash=0], locFut=null, sndId=058a99e8-3b65-4ec9-84b0-6f3502c2afce, reqId=359, incMeta=false, all=false], node=694a80b8-02a3-44c9-a2dd-45bed7d20a50] java.lang.NullPointerException 17/03/01 04:14:11 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=0d675d57-b9b9-4cff-a994-77337d618bbe, taskHash=0], locFut=null, sndId=0d675d57-b9b9-4cff-a994-77337d618bbe, reqId=279, incMeta=false, all=false], node=694a80b8-02a3-44c9-a2dd-45bed7d20a50] java.lang.NullPointerException 17/03/01 04:14:11 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=90532831-88fb-4eb8-adc9-db7a86744869, taskHash=0], locFut=null, sndId=90532831-88fb-4eb8-adc9-db7a86744869, reqId=385, incMeta=false, all=false], node=694a80b8-02a3-44c9-a2dd-45bed7d20a50] java.lang.NullPointerException 17/03/01 04:14:11 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=d8926a2c-2c00-4445-beb4-633c2d656c41, taskHash=0], locFut=null, sndId=d8926a2c-2c00-4445-beb4-633c2d656c41, reqId=385, incMeta=false, all=false], node=694a80b8-02a3-44c9-a2dd-45bed7d20a50] java.lang.NullPointerException 17/03/01 04:14:11 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=fa09caab-f4dc-43b6-ac8b-4a4bae6e7da6, taskHash=0], locFut=null, sndId=fa09caab-f4dc-43b6-ac8b-4a4bae6e7da6, reqId=5786, incMeta=false, all=false], node=694a80b8-02a3-44c9-a2dd-45bed7d20a50] java.lang.NullPointerException 17/03/01 04:14:11 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=e87f12ce-5981-4418-8468-f6bfed0a0cd8, taskHash=0], locFut=null, sndId=e87f12ce-5981-4418-8468-f6bfed0a0cd8, reqId=369, incMeta=false, all=false], node=694a80b8-02a3-44c9-a2dd-45bed7d20a50] java.lang.NullPointerException 17/03/01 04:14:11 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=daed0152-83fc-4828-ada6-64c74787b190, taskHash=0], locFut=null, sndId=daed0152-83fc-4828-ada6-64c74787b190, reqId=381, incMeta=false, all=false], node=694a80b8-02a3-44c9-a2dd-45bed7d20a50] java.lang.NullPointerException 17/03/01 04:14:11 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=694a80b8-02a3-44c9-a2dd-45bed7d20a50, taskHash=0], locFut=null, sndId=694a80b8-02a3-44c9-a2dd-45bed7d20a50, reqId=262, incMeta=false, all=false], node=694a80b8-02a3-44c9-a2dd-45bed7d20a50] java.lang.NullPointerException 17/03/01 04:14:11 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=5bc51e21-1dcf-498a-b87e-6dd24f7e36ad, taskHash=0], locFut=null, sndId=5bc51e21-1dcf-498a-b87e-6dd24f7e36ad, reqId=420, incMeta=false, all=false], node=694a80b8-02a3-44c9-a2dd-45bed7d20a50] java.lang.NullPointerException 17/03/01 04:14:11 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=23f61699-e2c9-4ff6-8731-2483934e84c4, taskHash=0], locFut=null, sndId=23f61699-e2c9-4ff6-8731-2483934e84c4, reqId=413, incMeta=false, all=false], node=694a80b8-02a3-44c9-a2dd-45bed7d20a50] java.lang.NullPointerException 17/03/01 04:14:11 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=9fb6e583-cea0-4f78-b403-b403a8bc9a0e, taskHash=0], locFut=null, sndId=9fb6e583-cea0-4f78-b403-b403a8bc9a0e, reqId=364, incMeta=false, all=false], node=694a80b8-02a3-44c9-a2dd-45bed7d20a50] java.lang.NullPointerException 17/03/01 04:14:11 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=479b18e6-54af-4313-85f7-c7525f6229a4, res=GridCacheQueryResponse [finished=false, reqId=262, err=null, fields=false, metadata=null]] 17/03/01 04:14:11 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=c4f4f6bb-b71a-4a29-9575-afee2ddc1b2d, taskHash=0], locFut=null, sndId=c4f4f6bb-b71a-4a29-9575-afee2ddc1b2d, reqId=289, incMeta=false, all=false], node=694a80b8-02a3-44c9-a2dd-45bed7d20a50] java.lang.NullPointerException 17/03/01 04:14:11 ERROR executor.Executor: Exception in task 5.0 in stage 7.0 (TID 249) javax.cache.CacheException: class org.apache.ignite.IgniteCheckedException: Query execution failed: GridCacheQueryBean [qry=GridCacheQueryAdapter [type=TEXT, clsName=CompanyVO1, clause=RIVER CITY AIR CONDITIONING, filter=null, transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=true, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=694a80b8-02a3-44c9-a2dd-45bed7d20a50, taskHash=0], rdc=null, trans=null] at org.apache.ignite.internal.processors.cache.GridCacheUtils.convertToCacheException(GridCacheUtils.java:1440) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.next(GridCacheQueryFutureAdapter.java:174) at org.apache.ignite.internal.processors.cache.IgniteCacheProxy$5.onHasNext(IgniteCacheProxy.java:600) at org.apache.ignite.internal.util.GridCloseableIteratorAdapter.hasNextX(GridCloseableIteratorAdapter.java:53) at org.apache.ignite.internal.util.lang.GridIteratorAdapter.hasNext(GridIteratorAdapter.java:45) at un.api.resolver.dao.CompanyDAO.getVarCompContains(CompanyDAO.scala:242) at un.api.resolver.accessor.CompanyAccessor.getVarCompContains(CompanyAccessor.scala:27) at un.api.resolver.CompanyResolverSparkTest$$anonfun$main$7.apply(CompanyResolverSparkTest.scala:291) at un.api.resolver.CompanyResolverSparkTest$$anonfun$main$7.apply(CompanyResolverSparkTest.scala:289) at scala.collection.Iterator$$anon$11.next(Iterator.scala:328) at org.apache.spark.util.Utils$.getIteratorSize(Utils.scala:1554) at org.apache.spark.rdd.RDD$$anonfun$count$1.apply(RDD.scala:1121) at org.apache.spark.rdd.RDD$$anonfun$count$1.apply(RDD.scala:1121) at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1850) at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1850) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:66) at org.apache.spark.scheduler.Task.run(Task.scala:88) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:214) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: class org.apache.ignite.IgniteCheckedException: Query execution failed: GridCacheQueryBean [qry=GridCacheQueryAdapter [type=TEXT, clsName=CompanyVO1, clause=RIVER CITY AIR CONDITIONING, filter=null, transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=true, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=694a80b8-02a3-44c9-a2dd-45bed7d20a50, taskHash=0], rdc=null, trans=null] at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.checkError(GridCacheQueryFutureAdapter.java:260) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.internalIterator(GridCacheQueryFutureAdapter.java:318) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.next(GridCacheQueryFutureAdapter.java:164) ... 19 more Caused by: class org.apache.ignite.IgniteCheckedException: Failed to execute query on node [query=GridCacheQueryBean [qry=GridCacheQueryAdapter [type=TEXT, clsName=CompanyVO1, clause=RIVER CITY AIR CONDITIONING, filter=null, transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=true, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=694a80b8-02a3-44c9-a2dd-45bed7d20a50, taskHash=0], rdc=null, trans=null], nodeId=694a80b8-02a3-44c9-a2dd-45bed7d20a50] at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.onPage(GridCacheQueryFutureAdapter.java:383) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.processQueryResponse(GridCacheDistributedQueryManager.java:398) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.access$000(GridCacheDistributedQueryManager.java:63) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$1.apply(GridCacheDistributedQueryManager.java:93) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$1.apply(GridCacheDistributedQueryManager.java:91) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.processMessage(GridCacheIoManager.java:827) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.onMessage0(GridCacheIoManager.java:369) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.access$400(GridCacheIoManager.java:95) at org.apache.ignite.internal.processors.cache.GridCacheIoManager$OrderedMessageListener.onMessage(GridCacheIoManager.java:1345) at org.apache.ignite.internal.managers.communication.GridIoManager.invokeListener(GridIoManager.java:1082) at org.apache.ignite.internal.managers.communication.GridIoManager.access$1600(GridIoManager.java:102) at org.apache.ignite.internal.managers.communication.GridIoManager$GridCommunicationMessageSet.unwind(GridIoManager.java:2332) at org.apache.ignite.internal.managers.communication.GridIoManager.unwindMessageSet(GridIoManager.java:1042) at org.apache.ignite.internal.managers.communication.GridIoManager.processOrderedMessage(GridIoManager.java:999) at org.apache.ignite.internal.managers.communication.GridIoManager.send(GridIoManager.java:1135) at org.apache.ignite.internal.managers.communication.GridIoManager.sendOrderedMessage(GridIoManager.java:1252) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.sendOrderedMessage(GridCacheIoManager.java:1081) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.sendQueryResponse(GridCacheDistributedQueryManager.java:323) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.onPageReady(GridCacheDistributedQueryManager.java:452) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryManager.runQuery(GridCacheQueryManager.java:1693) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.processQueryRequest(GridCacheDistributedQueryManager.java:230) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$8.call(GridCacheDistributedQueryManager.java:816) at org.apache.ignite.internal.util.IgniteUtils.wrapThreadLoader(IgniteUtils.java:6564) at org.apache.ignite.internal.processors.closure.GridClosureProcessor$2.body(GridClosureProcessor.java:906) at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110) ... 3 more Caused by: java.lang.NullPointerException 17/03/01 04:14:11 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 302 17/03/01 04:14:11 INFO executor.Executor: Running task 13.1 in stage 7.0 (TID 302) 17/03/01 04:14:11 INFO dao.CompanyDAO: testing[ipaddress:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509] 17/03/01 04:14:11 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=40d089f0-7c80-4f1f-8659-350791f57a4c, taskHash=0], locFut=null, sndId=40d089f0-7c80-4f1f-8659-350791f57a4c, reqId=502, incMeta=false, all=false], node=694a80b8-02a3-44c9-a2dd-45bed7d20a50] java.lang.NullPointerException 17/03/01 04:14:11 INFO dao.CompanyDAO: input company name inside Contains searchFRANKLIN LEDDY RANCH CORP 17/03/01 04:14:11 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=95f164b5-4b73-438f-804f-62854d615b5b, taskHash=0], locFut=null, sndId=95f164b5-4b73-438f-804f-62854d615b5b, reqId=413, incMeta=false, all=false], node=694a80b8-02a3-44c9-a2dd-45bed7d20a50] java.lang.NullPointerException 17/03/01 04:14:28 INFO executor.Executor: Finished task 13.1 in stage 7.0 (TID 302). 969 bytes result sent to driver 17/03/01 04:14:47 INFO internal.IgniteKernal%WCA: Metrics for local node (to disable set 'metricsLogFrequency' to 0) ^-- Node [id=694a80b8, name=WCA, uptime=00:02:00:032] ^-- H/N/C [hosts=41, nodes=41, CPUs=1664] ^-- CPU [cur=0.23%, avg=4.61%, GC=0%] ^-- Heap [used=2457MB, free=82.81%, comm=14296MB] ^-- Non heap [used=91MB, free=-1%, comm=94MB] ^-- Public thread pool [active=0, idle=0, qSize=0] ^-- System thread pool [active=0, idle=80, qSize=0] ^-- Outbound messages queue [size=0] 17/03/01 04:14:49 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 347 17/03/01 04:14:49 INFO executor.Executor: Running task 34.0 in stage 8.0 (TID 347) 17/03/01 04:14:49 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 132 17/03/01 04:14:49 INFO storage.MemoryStore: ensureFreeSpace(887) called with curMem=10068, maxMem=8334920908 17/03/01 04:14:49 INFO storage.MemoryStore: Block broadcast_132_piece0 stored as bytes in memory (estimated size 887.0 B, free 7.8 GB) 17/03/01 04:14:49 INFO broadcast.TorrentBroadcast: Reading broadcast variable 132 took 66 ms 17/03/01 04:14:49 INFO storage.MemoryStore: ensureFreeSpace(1216) called with curMem=10955, maxMem=8334920908 17/03/01 04:14:49 INFO storage.MemoryStore: Block broadcast_132 stored as values in memory (estimated size 1216.0 B, free 7.8 GB) 17/03/01 04:14:49 INFO tcp.GridTcpRestProtocol: Command protocol successfully stopped: TCP binary 17/03/01 04:14:51 WARN tcp.TcpDiscoverySpi: Failed to ping node (status check will be initiated): 8fd4eea2-2a45-4563-ae87-1848fd388a98 17/03/01 04:14:52 INFO cache.GridCacheProcessor: Stopped cache: ignite-marshaller-sys-cache 17/03/01 04:14:52 INFO cache.GridCacheProcessor: Stopped cache: ignite-sys-cache 17/03/01 04:14:52 INFO cache.GridCacheProcessor: Stopped cache: ignite-atomics-sys-cache 17/03/01 04:14:52 INFO cache.GridCacheProcessor: Stopped cache: WCAIgniteCache 17/03/01 04:14:52 INFO internal.IgniteKernal%WCA: >>> +---------------------------------------------------------------------------------+ >>> Ignite ver. 1.8.0#20161205-sha1:9ca40dbeb7d559fcb299bdb6f5c90cdf8ce7e533 stopped OK >>> +---------------------------------------------------------------------------------+ >>> Grid name: WCA >>> Grid uptime: 00:02:04:791 17/03/01 04:14:52 INFO executor.Executor: Finished task 34.0 in stage 8.0 (TID 347). 931 bytes result sent to driver 17/03/01 04:14:53 INFO executor.CoarseGrainedExecutorBackend: Driver commanded a shutdown 17/03/01 04:14:53 INFO storage.MemoryStore: MemoryStore cleared 17/03/01 04:14:53 INFO storage.BlockManager: BlockManager stopped 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Shutting down remote daemon. 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remote daemon shut down; proceeding with flushing remote transports. 17/03/01 04:14:53 INFO Remoting: Remoting shut down 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remoting shut down. 17/03/01 04:14:53 INFO util.ShutdownHookManager: Shutdown hook called LogType:stdout Log Upload Time:Wed Mar 01 04:14:58 -0600 2017 LogLength:1147 Log Contents: rEnd of the programe - [04:12:38] __________ ________________ [04:12:38] / _/ ___/ |/ / _/_ __/ __/ [04:12:38] _/ // (7 7 // / / / / _/ [04:12:38] /___/\___/_/|_/___/ /_/ /___/ [04:12:38] [04:12:38] ver. 1.8.0#20161205-sha1:9ca40dbe [04:12:38] 2016 Copyright(C) Apache Software Foundation [04:12:38] [04:12:38] Ignite documentation: http://ignite.apache.org [04:12:38] [04:12:38] Quiet mode. [04:12:38] ^-- To see **FULL** console log here add -DIGNITE_QUIET=false or "-v" to ignite.{sh|bat} [04:12:38] [04:12:38] OS: Linux 2.6.32-431.5.1.el6.x86_64 amd64 [04:12:38] VM information: Java(TM) SE Runtime Environment 1.8.0_60-b27 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.60-b23 [04:12:38] Configured plugins: [04:12:38] ^-- None [04:12:38] [04:12:38] Security status [authentication=off, tls/ssl=off] [04:12:47] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [04:12:47] [04:12:47] Ignite node started OK (id=694a80b8, grid=WCA) [04:12:47] Topology snapshot [ver=41, servers=41, clients=0, CPUs=1664, heap=640.0GB] [04:14:52] Ignite node stopped OK [name=WCA, uptime=00:02:04:791] Container: container_e76_1487862040010_131981_01_000013 on hostName_8041 =========================================================================================== LogType:stderr Log Upload Time:Wed Mar 01 04:14:58 -0600 2017 LogLength:83017 Log Contents: 17/03/01 04:11:02 INFO executor.CoarseGrainedExecutorBackend: Registered signal handlers for [TERM, HUP, INT] 17/03/01 04:11:03 INFO spark.SecurityManager: Changing view acls to: userName 17/03/01 04:11:03 INFO spark.SecurityManager: Changing modify acls to: userName 17/03/01 04:11:03 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(userName); users with modify permissions: Set(userName) 17/03/01 04:11:03 INFO slf4j.Slf4jLogger: Slf4jLogger started 17/03/01 04:11:03 INFO Remoting: Starting remoting 17/03/01 04:11:04 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://driverPropsFetcher@hostName:39105] 17/03/01 04:11:04 INFO Remoting: Remoting now listens on addresses: [akka.tcp://driverPropsFetcher@hostName:39105] 17/03/01 04:11:04 INFO util.Utils: Successfully started service 'driverPropsFetcher' on port 39105. 17/03/01 04:11:04 INFO spark.SecurityManager: Changing view acls to: userName 17/03/01 04:11:04 INFO spark.SecurityManager: Changing modify acls to: userName 17/03/01 04:11:04 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(userName); users with modify permissions: Set(userName) 17/03/01 04:11:04 INFO remote.RemoteActorRefProvider$RemotingTerminator: Shutting down remote daemon. 17/03/01 04:11:04 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remote daemon shut down; proceeding with flushing remote transports. 17/03/01 04:11:04 INFO slf4j.Slf4jLogger: Slf4jLogger started 17/03/01 04:11:04 INFO Remoting: Remoting shut down 17/03/01 04:11:04 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remoting shut down. 17/03/01 04:11:04 INFO Remoting: Starting remoting 17/03/01 04:11:04 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://sparkExecutor@hostName:34871] 17/03/01 04:11:04 INFO Remoting: Remoting now listens on addresses: [akka.tcp://sparkExecutor@hostName:34871] 17/03/01 04:11:04 INFO util.Utils: Successfully started service 'sparkExecutor' on port 34871. 17/03/01 04:11:04 INFO storage.DiskBlockManager: Created local directory at /data/1/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-cf2aead3-3908-4032-a39a-b4bee9229d12 17/03/01 04:11:04 INFO storage.DiskBlockManager: Created local directory at /data/2/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-f9f4448f-f1aa-400b-8d1b-b60070975c46 17/03/01 04:11:04 INFO storage.DiskBlockManager: Created local directory at /data/3/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-872d6b18-b095-438e-af36-ab912540d968 17/03/01 04:11:04 INFO storage.DiskBlockManager: Created local directory at /data/4/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-8f2b522e-3239-47db-b2a2-05c6547b9205 17/03/01 04:11:04 INFO storage.DiskBlockManager: Created local directory at /data/5/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-bca89c31-ed47-4306-be49-2f53ff57dcbb 17/03/01 04:11:04 INFO storage.DiskBlockManager: Created local directory at /data/6/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-de1b9829-70a8-4a6f-bcbe-11043489b44d 17/03/01 04:11:04 INFO storage.DiskBlockManager: Created local directory at /data/7/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-c68387ae-0d63-4b59-a4cd-76da928a8e8b 17/03/01 04:11:04 INFO storage.DiskBlockManager: Created local directory at /data/8/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-e1cdee5f-28d9-477a-b0e5-f02c868f19a9 17/03/01 04:11:04 INFO storage.DiskBlockManager: Created local directory at /data/9/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-68057b19-4de8-40b5-8428-870d6d11f0fe 17/03/01 04:11:04 INFO storage.DiskBlockManager: Created local directory at /data/10/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-fef7706d-58bd-4b9b-b6b2-3e539cda00d6 17/03/01 04:11:04 INFO storage.DiskBlockManager: Created local directory at /data/11/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-304ac528-b68c-4cad-b702-8f24a0988ca9 17/03/01 04:11:04 INFO storage.DiskBlockManager: Created local directory at /data/12/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-4a6ec0d6-99c6-47ac-b9dc-62b5d02200c3 17/03/01 04:11:04 INFO storage.MemoryStore: MemoryStore started with capacity 7.8 GB 17/03/01 04:11:04 INFO executor.CoarseGrainedExecutorBackend: Connecting to driver: akka.tcp://sparkDriver@ipaddress:38995/user/CoarseGrainedScheduler 17/03/01 04:11:04 INFO executor.CoarseGrainedExecutorBackend: Successfully registered with driver 17/03/01 04:11:04 INFO executor.Executor: Starting executor ID 10 on host hostName 17/03/01 04:11:04 INFO util.Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 40903. 17/03/01 04:11:04 INFO netty.NettyBlockTransferService: Server created on 40903 17/03/01 04:11:04 INFO storage.BlockManagerMaster: Trying to register BlockManager 17/03/01 04:11:04 INFO storage.BlockManagerMaster: Registered BlockManager 17/03/01 04:12:16 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 76 17/03/01 04:12:16 INFO executor.Executor: Running task 23.0 in stage 2.0 (TID 76) 17/03/01 04:12:17 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 84 17/03/01 04:12:17 INFO storage.MemoryStore: ensureFreeSpace(9240) called with curMem=0, maxMem=8334920908 17/03/01 04:12:17 INFO storage.MemoryStore: Block broadcast_84_piece0 stored as bytes in memory (estimated size 9.0 KB, free 7.8 GB) 17/03/01 04:12:17 INFO broadcast.TorrentBroadcast: Reading broadcast variable 84 took 203 ms 17/03/01 04:12:17 INFO storage.MemoryStore: ensureFreeSpace(32704) called with curMem=9240, maxMem=8334920908 17/03/01 04:12:17 INFO storage.MemoryStore: Block broadcast_84 stored as values in memory (estimated size 31.9 KB, free 7.8 GB) 17/03/01 04:12:18 INFO codegen.GenerateMutableProjection: Code generated in 93.603958 ms 17/03/01 04:12:18 INFO codegen.GenerateUnsafeProjection: Code generated in 9.190292 ms 17/03/01 04:12:18 INFO codegen.GenerateMutableProjection: Code generated in 12.384074 ms 17/03/01 04:12:18 INFO codegen.GenerateUnsafeRowJoiner: Code generated in 7.501432 ms 17/03/01 04:12:18 INFO codegen.GenerateUnsafeProjection: Code generated in 7.422196 ms 17/03/01 04:12:18 INFO rdd.HadoopRDD: Input split: avro path/part-r-00022-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:32180181+32180181 17/03/01 04:12:18 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 55 17/03/01 04:12:18 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=41944, maxMem=8334920908 17/03/01 04:12:18 INFO storage.MemoryStore: Block broadcast_55_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:12:18 INFO broadcast.TorrentBroadcast: Reading broadcast variable 55 took 45 ms 17/03/01 04:12:18 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=66587, maxMem=8334920908 17/03/01 04:12:18 INFO storage.MemoryStore: Block broadcast_55 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:12:19 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 17/03/01 04:12:19 INFO Configuration.deprecation: mapred.tip.id is deprecated. Instead, use mapreduce.task.id 17/03/01 04:12:19 INFO Configuration.deprecation: mapred.task.id is deprecated. Instead, use mapreduce.task.attempt.id 17/03/01 04:12:19 INFO Configuration.deprecation: mapred.task.is.map is deprecated. Instead, use mapreduce.task.ismap 17/03/01 04:12:19 INFO Configuration.deprecation: mapred.task.partition is deprecated. Instead, use mapreduce.task.partition 17/03/01 04:12:19 INFO Configuration.deprecation: mapred.job.id is deprecated. Instead, use mapreduce.job.id 17/03/01 04:12:19 WARN security.UserGroupInformation: PriviledgedActionException as:userName (auth:SIMPLE) cause:org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:12:19 WARN ipc.Client: Exception encountered while connecting to the server : org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:12:19 WARN security.UserGroupInformation: PriviledgedActionException as:userName (auth:SIMPLE) cause:org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:12:21 INFO executor.Executor: Finished task 23.0 in stage 2.0 (TID 76). 2495 bytes result sent to driver 17/03/01 04:12:38 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 143 17/03/01 04:12:38 INFO executor.Executor: Running task 21.0 in stage 4.0 (TID 143) 17/03/01 04:12:38 INFO spark.MapOutputTrackerWorker: Updating epoch to 1 and clearing cache 17/03/01 04:12:38 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 86 17/03/01 04:12:38 INFO storage.MemoryStore: ensureFreeSpace(2290) called with curMem=413659, maxMem=8334920908 17/03/01 04:12:38 INFO storage.MemoryStore: Block broadcast_86_piece0 stored as bytes in memory (estimated size 2.2 KB, free 7.8 GB) 17/03/01 04:12:38 INFO broadcast.TorrentBroadcast: Reading broadcast variable 86 took 12 ms 17/03/01 04:12:38 INFO storage.MemoryStore: ensureFreeSpace(6544) called with curMem=415949, maxMem=8334920908 17/03/01 04:12:38 INFO storage.MemoryStore: Block broadcast_86 stored as values in memory (estimated size 6.4 KB, free 7.8 GB) 17/03/01 04:12:38 INFO resolver.CompanyResolverSparkTest: testing worker[ipaddress:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509] 17/03/01 04:12:38 ERROR : Failed to resolve default logging config file: config/java.util.logging.properties Console logging handler is not configured. 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: >>> __________ ________________ >>> / _/ ___/ |/ / _/_ __/ __/ >>> _/ // (7 7 // / / / / _/ >>> /___/\___/_/|_/___/ /_/ /___/ >>> >>> ver. 1.8.0#20161205-sha1:9ca40dbe >>> 2016 Copyright(C) Apache Software Foundation >>> >>> Ignite documentation: http://ignite.apache.org 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Config URL: n/a 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Daemon mode: off 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: OS: Linux 2.6.32-431.5.1.el6.x86_64 amd64 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: OS user: userName 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: PID: 32806 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Language runtime: Java Platform API Specification ver. 1.8 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM information: Java(TM) SE Runtime Environment 1.8.0_60-b27 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.60-b23 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM total memory: 14.0GB 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Remote Management [restart: off, REST: on, JMX (remote: off)] 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: IGNITE_HOME=null 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM arguments: [-XX:OnOutOfMemoryError=kill %p, -Xms15360m, -Xmx15360m, -Djava.io.tmpdir=/data/2/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/container_e76_1487862040010_131981_01_000013/tmp, -Dspark.driver.port=38995, -Dspark.ui.port=0, -Dspark.yarn.app.container.log.dir=/data/7/yarn/log/container/application_1487862040010_131981/container_e76_1487862040010_131981_01_000013] 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Configured caches ['ignite-marshaller-sys-cache', 'ignite-sys-cache', 'ignite-atomics-sys-cache'] 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: Configured plugins: 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: ^-- None 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: 17/03/01 04:12:39 INFO tcp.TcpCommunicationSpi: IPC shared memory server endpoint started [port=48100, tokDir=/data/2/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/container_e76_1487862040010_131981_01_000013/tmp/ignite/work/ipc/shmem/058a99e8-3b65-4ec9-84b0-6f3502c2afce-32806] 17/03/01 04:12:39 INFO tcp.TcpCommunicationSpi: Successfully bound shared memory communication to TCP port [port=48100, locHost=0.0.0.0/0.0.0.0] 17/03/01 04:12:39 INFO tcp.TcpCommunicationSpi: Successfully bound to TCP port [port=47100, locHost=0.0.0.0/0.0.0.0] 17/03/01 04:12:39 WARN noop.NoopCheckpointSpi: Checkpoints are disabled (to enable configure any GridCheckpointSpi implementation) 17/03/01 04:12:39 WARN collision.GridCollisionManager: Collision resolution is disabled (all jobs will be activated upon arrival). 17/03/01 04:12:39 WARN noop.NoopSwapSpaceSpi: Swap space is disabled. To enable use FileSwapSpaceSpi. 17/03/01 04:12:39 INFO internal.IgniteKernal%WCA: Security status [authentication=off, tls/ssl=off] 17/03/01 04:12:40 INFO tcp.GridTcpRestProtocol: Command protocol successfully started [name=TCP binary, host=0.0.0.0/0.0.0.0, port=11211] 17/03/01 04:12:40 INFO internal.IgniteKernal%WCA: Non-loopback local IPs: 17/03/01 04:12:40 INFO internal.IgniteKernal%WCA: Enabled local MACs: 44A842104096 17/03/01 04:12:40 INFO tcp.TcpDiscoverySpi: Successfully bound to TCP port [port=47500, localHost=0.0.0.0/0.0.0.0, locNodeId=058a99e8-3b65-4ec9-84b0-6f3502c2afce] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=57c09d88-a4dc-4179-98b4-1144fd97d8cc, addrs=[35, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/35:47500], discPort=47500, order=29, intOrder=29, lastExchangeTime=1488363162988, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=29, servers=29, clients=0, CPUs=1192, heap=460.0GB] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=58298821-7aa9-4b58-ba15-e7f1ef2830fb, addrs=[3, 127.0.0.1], sockAddrs=[hostName/3:47500, /127.0.0.1:47500], discPort=47500, order=30, intOrder=30, lastExchangeTime=1488363162998, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=30, servers=30, clients=0, CPUs=1232, heap=470.0GB] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4d5de2f3-d975-4b28-b593-0cc0481cdc74, addrs=[03, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/03:47500], discPort=47500, order=31, intOrder=31, lastExchangeTime=1488363163018, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=31, servers=31, clients=0, CPUs=1280, heap=490.0GB] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=fa09caab-f4dc-43b6-ac8b-4a4bae6e7da6, addrs=[01, 127.0.0.1], sockAddrs=[hostName/01:47500, /127.0.0.1:47500], discPort=47500, order=32, intOrder=32, lastExchangeTime=1488363163039, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=32, servers=32, clients=0, CPUs=1320, heap=500.0GB] 17/03/01 04:12:43 INFO cache.GridCacheProcessor: Started cache [name=ignite-sys-cache, mode=REPLICATED] 17/03/01 04:12:43 INFO cache.GridCacheProcessor: Started cache [name=ignite-atomics-sys-cache, mode=PARTITIONED] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=af5837f0-25ec-4f3d-a1c1-90c09dc424cb, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=33, intOrder=33, lastExchangeTime=1488363163060, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=33, servers=33, clients=0, CPUs=1360, heap=520.0GB] 17/03/01 04:12:44 INFO cache.GridCacheProcessor: Started cache [name=WCAIgniteCache, mode=PARTITIONED] 17/03/01 04:12:44 INFO cache.GridCacheProcessor: Started cache [name=ignite-marshaller-sys-cache, mode=REPLICATED] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=e9e49d2d-5eeb-474f-8757-e447efc8ca8f, addrs=[6, 127.0.0.1], sockAddrs=[hostName/6:47500, /127.0.0.1:47500], discPort=47500, order=34, intOrder=34, lastExchangeTime=1488363163070, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=34, servers=34, clients=0, CPUs=1400, heap=530.0GB] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4b90e5a3-253a-435b-84ca-6b592610cf0c, addrs=[4, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/4:47500], discPort=47500, order=35, intOrder=35, lastExchangeTime=1488363163080, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=35, servers=35, clients=0, CPUs=1432, heap=550.0GB] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=8fd4eea2-2a45-4563-ae87-1848fd388a98, addrs=[3, 127.0.0.1], sockAddrs=[hostName/3:47500, /127.0.0.1:47500], discPort=47500, order=36, intOrder=36, lastExchangeTime=1488363163080, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=36, servers=36, clients=0, CPUs=1472, heap=560.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=28, minorTopVer=0], evt=NODE_JOINED, node=058a99e8-3b65-4ec9-84b0-6f3502c2afce] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=d7b45a02-0411-4028-acdf-f004e592f294, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=37, intOrder=37, lastExchangeTime=1488363163141, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=37, servers=37, clients=0, CPUs=1512, heap=580.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=29, minorTopVer=0], evt=NODE_JOINED, node=57c09d88-a4dc-4179-98b4-1144fd97d8cc] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=cf4e6e83-207e-42da-a55c-5621bc20b891, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=38, intOrder=38, lastExchangeTime=1488363163162, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=38, servers=38, clients=0, CPUs=1552, heap=590.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=30, minorTopVer=0], evt=NODE_JOINED, node=58298821-7aa9-4b58-ba15-e7f1ef2830fb] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=d8926a2c-2c00-4445-beb4-633c2d656c41, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=39, intOrder=39, lastExchangeTime=1488363163172, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=39, servers=39, clients=0, CPUs=1584, heap=610.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=31, minorTopVer=0], evt=NODE_JOINED, node=4d5de2f3-d975-4b28-b593-0cc0481cdc74] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4136a0c9-14d5-42b3-9a60-81689c800438, addrs=[3, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/3:47500], discPort=47500, order=40, intOrder=40, lastExchangeTime=1488363163213, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=40, servers=40, clients=0, CPUs=1624, heap=620.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=32, minorTopVer=0], evt=NODE_JOINED, node=fa09caab-f4dc-43b6-ac8b-4a4bae6e7da6] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=694a80b8-02a3-44c9-a2dd-45bed7d20a50, addrs=[1, 127.0.0.1], sockAddrs=[hostName/1:47500, /127.0.0.1:47500], discPort=47500, order=41, intOrder=41, lastExchangeTime=1488363163223, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=41, servers=41, clients=0, CPUs=1664, heap=640.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=33, minorTopVer=0], evt=NODE_JOINED, node=af5837f0-25ec-4f3d-a1c1-90c09dc424cb] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=34, minorTopVer=0], evt=NODE_JOINED, node=e9e49d2d-5eeb-474f-8757-e447efc8ca8f] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=35, minorTopVer=0], evt=NODE_JOINED, node=4b90e5a3-253a-435b-84ca-6b592610cf0c] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=36, minorTopVer=0], evt=NODE_JOINED, node=8fd4eea2-2a45-4563-ae87-1848fd388a98] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=37, minorTopVer=0], evt=NODE_JOINED, node=d7b45a02-0411-4028-acdf-f004e592f294] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=38, minorTopVer=0], evt=NODE_JOINED, node=cf4e6e83-207e-42da-a55c-5621bc20b891] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=39, minorTopVer=0], evt=NODE_JOINED, node=d8926a2c-2c00-4445-beb4-633c2d656c41] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=40, minorTopVer=0], evt=NODE_JOINED, node=4136a0c9-14d5-42b3-9a60-81689c800438] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-sys-cache, waitList=[]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-marshaller-sys-cache, waitList=[]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-atomics-sys-cache, waitList=[ignite-sys-cache, ignite-marshaller-sys-cache]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=WCAIgniteCache, waitList=[ignite-sys-cache, ignite-marshaller-sys-cache, ignite-atomics-sys-cache]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Rebalancing required [top=AffinityTopologyVersion [topVer=41, minorTopVer=0], evt=NODE_JOINED, node=694a80b8-02a3-44c9-a2dd-45bed7d20a50] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-marshaller-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=20, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=14] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=100, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=14] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-marshaller-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=30 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=20 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-atomics-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=27, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=14] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-atomics-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=10 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=WCAIgniteCache, mode=ASYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=27, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=14] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=WCAIgniteCache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=0 ms] 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: >>> +----------------------------------------------------------------------+ >>> Ignite ver. 1.8.0#20161205-sha1:9ca40dbeb7d559fcb299bdb6f5c90cdf8ce7e533 >>> +----------------------------------------------------------------------+ >>> OS name: Linux 2.6.32-431.5.1.el6.x86_64 amd64 >>> CPU(s): 40 >>> Heap: 15.0GB >>> VM name: 32806@hostName >>> Grid name: WCA >>> Local node [ID=058A99E8-3B65-4EC9-84B0-6F3502C2AFCE, order=28, clientMode=false] >>> Local node addresses: [hostName/, /127.0.0.1] >>> Local ports: TCP:11211 TCP:47100 TCP:47500 TCP:48100 17/03/01 04:12:47 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=28, servers=28, clients=0, CPUs=1144, heap=440.0GB] 17/03/01 04:12:47 INFO resolver.CompanyResolverSparkTest: Started ignite node on executor 17/03/01 04:12:47 INFO executor.Executor: Finished task 21.0 in stage 4.0 (TID 143). 931 bytes result sent to driver 17/03/01 04:12:49 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=41, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, node=6172ee3a-eb33-4bf5-9080-c255f52caed8] 17/03/01 04:12:52 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 188 17/03/01 04:12:52 INFO executor.Executor: Running task 22.0 in stage 5.0 (TID 188) 17/03/01 04:12:52 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 128 17/03/01 04:12:52 INFO storage.MemoryStore: ensureFreeSpace(7311) called with curMem=0, maxMem=8334920908 17/03/01 04:12:52 INFO storage.MemoryStore: Block broadcast_128_piece0 stored as bytes in memory (estimated size 7.1 KB, free 7.8 GB) 17/03/01 04:12:52 INFO broadcast.TorrentBroadcast: Reading broadcast variable 128 took 17 ms 17/03/01 04:12:52 INFO storage.MemoryStore: ensureFreeSpace(28168) called with curMem=7311, maxMem=8334920908 17/03/01 04:12:52 INFO storage.MemoryStore: Block broadcast_128 stored as values in memory (estimated size 27.5 KB, free 7.8 GB) 17/03/01 04:12:53 INFO rdd.HadoopRDD: Input split: avro path/part-r-00022-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:0+32180181 17/03/01 04:12:53 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 99 17/03/01 04:12:53 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=35479, maxMem=8334920908 17/03/01 04:12:53 INFO storage.MemoryStore: Block broadcast_99_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:12:53 INFO broadcast.TorrentBroadcast: Reading broadcast variable 99 took 14 ms 17/03/01 04:12:53 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=60122, maxMem=8334920908 17/03/01 04:12:53 INFO storage.MemoryStore: Block broadcast_99 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:13:01 INFO executor.Executor: Finished task 22.0 in stage 5.0 (TID 188). 2098 bytes result sent to driver 17/03/01 04:13:47 INFO internal.IgniteKernal%WCA: Metrics for local node (to disable set 'metricsLogFrequency' to 0) ^-- Node [id=058a99e8, name=WCA, uptime=00:01:00:002] ^-- H/N/C [hosts=41, nodes=41, CPUs=1664] ^-- CPU [cur=2.33%, avg=4.35%, GC=0%] ^-- Heap [used=3529MB, free=76.03%, comm=14726MB] ^-- Non heap [used=119MB, free=-1%, comm=121MB] ^-- Public thread pool [active=0, idle=0, qSize=0] ^-- System thread pool [active=0, idle=79, qSize=0] ^-- Outbound messages queue [size=0] 17/03/01 04:13:53 INFO cluster.GridUpdateNotifier: Update status is not available. 17/03/01 04:14:00 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 252 17/03/01 04:14:00 INFO executor.Executor: Running task 8.0 in stage 7.0 (TID 252) 17/03/01 04:14:00 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 131 17/03/01 04:14:00 INFO storage.MemoryStore: ensureFreeSpace(2732) called with curMem=407194, maxMem=8334920908 17/03/01 04:14:00 INFO storage.MemoryStore: Block broadcast_131_piece0 stored as bytes in memory (estimated size 2.7 KB, free 7.8 GB) 17/03/01 04:14:00 INFO broadcast.TorrentBroadcast: Reading broadcast variable 131 took 34 ms 17/03/01 04:14:00 INFO storage.MemoryStore: ensureFreeSpace(7336) called with curMem=409926, maxMem=8334920908 17/03/01 04:14:00 INFO storage.MemoryStore: Block broadcast_131 stored as values in memory (estimated size 7.2 KB, free 7.8 GB) 17/03/01 04:14:00 INFO dao.CompanyDAO: testing[ipaddress:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509] 17/03/01 04:14:00 INFO dao.CompanyDAO: input company name inside Contains searchSANFORD OIL 17/03/01 04:14:11 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=daed0152-83fc-4828-ada6-64c74787b190, res=GridCacheQueryResponse [finished=true, reqId=359, err=null, fields=false, metadata=null]] 17/03/01 04:14:11 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=af5837f0-25ec-4f3d-a1c1-90c09dc424cb, res=GridCacheQueryResponse [finished=true, reqId=359, err=null, fields=false, metadata=null]] 17/03/01 04:14:11 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=90db2cab-26f6-463d-9755-d03d059a8723, res=GridCacheQueryResponse [finished=true, reqId=359, err=java.lang.NullPointerException, fields=false, metadata=null]] 17/03/01 04:14:11 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=c4f4f6bb-b71a-4a29-9575-afee2ddc1b2d, res=GridCacheQueryResponse [finished=true, reqId=359, err=null, fields=false, metadata=null]] 17/03/01 04:14:11 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=9fb6e583-cea0-4f78-b403-b403a8bc9a0e, res=GridCacheQueryResponse [finished=false, reqId=359, err=null, fields=false, metadata=null]] 17/03/01 04:14:11 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=ffe19475-7849-4027-8648-ce56598ff50f, res=GridCacheQueryResponse [finished=true, reqId=359, err=null, fields=false, metadata=null]] 17/03/01 04:14:11 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=e2cba212-89dd-48dd-8d7e-821b5725fe03, res=GridCacheQueryResponse [finished=true, reqId=359, err=null, fields=false, metadata=null]] 17/03/01 04:14:11 ERROR executor.Executor: Exception in task 8.0 in stage 7.0 (TID 252) javax.cache.CacheException: class org.apache.ignite.IgniteCheckedException: Query execution failed: GridCacheQueryBean [qry=GridCacheQueryAdapter [type=TEXT, clsName=CompanyVO1, clause=SANFORD OIL, filter=null, transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=true, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=058a99e8-3b65-4ec9-84b0-6f3502c2afce, taskHash=0], rdc=null, trans=null] at org.apache.ignite.internal.processors.cache.GridCacheUtils.convertToCacheException(GridCacheUtils.java:1440) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.next(GridCacheQueryFutureAdapter.java:174) at org.apache.ignite.internal.processors.cache.IgniteCacheProxy$5.onHasNext(IgniteCacheProxy.java:600) at org.apache.ignite.internal.util.GridCloseableIteratorAdapter.hasNextX(GridCloseableIteratorAdapter.java:53) at org.apache.ignite.internal.util.lang.GridIteratorAdapter.hasNext(GridIteratorAdapter.java:45) at un.api.resolver.dao.CompanyDAO.getVarCompContains(CompanyDAO.scala:242) at un.api.resolver.accessor.CompanyAccessor.getVarCompContains(CompanyAccessor.scala:27) at un.api.resolver.CompanyResolverSparkTest$$anonfun$main$7.apply(CompanyResolverSparkTest.scala:291) at un.api.resolver.CompanyResolverSparkTest$$anonfun$main$7.apply(CompanyResolverSparkTest.scala:289) at scala.collection.Iterator$$anon$11.next(Iterator.scala:328) at org.apache.spark.util.Utils$.getIteratorSize(Utils.scala:1554) at org.apache.spark.rdd.RDD$$anonfun$count$1.apply(RDD.scala:1121) at org.apache.spark.rdd.RDD$$anonfun$count$1.apply(RDD.scala:1121) at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1850) at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1850) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:66) at org.apache.spark.scheduler.Task.run(Task.scala:88) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:214) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: class org.apache.ignite.IgniteCheckedException: Query execution failed: GridCacheQueryBean [qry=GridCacheQueryAdapter [type=TEXT, clsName=CompanyVO1, clause=SANFORD OIL, filter=null, transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=true, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=058a99e8-3b65-4ec9-84b0-6f3502c2afce, taskHash=0], rdc=null, trans=null] at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.checkError(GridCacheQueryFutureAdapter.java:260) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.internalIterator(GridCacheQueryFutureAdapter.java:318) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.next(GridCacheQueryFutureAdapter.java:164) ... 19 more Caused by: class org.apache.ignite.IgniteCheckedException: Failed to execute query on node [query=GridCacheQueryBean [qry=GridCacheQueryAdapter [type=TEXT, clsName=CompanyVO1, clause=SANFORD OIL, filter=null, transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=true, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=058a99e8-3b65-4ec9-84b0-6f3502c2afce, taskHash=0], rdc=null, trans=null], nodeId=23f61699-e2c9-4ff6-8731-2483934e84c4] at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.onPage(GridCacheQueryFutureAdapter.java:383) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.processQueryResponse(GridCacheDistributedQueryManager.java:398) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.access$000(GridCacheDistributedQueryManager.java:63) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$1.apply(GridCacheDistributedQueryManager.java:93) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$1.apply(GridCacheDistributedQueryManager.java:91) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.processMessage(GridCacheIoManager.java:827) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.onMessage0(GridCacheIoManager.java:369) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.access$400(GridCacheIoManager.java:95) at org.apache.ignite.internal.processors.cache.GridCacheIoManager$OrderedMessageListener.onMessage(GridCacheIoManager.java:1345) at org.apache.ignite.internal.managers.communication.GridIoManager.invokeListener(GridIoManager.java:1082) at org.apache.ignite.internal.managers.communication.GridIoManager.access$1600(GridIoManager.java:102) at org.apache.ignite.internal.managers.communication.GridIoManager$GridCommunicationMessageSet.unwind(GridIoManager.java:2332) at org.apache.ignite.internal.managers.communication.GridIoManager.unwindMessageSet(GridIoManager.java:1042) at org.apache.ignite.internal.managers.communication.GridIoManager.access$1900(GridIoManager.java:102) at org.apache.ignite.internal.managers.communication.GridIoManager$6.run(GridIoManager.java:1011) ... 3 more Caused by: java.lang.NullPointerException 17/03/01 04:14:11 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=6b1889dd-9de5-4f1b-8ec9-c123c7df8ea2, res=GridCacheQueryResponse [finished=true, reqId=359, err=null, fields=false, metadata=null]] 17/03/01 04:14:11 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=40d089f0-7c80-4f1f-8659-350791f57a4c, res=GridCacheQueryResponse [finished=true, reqId=359, err=null, fields=false, metadata=null]] 17/03/01 04:14:11 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=133c388f-3399-4cc8-b2f1-7ae8ba971b03, res=GridCacheQueryResponse [finished=true, reqId=359, err=null, fields=false, metadata=null]] 17/03/01 04:14:11 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=694a80b8-02a3-44c9-a2dd-45bed7d20a50, res=GridCacheQueryResponse [finished=true, reqId=359, err=java.lang.NullPointerException, fields=false, metadata=null]] 17/03/01 04:14:11 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=e87f12ce-5981-4418-8468-f6bfed0a0cd8, res=GridCacheQueryResponse [finished=false, reqId=359, err=null, fields=false, metadata=null]] 17/03/01 04:14:11 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=20860cae-2881-4311-a3f5-edaa160ef37f, res=GridCacheQueryResponse [finished=true, reqId=359, err=java.lang.NullPointerException, fields=false, metadata=null]] 17/03/01 04:14:11 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=717de453-fc6b-4a46-91b2-b5c54ab8a4be, res=GridCacheQueryResponse [finished=true, reqId=359, err=null, fields=false, metadata=null]] 17/03/01 04:14:11 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=3e101db5-8c5c-47b7-bbdb-a9a892c4bada, res=GridCacheQueryResponse [finished=true, reqId=359, err=null, fields=false, metadata=null]] 17/03/01 04:14:12 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 309 17/03/01 04:14:12 INFO executor.Executor: Running task 8.1 in stage 7.0 (TID 309) 17/03/01 04:14:28 INFO executor.Executor: Finished task 8.1 in stage 7.0 (TID 309). 969 bytes result sent to driver 17/03/01 04:14:48 INFO internal.IgniteKernal%WCA: Metrics for local node (to disable set 'metricsLogFrequency' to 0) ^-- Node [id=058a99e8, name=WCA, uptime=00:02:00:834] ^-- H/N/C [hosts=41, nodes=41, CPUs=1664] ^-- CPU [cur=0.43%, avg=3.99%, GC=0%] ^-- Heap [used=1625MB, free=89.08%, comm=14886MB] ^-- Non heap [used=125MB, free=-1%, comm=127MB] ^-- Public thread pool [active=0, idle=0, qSize=0] ^-- System thread pool [active=0, idle=80, qSize=0] ^-- Outbound messages queue [size=0] 17/03/01 04:14:49 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 350 17/03/01 04:14:49 INFO executor.Executor: Running task 37.0 in stage 8.0 (TID 350) 17/03/01 04:14:49 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 132 17/03/01 04:14:49 INFO storage.MemoryStore: ensureFreeSpace(887) called with curMem=417262, maxMem=8334920908 17/03/01 04:14:49 INFO storage.MemoryStore: Block broadcast_132_piece0 stored as bytes in memory (estimated size 887.0 B, free 7.8 GB) 17/03/01 04:14:49 INFO broadcast.TorrentBroadcast: Reading broadcast variable 132 took 76 ms 17/03/01 04:14:49 INFO storage.MemoryStore: ensureFreeSpace(1216) called with curMem=418149, maxMem=8334920908 17/03/01 04:14:49 INFO storage.MemoryStore: Block broadcast_132 stored as values in memory (estimated size 1216.0 B, free 7.8 GB) 17/03/01 04:14:49 INFO tcp.GridTcpRestProtocol: Command protocol successfully stopped: TCP binary 17/03/01 04:14:50 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=4136a0c9-14d5-42b3-9a60-81689c800438, addrs=[3, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/3:47500], discPort=47500, order=40, intOrder=40, lastExchangeTime=1488363163213, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:50 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=42, servers=40, clients=0, CPUs=1624, heap=620.0GB] 17/03/01 04:14:50 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=cf4e6e83-207e-42da-a55c-5621bc20b891, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=38, intOrder=38, lastExchangeTime=1488363163162, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:50 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=43, servers=39, clients=0, CPUs=1584, heap=610.0GB] 17/03/01 04:14:50 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=d8926a2c-2c00-4445-beb4-633c2d656c41, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=39, intOrder=39, lastExchangeTime=1488363163172, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:50 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=44, servers=38, clients=0, CPUs=1552, heap=590.0GB] 17/03/01 04:14:50 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=e9e49d2d-5eeb-474f-8757-e447efc8ca8f, addrs=[6, 127.0.0.1], sockAddrs=[hostName/6:47500, /127.0.0.1:47500], discPort=47500, order=34, intOrder=34, lastExchangeTime=1488363163070, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:50 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=45, servers=37, clients=0, CPUs=1512, heap=580.0GB] 17/03/01 04:14:51 WARN tcp.TcpDiscoverySpi: Failed to ping node (status check will be initiated): 8fd4eea2-2a45-4563-ae87-1848fd388a98 17/03/01 04:14:52 INFO cache.GridCacheProcessor: Stopped cache: ignite-marshaller-sys-cache 17/03/01 04:14:52 INFO cache.GridCacheProcessor: Stopped cache: ignite-sys-cache 17/03/01 04:14:52 INFO cache.GridCacheProcessor: Stopped cache: ignite-atomics-sys-cache 17/03/01 04:14:52 INFO cache.GridCacheProcessor: Stopped cache: WCAIgniteCache 17/03/01 04:14:52 INFO internal.IgniteKernal%WCA: >>> +---------------------------------------------------------------------------------+ >>> Ignite ver. 1.8.0#20161205-sha1:9ca40dbeb7d559fcb299bdb6f5c90cdf8ce7e533 stopped OK >>> +---------------------------------------------------------------------------------+ >>> Grid name: WCA >>> Grid uptime: 00:02:05:115 17/03/01 04:14:52 INFO executor.Executor: Finished task 37.0 in stage 8.0 (TID 350). 931 bytes result sent to driver 17/03/01 04:14:53 INFO executor.CoarseGrainedExecutorBackend: Driver commanded a shutdown 17/03/01 04:14:53 INFO storage.MemoryStore: MemoryStore cleared 17/03/01 04:14:53 INFO storage.BlockManager: BlockManager stopped 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Shutting down remote daemon. 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remote daemon shut down; proceeding with flushing remote transports. 17/03/01 04:14:53 INFO Remoting: Remoting shut down 17/03/01 04:14:53 INFO util.ShutdownHookManager: Shutdown hook called LogType:stdout Log Upload Time:Wed Mar 01 04:14:58 -0600 2017 LogLength:2609 Log Contents: rEnd of the programe - [04:12:38] __________ ________________ [04:12:38] / _/ ___/ |/ / _/_ __/ __/ [04:12:38] _/ // (7 7 // / / / / _/ [04:12:38] /___/\___/_/|_/___/ /_/ /___/ [04:12:38] [04:12:38] ver. 1.8.0#20161205-sha1:9ca40dbe [04:12:38] 2016 Copyright(C) Apache Software Foundation [04:12:38] [04:12:38] Ignite documentation: http://ignite.apache.org [04:12:38] [04:12:38] Quiet mode. [04:12:38] ^-- To see **FULL** console log here add -DIGNITE_QUIET=false or "-v" to ignite.{sh|bat} [04:12:38] [04:12:38] OS: Linux 2.6.32-431.5.1.el6.x86_64 amd64 [04:12:38] VM information: Java(TM) SE Runtime Environment 1.8.0_60-b27 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.60-b23 [04:12:38] Configured plugins: [04:12:38] ^-- None [04:12:38] [04:12:39] Security status [authentication=off, tls/ssl=off] [04:12:43] Topology snapshot [ver=29, servers=29, clients=0, CPUs=1192, heap=460.0GB] [04:12:43] Topology snapshot [ver=30, servers=30, clients=0, CPUs=1232, heap=470.0GB] [04:12:43] Topology snapshot [ver=31, servers=31, clients=0, CPUs=1280, heap=490.0GB] [04:12:43] Topology snapshot [ver=32, servers=32, clients=0, CPUs=1320, heap=500.0GB] [04:12:44] Topology snapshot [ver=33, servers=33, clients=0, CPUs=1360, heap=520.0GB] [04:12:44] Topology snapshot [ver=34, servers=34, clients=0, CPUs=1400, heap=530.0GB] [04:12:44] Topology snapshot [ver=35, servers=35, clients=0, CPUs=1432, heap=550.0GB] [04:12:44] Topology snapshot [ver=36, servers=36, clients=0, CPUs=1472, heap=560.0GB] [04:12:44] Topology snapshot [ver=37, servers=37, clients=0, CPUs=1512, heap=580.0GB] [04:12:44] Topology snapshot [ver=38, servers=38, clients=0, CPUs=1552, heap=590.0GB] [04:12:45] Topology snapshot [ver=39, servers=39, clients=0, CPUs=1584, heap=610.0GB] [04:12:45] Topology snapshot [ver=40, servers=40, clients=0, CPUs=1624, heap=620.0GB] [04:12:45] Topology snapshot [ver=41, servers=41, clients=0, CPUs=1664, heap=640.0GB] [04:12:47] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [04:12:47] [04:12:47] Ignite node started OK (id=058a99e8, grid=WCA) [04:12:47] Topology snapshot [ver=28, servers=28, clients=0, CPUs=1144, heap=440.0GB] [04:14:50] Topology snapshot [ver=42, servers=40, clients=0, CPUs=1624, heap=620.0GB] [04:14:50] Topology snapshot [ver=43, servers=39, clients=0, CPUs=1584, heap=610.0GB] [04:14:50] Topology snapshot [ver=44, servers=38, clients=0, CPUs=1552, heap=590.0GB] [04:14:50] Topology snapshot [ver=45, servers=37, clients=0, CPUs=1512, heap=580.0GB] [04:14:52] Ignite node stopped OK [name=WCA, uptime=00:02:05:115] Container: container_e76_1487862040010_131981_01_000007 on hostName_8041 =========================================================================================== LogType:stderr Log Upload Time:Wed Mar 01 04:14:58 -0600 2017 LogLength:51113 Log Contents: 17/03/01 04:10:59 INFO executor.CoarseGrainedExecutorBackend: Registered signal handlers for [TERM, HUP, INT] 17/03/01 04:11:00 INFO spark.SecurityManager: Changing view acls to: userName 17/03/01 04:11:00 INFO spark.SecurityManager: Changing modify acls to: userName 17/03/01 04:11:00 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(userName); users with modify permissions: Set(userName) 17/03/01 04:11:00 INFO slf4j.Slf4jLogger: Slf4jLogger started 17/03/01 04:11:00 INFO Remoting: Starting remoting 17/03/01 04:11:01 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://driverPropsFetcher@hostName:60563] 17/03/01 04:11:01 INFO Remoting: Remoting now listens on addresses: [akka.tcp://driverPropsFetcher@hostName:60563] 17/03/01 04:11:01 INFO util.Utils: Successfully started service 'driverPropsFetcher' on port 60563. 17/03/01 04:11:01 INFO spark.SecurityManager: Changing view acls to: userName 17/03/01 04:11:01 INFO spark.SecurityManager: Changing modify acls to: userName 17/03/01 04:11:01 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(userName); users with modify permissions: Set(userName) 17/03/01 04:11:01 INFO remote.RemoteActorRefProvider$RemotingTerminator: Shutting down remote daemon. 17/03/01 04:11:01 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remote daemon shut down; proceeding with flushing remote transports. 17/03/01 04:11:01 INFO slf4j.Slf4jLogger: Slf4jLogger started 17/03/01 04:11:01 INFO Remoting: Remoting shut down 17/03/01 04:11:01 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remoting shut down. 17/03/01 04:11:01 INFO Remoting: Starting remoting 17/03/01 04:11:01 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://sparkExecutor@hostName:46551] 17/03/01 04:11:01 INFO Remoting: Remoting now listens on addresses: [akka.tcp://sparkExecutor@hostName:46551] 17/03/01 04:11:01 INFO util.Utils: Successfully started service 'sparkExecutor' on port 46551. 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/1/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-6385d03d-33d7-48c1-a2bb-3c3f34f0a66c 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/2/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-9835811c-432a-4600-ade1-fedc6ceeaf01 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/3/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-e32da0e1-7c01-49c3-8ab9-283d38e2ea53 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/4/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-9df85a17-e058-491b-821c-593c62ed6d80 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/5/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-1c8a1be8-74d0-426d-8219-13bcaac7039c 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/6/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-e0326a51-461d-4a4a-a790-7c6a84e27a5e 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/7/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-af312100-b5c5-49bc-980d-1f9020ce1a4d 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/8/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-bd919be4-278f-46a9-a710-074739593e0e 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/9/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-1482226f-a984-42f8-9341-98553d7090d1 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/10/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-ba2e8458-b823-493b-8fce-f7403791c2a1 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/11/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-321fd983-01ca-4f24-b236-ab5c6c41c8ed 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/12/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-1faeaa32-c396-4228-b970-5e951290f8b3 17/03/01 04:11:01 INFO storage.MemoryStore: MemoryStore started with capacity 7.8 GB 17/03/01 04:11:01 INFO executor.CoarseGrainedExecutorBackend: Connecting to driver: akka.tcp://sparkDriver@ipaddress:38995/user/CoarseGrainedScheduler 17/03/01 04:11:01 INFO executor.CoarseGrainedExecutorBackend: Successfully registered with driver 17/03/01 04:11:01 INFO executor.Executor: Starting executor ID 4 on host hostName 17/03/01 04:11:01 INFO util.Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 48862. 17/03/01 04:11:01 INFO netty.NettyBlockTransferService: Server created on 48862 17/03/01 04:11:01 INFO storage.BlockManagerMaster: Trying to register BlockManager 17/03/01 04:11:01 INFO storage.BlockManagerMaster: Registered BlockManager 17/03/01 04:11:02 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 32 17/03/01 04:11:02 INFO executor.Executor: Running task 32.0 in stage 0.0 (TID 32) 17/03/01 04:11:02 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 0 17/03/01 04:11:02 INFO storage.MemoryStore: ensureFreeSpace(1310) called with curMem=0, maxMem=8334920908 17/03/01 04:11:02 INFO storage.MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 1310.0 B, free 7.8 GB) 17/03/01 04:11:02 INFO broadcast.TorrentBroadcast: Reading broadcast variable 0 took 234 ms 17/03/01 04:11:02 INFO storage.MemoryStore: ensureFreeSpace(2064) called with curMem=1310, maxMem=8334920908 17/03/01 04:11:02 INFO storage.MemoryStore: Block broadcast_0 stored as values in memory (estimated size 2.0 KB, free 7.8 GB) 17/03/01 04:11:02 INFO resolver.CompanyResolverSparkTest: Ranjit exec test 17/03/01 04:11:02 INFO executor.Executor: Finished task 32.0 in stage 0.0 (TID 32). 972 bytes result sent to driver 17/03/01 04:12:03 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 55 17/03/01 04:12:03 INFO executor.Executor: Running task 14.0 in stage 2.0 (TID 55) 17/03/01 04:12:03 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 84 17/03/01 04:12:03 INFO storage.MemoryStore: ensureFreeSpace(9240) called with curMem=3374, maxMem=8334920908 17/03/01 04:12:03 INFO storage.MemoryStore: Block broadcast_84_piece0 stored as bytes in memory (estimated size 9.0 KB, free 7.8 GB) 17/03/01 04:12:03 INFO broadcast.TorrentBroadcast: Reading broadcast variable 84 took 41 ms 17/03/01 04:12:03 INFO storage.MemoryStore: ensureFreeSpace(32704) called with curMem=12614, maxMem=8334920908 17/03/01 04:12:03 INFO storage.MemoryStore: Block broadcast_84 stored as values in memory (estimated size 31.9 KB, free 7.8 GB) 17/03/01 04:12:04 INFO codegen.GenerateMutableProjection: Code generated in 99.14807 ms 17/03/01 04:12:04 INFO codegen.GenerateUnsafeProjection: Code generated in 10.349075 ms 17/03/01 04:12:04 INFO codegen.GenerateMutableProjection: Code generated in 14.919534 ms 17/03/01 04:12:04 INFO codegen.GenerateUnsafeRowJoiner: Code generated in 8.410922 ms 17/03/01 04:12:04 INFO codegen.GenerateUnsafeProjection: Code generated in 8.348643 ms 17/03/01 04:12:04 INFO rdd.HadoopRDD: Input split: avro path/part-r-00001-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:0+37465164 17/03/01 04:12:04 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 51 17/03/01 04:12:04 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=45318, maxMem=8334920908 17/03/01 04:12:04 INFO storage.MemoryStore: Block broadcast_51_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:12:04 INFO broadcast.TorrentBroadcast: Reading broadcast variable 51 took 9 ms 17/03/01 04:12:04 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=69961, maxMem=8334920908 17/03/01 04:12:04 INFO storage.MemoryStore: Block broadcast_51 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:12:04 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 17/03/01 04:12:04 INFO Configuration.deprecation: mapred.tip.id is deprecated. Instead, use mapreduce.task.id 17/03/01 04:12:04 INFO Configuration.deprecation: mapred.task.id is deprecated. Instead, use mapreduce.task.attempt.id 17/03/01 04:12:04 INFO Configuration.deprecation: mapred.task.is.map is deprecated. Instead, use mapreduce.task.ismap 17/03/01 04:12:04 INFO Configuration.deprecation: mapred.task.partition is deprecated. Instead, use mapreduce.task.partition 17/03/01 04:12:04 INFO Configuration.deprecation: mapred.job.id is deprecated. Instead, use mapreduce.job.id 17/03/01 04:12:04 WARN security.UserGroupInformation: PriviledgedActionException as:userName (auth:SIMPLE) cause:org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:12:04 WARN ipc.Client: Exception encountered while connecting to the server : org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:12:04 WARN security.UserGroupInformation: PriviledgedActionException as:userName (auth:SIMPLE) cause:org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:12:07 INFO executor.Executor: Finished task 14.0 in stage 2.0 (TID 55). 2494 bytes result sent to driver 17/03/01 04:12:38 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 134 17/03/01 04:12:38 INFO executor.Executor: Running task 12.0 in stage 4.0 (TID 134) 17/03/01 04:12:38 INFO spark.MapOutputTrackerWorker: Updating epoch to 1 and clearing cache 17/03/01 04:12:38 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 86 17/03/01 04:12:38 INFO storage.MemoryStore: ensureFreeSpace(2290) called with curMem=417033, maxMem=8334920908 17/03/01 04:12:38 INFO storage.MemoryStore: Block broadcast_86_piece0 stored as bytes in memory (estimated size 2.2 KB, free 7.8 GB) 17/03/01 04:12:38 INFO broadcast.TorrentBroadcast: Reading broadcast variable 86 took 9 ms 17/03/01 04:12:38 INFO storage.MemoryStore: ensureFreeSpace(6544) called with curMem=419323, maxMem=8334920908 17/03/01 04:12:38 INFO storage.MemoryStore: Block broadcast_86 stored as values in memory (estimated size 6.4 KB, free 7.8 GB) 17/03/01 04:12:38 INFO resolver.CompanyResolverSparkTest: testing worker[ipaddress:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509] 17/03/01 04:12:38 ERROR : Failed to resolve default logging config file: config/java.util.logging.properties Console logging handler is not configured. 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: >>> __________ ________________ >>> / _/ ___/ |/ / _/_ __/ __/ >>> _/ // (7 7 // / / / / _/ >>> /___/\___/_/|_/___/ /_/ /___/ >>> >>> ver. 1.8.0#20161205-sha1:9ca40dbe >>> 2016 Copyright(C) Apache Software Foundation >>> >>> Ignite documentation: http://ignite.apache.org 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Config URL: n/a 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Daemon mode: off 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: OS: Linux 2.6.32-431.5.1.el6.x86_64 amd64 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: OS user: userName 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: PID: 21886 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Language runtime: Java Platform API Specification ver. 1.8 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM information: Java(TM) SE Runtime Environment 1.8.0_60-b27 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.60-b23 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM total memory: 14.0GB 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Remote Management [restart: off, REST: on, JMX (remote: off)] 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: IGNITE_HOME=null 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM arguments: [-XX:OnOutOfMemoryError=kill %p, -Xms15360m, -Xmx15360m, -Djava.io.tmpdir=/data/12/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/container_e76_1487862040010_131981_01_000007/tmp, -Dspark.driver.port=38995, -Dspark.ui.port=0, -Dspark.yarn.app.container.log.dir=/data/5/yarn/log/container/application_1487862040010_131981/container_e76_1487862040010_131981_01_000007] 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Configured caches ['ignite-marshaller-sys-cache', 'ignite-sys-cache', 'ignite-atomics-sys-cache'] 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: Configured plugins: 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: ^-- None 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: IPC shared memory server endpoint started [port=48100, tokDir=/data/12/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/container_e76_1487862040010_131981_01_000007/tmp/ignite/work/ipc/shmem/e9e49d2d-5eeb-474f-8757-e447efc8ca8f-21886] 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: Successfully bound shared memory communication to TCP port [port=48100, locHost=0.0.0.0/0.0.0.0] 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: Successfully bound to TCP port [port=47100, locHost=0.0.0.0/0.0.0.0] 17/03/01 04:12:38 WARN noop.NoopCheckpointSpi: Checkpoints are disabled (to enable configure any GridCheckpointSpi implementation) 17/03/01 04:12:38 WARN collision.GridCollisionManager: Collision resolution is disabled (all jobs will be activated upon arrival). 17/03/01 04:12:38 WARN noop.NoopSwapSpaceSpi: Swap space is disabled. To enable use FileSwapSpaceSpi. 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Security status [authentication=off, tls/ssl=off] 17/03/01 04:12:39 INFO tcp.GridTcpRestProtocol: Command protocol successfully started [name=TCP binary, host=0.0.0.0/0.0.0.0, port=11211] 17/03/01 04:12:39 INFO internal.IgniteKernal%WCA: Non-loopback local IPs: 6 17/03/01 04:12:39 INFO internal.IgniteKernal%WCA: Enabled local MACs: B083FECD69A4 17/03/01 04:12:39 INFO tcp.TcpDiscoverySpi: Successfully bound to TCP port [port=47500, localHost=0.0.0.0/0.0.0.0, locNodeId=e9e49d2d-5eeb-474f-8757-e447efc8ca8f] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4b90e5a3-253a-435b-84ca-6b592610cf0c, addrs=[4, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/4:47500], discPort=47500, order=35, intOrder=35, lastExchangeTime=1488363164087, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=35, servers=35, clients=0, CPUs=1432, heap=550.0GB] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=8fd4eea2-2a45-4563-ae87-1848fd388a98, addrs=[3, 127.0.0.1], sockAddrs=[hostName/3:47500, /127.0.0.1:47500], discPort=47500, order=36, intOrder=36, lastExchangeTime=1488363164087, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=36, servers=36, clients=0, CPUs=1472, heap=560.0GB] 17/03/01 04:12:44 INFO cache.GridCacheProcessor: Started cache [name=ignite-sys-cache, mode=REPLICATED] 17/03/01 04:12:44 INFO cache.GridCacheProcessor: Started cache [name=ignite-atomics-sys-cache, mode=PARTITIONED] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=d7b45a02-0411-4028-acdf-f004e592f294, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=37, intOrder=37, lastExchangeTime=1488363164127, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=37, servers=37, clients=0, CPUs=1512, heap=580.0GB] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=cf4e6e83-207e-42da-a55c-5621bc20b891, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=38, intOrder=38, lastExchangeTime=1488363164147, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=38, servers=38, clients=0, CPUs=1552, heap=590.0GB] 17/03/01 04:12:45 INFO cache.GridCacheProcessor: Started cache [name=WCAIgniteCache, mode=PARTITIONED] 17/03/01 04:12:45 INFO cache.GridCacheProcessor: Started cache [name=ignite-marshaller-sys-cache, mode=REPLICATED] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=d8926a2c-2c00-4445-beb4-633c2d656c41, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=39, intOrder=39, lastExchangeTime=1488363164157, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=39, servers=39, clients=0, CPUs=1584, heap=610.0GB] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4136a0c9-14d5-42b3-9a60-81689c800438, addrs=[3, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/3:47500], discPort=47500, order=40, intOrder=40, lastExchangeTime=1488363164157, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=40, servers=40, clients=0, CPUs=1624, heap=620.0GB] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=694a80b8-02a3-44c9-a2dd-45bed7d20a50, addrs=[1, 127.0.0.1], sockAddrs=[hostName/1:47500, /127.0.0.1:47500], discPort=47500, order=41, intOrder=41, lastExchangeTime=1488363164167, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=41, servers=41, clients=0, CPUs=1664, heap=640.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=34, minorTopVer=0], evt=NODE_JOINED, node=e9e49d2d-5eeb-474f-8757-e447efc8ca8f] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=35, minorTopVer=0], evt=NODE_JOINED, node=4b90e5a3-253a-435b-84ca-6b592610cf0c] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=36, minorTopVer=0], evt=NODE_JOINED, node=8fd4eea2-2a45-4563-ae87-1848fd388a98] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=37, minorTopVer=0], evt=NODE_JOINED, node=d7b45a02-0411-4028-acdf-f004e592f294] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=38, minorTopVer=0], evt=NODE_JOINED, node=cf4e6e83-207e-42da-a55c-5621bc20b891] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=39, minorTopVer=0], evt=NODE_JOINED, node=d8926a2c-2c00-4445-beb4-633c2d656c41] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=40, minorTopVer=0], evt=NODE_JOINED, node=4136a0c9-14d5-42b3-9a60-81689c800438] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-sys-cache, waitList=[]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-marshaller-sys-cache, waitList=[]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-atomics-sys-cache, waitList=[ignite-sys-cache, ignite-marshaller-sys-cache]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=WCAIgniteCache, waitList=[ignite-sys-cache, ignite-marshaller-sys-cache, ignite-atomics-sys-cache]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Rebalancing required [top=AffinityTopologyVersion [topVer=41, minorTopVer=0], evt=NODE_JOINED, node=694a80b8-02a3-44c9-a2dd-45bed7d20a50] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-marshaller-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=20, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=8] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=100, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=8] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-marshaller-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=20 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=20 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-atomics-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=23, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=8] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-atomics-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=0 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=WCAIgniteCache, mode=ASYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=23, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=8] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=WCAIgniteCache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=0 ms] 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: >>> +----------------------------------------------------------------------+ >>> Ignite ver. 1.8.0#20161205-sha1:9ca40dbeb7d559fcb299bdb6f5c90cdf8ce7e533 >>> +----------------------------------------------------------------------+ >>> OS name: Linux 2.6.32-431.5.1.el6.x86_64 amd64 >>> CPU(s): 40 >>> Heap: 15.0GB >>> VM name: 21886@hostName >>> Grid name: WCA >>> Local node [ID=E9E49D2D-5EEB-474F-8757-E447EFC8CA8F, order=34, clientMode=false] >>> Local node addresses: [hostName/6, /127.0.0.1] >>> Local ports: TCP:11211 TCP:47100 TCP:47500 TCP:48100 17/03/01 04:12:47 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=34, servers=34, clients=0, CPUs=1400, heap=530.0GB] 17/03/01 04:12:47 INFO resolver.CompanyResolverSparkTest: Started ignite node on executor 17/03/01 04:12:47 INFO executor.Executor: Finished task 12.0 in stage 4.0 (TID 134). 931 bytes result sent to driver 17/03/01 04:12:49 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 166 17/03/01 04:12:49 INFO executor.Executor: Running task 14.0 in stage 5.0 (TID 166) 17/03/01 04:12:49 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 128 17/03/01 04:12:49 INFO storage.MemoryStore: ensureFreeSpace(7311) called with curMem=12208, maxMem=8334920908 17/03/01 04:12:49 INFO storage.MemoryStore: Block broadcast_128_piece0 stored as bytes in memory (estimated size 7.1 KB, free 7.8 GB) 17/03/01 04:12:49 INFO broadcast.TorrentBroadcast: Reading broadcast variable 128 took 7 ms 17/03/01 04:12:49 INFO storage.MemoryStore: ensureFreeSpace(28168) called with curMem=19519, maxMem=8334920908 17/03/01 04:12:49 INFO storage.MemoryStore: Block broadcast_128 stored as values in memory (estimated size 27.5 KB, free 7.8 GB) 17/03/01 04:12:49 INFO rdd.HadoopRDD: Input split: avro path/part-r-00001-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:0+37465164 17/03/01 04:12:49 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 95 17/03/01 04:12:49 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=47687, maxMem=8334920908 17/03/01 04:12:49 INFO storage.MemoryStore: Block broadcast_95_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:12:49 INFO broadcast.TorrentBroadcast: Reading broadcast variable 95 took 6 ms 17/03/01 04:12:49 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=72330, maxMem=8334920908 17/03/01 04:12:49 INFO storage.MemoryStore: Block broadcast_95 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:12:49 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=41, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, node=6172ee3a-eb33-4bf5-9080-c255f52caed8] 17/03/01 04:12:56 INFO executor.Executor: Finished task 14.0 in stage 5.0 (TID 166). 2098 bytes result sent to driver 17/03/01 04:13:47 INFO internal.IgniteKernal%WCA: Metrics for local node (to disable set 'metricsLogFrequency' to 0) ^-- Node [id=e9e49d2d, name=WCA, uptime=00:01:00:004] ^-- H/N/C [hosts=41, nodes=41, CPUs=1664] ^-- CPU [cur=2.3%, avg=2.89%, GC=0%] ^-- Heap [used=4835MB, free=67.58%, comm=14912MB] ^-- Non heap [used=120MB, free=-1%, comm=122MB] ^-- Public thread pool [active=0, idle=0, qSize=0] ^-- System thread pool [active=0, idle=80, qSize=0] ^-- Outbound messages queue [size=0] 17/03/01 04:13:54 INFO cluster.GridUpdateNotifier: Update status is not available. 17/03/01 04:14:00 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 251 17/03/01 04:14:00 INFO executor.Executor: Running task 7.0 in stage 7.0 (TID 251) 17/03/01 04:14:00 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 131 17/03/01 04:14:00 INFO storage.MemoryStore: ensureFreeSpace(2732) called with curMem=407194, maxMem=8334920908 17/03/01 04:14:00 INFO storage.MemoryStore: Block broadcast_131_piece0 stored as bytes in memory (estimated size 2.7 KB, free 7.8 GB) 17/03/01 04:14:00 INFO broadcast.TorrentBroadcast: Reading broadcast variable 131 took 36 ms 17/03/01 04:14:00 INFO storage.MemoryStore: ensureFreeSpace(7336) called with curMem=409926, maxMem=8334920908 17/03/01 04:14:00 INFO storage.MemoryStore: Block broadcast_131 stored as values in memory (estimated size 7.2 KB, free 7.8 GB) 17/03/01 04:14:00 INFO dao.CompanyDAO: testing[ipaddress:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509] 17/03/01 04:14:00 INFO dao.CompanyDAO: input company name inside Contains searchGRIMMS CENTRAL MARKET 17/03/01 04:14:09 ERROR executor.Executor: Exception in task 7.0 in stage 7.0 (TID 251) javax.cache.CacheException: class org.apache.ignite.IgniteCheckedException: Query execution failed: GridCacheQueryBean [qry=GridCacheQueryAdapter [type=TEXT, clsName=CompanyVO1, clause=GRIMMS CENTRAL MARKET, filter=null, transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=true, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=e9e49d2d-5eeb-474f-8757-e447efc8ca8f, taskHash=0], rdc=null, trans=null] at org.apache.ignite.internal.processors.cache.GridCacheUtils.convertToCacheException(GridCacheUtils.java:1440) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.next(GridCacheQueryFutureAdapter.java:174) at org.apache.ignite.internal.processors.cache.IgniteCacheProxy$5.onHasNext(IgniteCacheProxy.java:600) at org.apache.ignite.internal.util.GridCloseableIteratorAdapter.hasNextX(GridCloseableIteratorAdapter.java:53) at org.apache.ignite.internal.util.lang.GridIteratorAdapter.hasNext(GridIteratorAdapter.java:45) at un.api.resolver.dao.CompanyDAO.getVarCompContains(CompanyDAO.scala:242) at un.api.resolver.accessor.CompanyAccessor.getVarCompContains(CompanyAccessor.scala:27) at un.api.resolver.CompanyResolverSparkTest$$anonfun$main$7.apply(CompanyResolverSparkTest.scala:291) at un.api.resolver.CompanyResolverSparkTest$$anonfun$main$7.apply(CompanyResolverSparkTest.scala:289) at scala.collection.Iterator$$anon$11.next(Iterator.scala:328) at org.apache.spark.util.Utils$.getIteratorSize(Utils.scala:1554) at org.apache.spark.rdd.RDD$$anonfun$count$1.apply(RDD.scala:1121) at org.apache.spark.rdd.RDD$$anonfun$count$1.apply(RDD.scala:1121) at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1850) at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1850) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:66) at org.apache.spark.scheduler.Task.run(Task.scala:88) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:214) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: class org.apache.ignite.IgniteCheckedException: Query execution failed: GridCacheQueryBean [qry=GridCacheQueryAdapter [type=TEXT, clsName=CompanyVO1, clause=GRIMMS CENTRAL MARKET, filter=null, transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=true, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=e9e49d2d-5eeb-474f-8757-e447efc8ca8f, taskHash=0], rdc=null, trans=null] at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.checkError(GridCacheQueryFutureAdapter.java:260) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.internalIterator(GridCacheQueryFutureAdapter.java:318) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.next(GridCacheQueryFutureAdapter.java:164) ... 19 more Caused by: class org.apache.ignite.IgniteCheckedException: Failed to execute query on node [query=GridCacheQueryBean [qry=GridCacheQueryAdapter [type=TEXT, clsName=CompanyVO1, clause=GRIMMS CENTRAL MARKET, filter=null, transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=true, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=e9e49d2d-5eeb-474f-8757-e447efc8ca8f, taskHash=0], rdc=null, trans=null], nodeId=20860cae-2881-4311-a3f5-edaa160ef37f] at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.onPage(GridCacheQueryFutureAdapter.java:383) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.processQueryResponse(GridCacheDistributedQueryManager.java:398) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.access$000(GridCacheDistributedQueryManager.java:63) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$1.apply(GridCacheDistributedQueryManager.java:93) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$1.apply(GridCacheDistributedQueryManager.java:91) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.processMessage(GridCacheIoManager.java:827) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.onMessage0(GridCacheIoManager.java:369) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.access$400(GridCacheIoManager.java:95) at org.apache.ignite.internal.processors.cache.GridCacheIoManager$OrderedMessageListener.onMessage(GridCacheIoManager.java:1345) at org.apache.ignite.internal.managers.communication.GridIoManager.invokeListener(GridIoManager.java:1082) at org.apache.ignite.internal.managers.communication.GridIoManager.access$1600(GridIoManager.java:102) at org.apache.ignite.internal.managers.communication.GridIoManager$GridCommunicationMessageSet.unwind(GridIoManager.java:2332) at org.apache.ignite.internal.managers.communication.GridIoManager.unwindMessageSet(GridIoManager.java:1042) at org.apache.ignite.internal.managers.communication.GridIoManager.access$1900(GridIoManager.java:102) at org.apache.ignite.internal.managers.communication.GridIoManager$6.run(GridIoManager.java:1011) ... 3 more Caused by: java.lang.NullPointerException at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneFile.numBuffers(GridLuceneFile.java:109) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneInputStream.switchCurrentBuffer(GridLuceneInputStream.java:132) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneInputStream.seek(GridLuceneInputStream.java:224) at org.apache.lucene.index.CompoundFileReader$CSIndexInput.readInternal(CompoundFileReader.java:273) at org.apache.lucene.store.BufferedIndexInput.refill(BufferedIndexInput.java:229) at org.apache.lucene.store.BufferedIndexInput.readByte(BufferedIndexInput.java:39) at org.apache.lucene.store.DataInput.readInt(DataInput.java:84) at org.apache.lucene.store.BufferedIndexInput.readInt(BufferedIndexInput.java:169) at org.apache.lucene.store.DataInput.readLong(DataInput.java:126) at org.apache.lucene.store.BufferedIndexInput.readLong(BufferedIndexInput.java:182) at org.apache.lucene.index.FieldsReader.doc(FieldsReader.java:231) at org.apache.lucene.index.SegmentReader.document(SegmentReader.java:477) at org.apache.lucene.index.DirectoryReader.document(DirectoryReader.java:583) at org.apache.lucene.index.IndexReader.document(IndexReader.java:1115) at org.apache.lucene.search.IndexSearcher.doc(IndexSearcher.java:258) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneIndex$It.findNext(GridLuceneIndex.java:383) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneIndex$It.onNext(GridLuceneIndex.java:415) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneIndex$It.onNext(GridLuceneIndex.java:299) at org.apache.ignite.internal.util.GridCloseableIteratorAdapter.nextX(GridCloseableIteratorAdapter.java:41) at org.apache.ignite.internal.util.lang.GridIteratorAdapter.next(GridIteratorAdapter.java:35) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryManager.runQuery(GridCacheQueryManager.java:1512) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.processQueryRequest(GridCacheDistributedQueryManager.java:230) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$2.apply(GridCacheDistributedQueryManager.java:108) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$2.apply(GridCacheDistributedQueryManager.java:106) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.processMessage(GridCacheIoManager.java:827) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.onMessage0(GridCacheIoManager.java:369) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.handleMessage(GridCacheIoManager.java:293) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.access$000(GridCacheIoManager.java:95) at org.apache.ignite.internal.processors.cache.GridCacheIoManager$1.onMessage(GridCacheIoManager.java:238) at org.apache.ignite.internal.managers.communication.GridIoManager.invokeListener(GridIoManager.java:1082) at org.apache.ignite.internal.managers.communication.GridIoManager.processRegularMessage0(GridIoManager.java:710) at org.apache.ignite.internal.managers.communication.GridIoManager.access$1700(GridIoManager.java:102) at org.apache.ignite.internal.managers.communication.GridIoManager$5.run(GridIoManager.java:673) ... 3 more 17/03/01 04:14:09 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 284 17/03/01 04:14:09 INFO executor.Executor: Running task 7.1 in stage 7.0 (TID 284) 17/03/01 04:14:09 INFO dao.CompanyDAO: testing[ipaddress:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509] 17/03/01 04:14:09 INFO dao.CompanyDAO: input company name inside Contains searchGRIMMS CENTRAL MARKET 17/03/01 04:14:25 INFO dao.CompanyDAO: look up time contains-5489 17/03/01 04:14:25 INFO executor.Executor: Finished task 7.1 in stage 7.0 (TID 284). 969 bytes result sent to driver 17/03/01 04:14:47 INFO internal.IgniteKernal%WCA: Metrics for local node (to disable set 'metricsLogFrequency' to 0) ^-- Node [id=e9e49d2d, name=WCA, uptime=00:02:00:034] ^-- H/N/C [hosts=41, nodes=41, CPUs=1664] ^-- CPU [cur=0.3%, avg=3.26%, GC=0%] ^-- Heap [used=3426MB, free=76.45%, comm=14550MB] ^-- Non heap [used=124MB, free=-1%, comm=127MB] ^-- Public thread pool [active=0, idle=0, qSize=0] ^-- System thread pool [active=0, idle=80, qSize=0] ^-- Outbound messages queue [size=0] 17/03/01 04:14:49 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 322 17/03/01 04:14:49 INFO executor.Executor: Running task 9.0 in stage 8.0 (TID 322) 17/03/01 04:14:49 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 132 17/03/01 04:14:49 INFO storage.MemoryStore: ensureFreeSpace(887) called with curMem=417262, maxMem=8334920908 17/03/01 04:14:49 INFO storage.MemoryStore: Block broadcast_132_piece0 stored as bytes in memory (estimated size 887.0 B, free 7.8 GB) 17/03/01 04:14:49 INFO broadcast.TorrentBroadcast: Reading broadcast variable 132 took 16 ms 17/03/01 04:14:49 INFO storage.MemoryStore: ensureFreeSpace(1216) called with curMem=418149, maxMem=8334920908 17/03/01 04:14:49 INFO storage.MemoryStore: Block broadcast_132 stored as values in memory (estimated size 1216.0 B, free 7.8 GB) 17/03/01 04:14:49 INFO tcp.GridTcpRestProtocol: Command protocol successfully stopped: TCP binary 17/03/01 04:14:50 INFO cache.GridCacheProcessor: Stopped cache: ignite-marshaller-sys-cache 17/03/01 04:14:50 INFO cache.GridCacheProcessor: Stopped cache: ignite-sys-cache 17/03/01 04:14:50 INFO cache.GridCacheProcessor: Stopped cache: ignite-atomics-sys-cache 17/03/01 04:14:50 INFO cache.GridCacheProcessor: Stopped cache: WCAIgniteCache 17/03/01 04:14:50 INFO internal.IgniteKernal%WCA: >>> +---------------------------------------------------------------------------------+ >>> Ignite ver. 1.8.0#20161205-sha1:9ca40dbeb7d559fcb299bdb6f5c90cdf8ce7e533 stopped OK >>> +---------------------------------------------------------------------------------+ >>> Grid name: WCA >>> Grid uptime: 00:02:02:807 17/03/01 04:14:50 INFO executor.Executor: Finished task 9.0 in stage 8.0 (TID 322). 931 bytes result sent to driver 17/03/01 04:14:53 INFO executor.CoarseGrainedExecutorBackend: Driver commanded a shutdown 17/03/01 04:14:53 INFO storage.MemoryStore: MemoryStore cleared 17/03/01 04:14:53 INFO storage.BlockManager: BlockManager stopped 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Shutting down remote daemon. 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remote daemon shut down; proceeding with flushing remote transports. 17/03/01 04:14:53 INFO Remoting: Remoting shut down 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remoting shut down. 17/03/01 04:14:53 INFO util.ShutdownHookManager: Shutdown hook called LogType:stdout Log Upload Time:Wed Mar 01 04:14:58 -0600 2017 LogLength:1749 Log Contents: rEnd of the programe - [04:12:38] __________ ________________ [04:12:38] / _/ ___/ |/ / _/_ __/ __/ [04:12:38] _/ // (7 7 // / / / / _/ [04:12:38] /___/\___/_/|_/___/ /_/ /___/ [04:12:38] [04:12:38] ver. 1.8.0#20161205-sha1:9ca40dbe [04:12:38] 2016 Copyright(C) Apache Software Foundation [04:12:38] [04:12:38] Ignite documentation: http://ignite.apache.org [04:12:38] [04:12:38] Quiet mode. [04:12:38] ^-- To see **FULL** console log here add -DIGNITE_QUIET=false or "-v" to ignite.{sh|bat} [04:12:38] [04:12:38] OS: Linux 2.6.32-431.5.1.el6.x86_64 amd64 [04:12:38] VM information: Java(TM) SE Runtime Environment 1.8.0_60-b27 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.60-b23 [04:12:38] Configured plugins: [04:12:38] ^-- None [04:12:38] [04:12:38] Security status [authentication=off, tls/ssl=off] [04:12:44] Topology snapshot [ver=35, servers=35, clients=0, CPUs=1432, heap=550.0GB] [04:12:44] Topology snapshot [ver=36, servers=36, clients=0, CPUs=1472, heap=560.0GB] [04:12:44] Topology snapshot [ver=37, servers=37, clients=0, CPUs=1512, heap=580.0GB] [04:12:44] Topology snapshot [ver=38, servers=38, clients=0, CPUs=1552, heap=590.0GB] [04:12:45] Topology snapshot [ver=39, servers=39, clients=0, CPUs=1584, heap=610.0GB] [04:12:45] Topology snapshot [ver=40, servers=40, clients=0, CPUs=1624, heap=620.0GB] [04:12:45] Topology snapshot [ver=41, servers=41, clients=0, CPUs=1664, heap=640.0GB] [04:12:47] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [04:12:47] [04:12:47] Ignite node started OK (id=e9e49d2d, grid=WCA) [04:12:47] Topology snapshot [ver=34, servers=34, clients=0, CPUs=1400, heap=530.0GB] [04:14:50] Ignite node stopped OK [name=WCA, uptime=00:02:02:807] Container: container_e76_1487862040010_131981_01_000018 on hostName_8041 =========================================================================================== LogType:stderr Log Upload Time:Wed Mar 01 04:14:58 -0600 2017 LogLength:123877 Log Contents: 17/03/01 04:10:58 INFO executor.CoarseGrainedExecutorBackend: Registered signal handlers for [TERM, HUP, INT] 17/03/01 04:10:59 INFO spark.SecurityManager: Changing view acls to: userName 17/03/01 04:10:59 INFO spark.SecurityManager: Changing modify acls to: userName 17/03/01 04:10:59 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(userName); users with modify permissions: Set(userName) 17/03/01 04:10:59 INFO slf4j.Slf4jLogger: Slf4jLogger started 17/03/01 04:10:59 INFO Remoting: Starting remoting 17/03/01 04:11:00 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://driverPropsFetcher@hostName:35694] 17/03/01 04:11:00 INFO Remoting: Remoting now listens on addresses: [akka.tcp://driverPropsFetcher@hostName:35694] 17/03/01 04:11:00 INFO util.Utils: Successfully started service 'driverPropsFetcher' on port 35694. 17/03/01 04:11:00 INFO spark.SecurityManager: Changing view acls to: userName 17/03/01 04:11:00 INFO spark.SecurityManager: Changing modify acls to: userName 17/03/01 04:11:00 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(userName); users with modify permissions: Set(userName) 17/03/01 04:11:00 INFO remote.RemoteActorRefProvider$RemotingTerminator: Shutting down remote daemon. 17/03/01 04:11:00 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remote daemon shut down; proceeding with flushing remote transports. 17/03/01 04:11:00 INFO slf4j.Slf4jLogger: Slf4jLogger started 17/03/01 04:11:00 INFO Remoting: Starting remoting 17/03/01 04:11:00 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://sparkExecutor@hostName:48531] 17/03/01 04:11:00 INFO Remoting: Remoting now listens on addresses: [akka.tcp://sparkExecutor@hostName:48531] 17/03/01 04:11:00 INFO util.Utils: Successfully started service 'sparkExecutor' on port 48531. 17/03/01 04:11:00 INFO Remoting: Remoting shut down 17/03/01 04:11:00 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remoting shut down. 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/1/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-4552ff47-8b4b-473b-abbd-e316f3cfc0ad 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/2/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-86e2740e-0869-412b-8747-acdc1d2bbca7 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/3/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-714acbb6-b497-4973-8076-3da53de2da48 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/4/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-fcf2f619-1bd2-4b10-9235-95763d5b4e4e 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/5/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-e88ad85c-0bdc-4cad-a7b1-d679d2c4784a 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/6/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-493f0521-802b-4552-a663-a780d56c4904 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/7/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-c4da6a0f-e03c-454b-b82b-b750f71bc590 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/8/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-319ac4c1-58f7-4b0c-b72b-0242f9a57255 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/9/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-bc62e026-22c8-4086-b218-9f8e8c212c16 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/10/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-3bb24d2b-524a-4680-8f50-9d17aac997a9 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/11/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-bf655910-1924-4d8b-87c4-77790a24a1be 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/12/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-e6ec06f3-2674-4127-8328-1f973b11850e 17/03/01 04:11:00 INFO storage.MemoryStore: MemoryStore started with capacity 7.8 GB 17/03/01 04:11:00 INFO executor.CoarseGrainedExecutorBackend: Connecting to driver: akka.tcp://sparkDriver@ipaddress:38995/user/CoarseGrainedScheduler 17/03/01 04:11:00 INFO executor.CoarseGrainedExecutorBackend: Successfully registered with driver 17/03/01 04:11:00 INFO executor.Executor: Starting executor ID 15 on host hostName 17/03/01 04:11:00 INFO util.Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 38204. 17/03/01 04:11:00 INFO netty.NettyBlockTransferService: Server created on 38204 17/03/01 04:11:00 INFO storage.BlockManagerMaster: Trying to register BlockManager 17/03/01 04:11:00 INFO storage.BlockManagerMaster: Registered BlockManager 17/03/01 04:11:02 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 35 17/03/01 04:11:02 INFO executor.Executor: Running task 35.0 in stage 0.0 (TID 35) 17/03/01 04:11:02 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 0 17/03/01 04:11:02 INFO storage.MemoryStore: ensureFreeSpace(1310) called with curMem=0, maxMem=8334920908 17/03/01 04:11:02 INFO storage.MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 1310.0 B, free 7.8 GB) 17/03/01 04:11:02 INFO broadcast.TorrentBroadcast: Reading broadcast variable 0 took 231 ms 17/03/01 04:11:02 INFO storage.MemoryStore: ensureFreeSpace(2064) called with curMem=1310, maxMem=8334920908 17/03/01 04:11:02 INFO storage.MemoryStore: Block broadcast_0 stored as values in memory (estimated size 2.0 KB, free 7.8 GB) 17/03/01 04:11:02 INFO resolver.CompanyResolverSparkTest: Ranjit exec test 17/03/01 04:11:02 INFO executor.Executor: Finished task 35.0 in stage 0.0 (TID 35). 972 bytes result sent to driver 17/03/01 04:12:03 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 51 17/03/01 04:12:03 INFO executor.Executor: Running task 48.0 in stage 2.0 (TID 51) 17/03/01 04:12:03 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 84 17/03/01 04:12:03 INFO storage.MemoryStore: ensureFreeSpace(9240) called with curMem=3374, maxMem=8334920908 17/03/01 04:12:03 INFO storage.MemoryStore: Block broadcast_84_piece0 stored as bytes in memory (estimated size 9.0 KB, free 7.8 GB) 17/03/01 04:12:03 INFO broadcast.TorrentBroadcast: Reading broadcast variable 84 took 9 ms 17/03/01 04:12:03 INFO storage.MemoryStore: ensureFreeSpace(32704) called with curMem=12614, maxMem=8334920908 17/03/01 04:12:03 INFO storage.MemoryStore: Block broadcast_84 stored as values in memory (estimated size 31.9 KB, free 7.8 GB) 17/03/01 04:12:03 INFO codegen.GenerateMutableProjection: Code generated in 94.74782 ms 17/03/01 04:12:04 INFO codegen.GenerateUnsafeProjection: Code generated in 8.60035 ms 17/03/01 04:12:04 INFO codegen.GenerateMutableProjection: Code generated in 11.633535 ms 17/03/01 04:12:04 INFO codegen.GenerateUnsafeRowJoiner: Code generated in 6.539234 ms 17/03/01 04:12:04 INFO codegen.GenerateUnsafeProjection: Code generated in 7.104633 ms 17/03/01 04:12:04 INFO rdd.HadoopRDD: Input split: avro path/part-r-00036-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:0+117914948 17/03/01 04:12:04 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 68 17/03/01 04:12:04 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=45318, maxMem=8334920908 17/03/01 04:12:04 INFO storage.MemoryStore: Block broadcast_68_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:12:04 INFO broadcast.TorrentBroadcast: Reading broadcast variable 68 took 8 ms 17/03/01 04:12:04 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=69961, maxMem=8334920908 17/03/01 04:12:04 INFO storage.MemoryStore: Block broadcast_68 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:12:04 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 17/03/01 04:12:04 INFO Configuration.deprecation: mapred.tip.id is deprecated. Instead, use mapreduce.task.id 17/03/01 04:12:04 INFO Configuration.deprecation: mapred.task.id is deprecated. Instead, use mapreduce.task.attempt.id 17/03/01 04:12:04 INFO Configuration.deprecation: mapred.task.is.map is deprecated. Instead, use mapreduce.task.ismap 17/03/01 04:12:04 INFO Configuration.deprecation: mapred.task.partition is deprecated. Instead, use mapreduce.task.partition 17/03/01 04:12:04 INFO Configuration.deprecation: mapred.job.id is deprecated. Instead, use mapreduce.job.id 17/03/01 04:12:04 WARN security.UserGroupInformation: PriviledgedActionException as:userName (auth:SIMPLE) cause:org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:12:04 WARN ipc.Client: Exception encountered while connecting to the server : org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:12:04 WARN security.UserGroupInformation: PriviledgedActionException as:userName (auth:SIMPLE) cause:org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:12:09 INFO executor.Executor: Finished task 48.0 in stage 2.0 (TID 51). 2495 bytes result sent to driver 17/03/01 04:12:16 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 86 17/03/01 04:12:16 INFO executor.Executor: Running task 66.0 in stage 2.0 (TID 86) 17/03/01 04:12:16 INFO rdd.HadoopRDD: Input split: avro path/part-r-00019-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:0+69615127 17/03/01 04:12:16 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 77 17/03/01 04:12:16 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=417033, maxMem=8334920908 17/03/01 04:12:16 INFO storage.MemoryStore: Block broadcast_77_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:12:16 INFO broadcast.TorrentBroadcast: Reading broadcast variable 77 took 8 ms 17/03/01 04:12:16 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=441676, maxMem=8334920908 17/03/01 04:12:16 INFO storage.MemoryStore: Block broadcast_77 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:12:19 INFO executor.Executor: Finished task 66.0 in stage 2.0 (TID 86). 2495 bytes result sent to driver 17/03/01 04:12:19 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 90 17/03/01 04:12:19 INFO executor.Executor: Running task 67.0 in stage 2.0 (TID 90) 17/03/01 04:12:19 INFO rdd.HadoopRDD: Input split: avro path/part-r-00019-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:69615127+69615128 17/03/01 04:12:21 INFO executor.Executor: Finished task 67.0 in stage 2.0 (TID 90). 2495 bytes result sent to driver 17/03/01 04:12:21 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 101 17/03/01 04:12:21 INFO executor.Executor: Running task 76.0 in stage 2.0 (TID 101) 17/03/01 04:12:21 INFO rdd.HadoopRDD: Input split: avro path/part-r-00035-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:0+32162696 17/03/01 04:12:21 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 82 17/03/01 04:12:21 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=788748, maxMem=8334920908 17/03/01 04:12:21 INFO storage.MemoryStore: Block broadcast_82_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:12:21 INFO broadcast.TorrentBroadcast: Reading broadcast variable 82 took 8 ms 17/03/01 04:12:21 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=813391, maxMem=8334920908 17/03/01 04:12:21 INFO storage.MemoryStore: Block broadcast_82 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:12:23 INFO executor.Executor: Finished task 76.0 in stage 2.0 (TID 101). 2495 bytes result sent to driver 17/03/01 04:12:23 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 105 17/03/01 04:12:23 INFO executor.Executor: Running task 77.0 in stage 2.0 (TID 105) 17/03/01 04:12:23 INFO rdd.HadoopRDD: Input split: avro path/part-r-00035-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:32162696+32162697 17/03/01 04:12:24 INFO executor.Executor: Finished task 77.0 in stage 2.0 (TID 105). 2495 bytes result sent to driver 17/03/01 04:12:38 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 126 17/03/01 04:12:38 INFO executor.Executor: Running task 4.0 in stage 4.0 (TID 126) 17/03/01 04:12:38 INFO spark.MapOutputTrackerWorker: Updating epoch to 1 and clearing cache 17/03/01 04:12:38 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 86 17/03/01 04:12:38 INFO storage.MemoryStore: ensureFreeSpace(2290) called with curMem=1160463, maxMem=8334920908 17/03/01 04:12:38 INFO storage.MemoryStore: Block broadcast_86_piece0 stored as bytes in memory (estimated size 2.2 KB, free 7.8 GB) 17/03/01 04:12:38 INFO broadcast.TorrentBroadcast: Reading broadcast variable 86 took 8 ms 17/03/01 04:12:38 INFO storage.MemoryStore: ensureFreeSpace(6544) called with curMem=1162753, maxMem=8334920908 17/03/01 04:12:38 INFO storage.MemoryStore: Block broadcast_86 stored as values in memory (estimated size 6.4 KB, free 7.8 GB) 17/03/01 04:12:38 INFO resolver.CompanyResolverSparkTest: testing worker[ipaddress:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509] 17/03/01 04:12:38 ERROR : Failed to resolve default logging config file: config/java.util.logging.properties Console logging handler is not configured. 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: >>> __________ ________________ >>> / _/ ___/ |/ / _/_ __/ __/ >>> _/ // (7 7 // / / / / _/ >>> /___/\___/_/|_/___/ /_/ /___/ >>> >>> ver. 1.8.0#20161205-sha1:9ca40dbe >>> 2016 Copyright(C) Apache Software Foundation >>> >>> Ignite documentation: http://ignite.apache.org 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Config URL: n/a 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Daemon mode: off 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: OS: Linux 2.6.32-431.5.1.el6.x86_64 amd64 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: OS user: userName 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: PID: 29925 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Language runtime: Java Platform API Specification ver. 1.8 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM information: Java(TM) SE Runtime Environment 1.8.0_60-b27 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.60-b23 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM total memory: 14.0GB 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Remote Management [restart: off, REST: on, JMX (remote: off)] 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: IGNITE_HOME=null 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM arguments: [-XX:OnOutOfMemoryError=kill %p, -Xms15360m, -Xmx15360m, -Djava.io.tmpdir=/data/7/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/container_e76_1487862040010_131981_01_000018/tmp, -Dspark.driver.port=38995, -Dspark.ui.port=0, -Dspark.yarn.app.container.log.dir=/data/1/yarn/log/container/application_1487862040010_131981/container_e76_1487862040010_131981_01_000018] 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Configured caches ['ignite-marshaller-sys-cache', 'ignite-sys-cache', 'ignite-atomics-sys-cache'] 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: Configured plugins: 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: ^-- None 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: IPC shared memory server endpoint started [port=48100, tokDir=/data/7/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/container_e76_1487862040010_131981_01_000018/tmp/ignite/work/ipc/shmem/90db2cab-26f6-463d-9755-d03d059a8723-29925] 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: Successfully bound shared memory communication to TCP port [port=48100, locHost=0.0.0.0/0.0.0.0] 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: Successfully bound to TCP port [port=47100, locHost=0.0.0.0/0.0.0.0] 17/03/01 04:12:38 WARN noop.NoopCheckpointSpi: Checkpoints are disabled (to enable configure any GridCheckpointSpi implementation) 17/03/01 04:12:38 WARN collision.GridCollisionManager: Collision resolution is disabled (all jobs will be activated upon arrival). 17/03/01 04:12:38 WARN noop.NoopSwapSpaceSpi: Swap space is disabled. To enable use FileSwapSpaceSpi. 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Security status [authentication=off, tls/ssl=off] 17/03/01 04:12:39 INFO tcp.GridTcpRestProtocol: Command protocol successfully started [name=TCP binary, host=0.0.0.0/0.0.0.0, port=11211] 17/03/01 04:12:39 INFO internal.IgniteKernal%WCA: Non-loopback local IPs: 69 17/03/01 04:12:39 INFO internal.IgniteKernal%WCA: Enabled local MACs: 246E96024E70 17/03/01 04:12:39 INFO tcp.TcpDiscoverySpi: Successfully bound to TCP port [port=47500, localHost=0.0.0.0/0.0.0.0, locNodeId=90db2cab-26f6-463d-9755-d03d059a8723] 17/03/01 04:12:39 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=3e101db5-8c5c-47b7-bbdb-a9a892c4bada, addrs=[08, 127.0.0.1], sockAddrs=[hostName/08:47500, /127.0.0.1:47500], discPort=47500, order=3, intOrder=3, lastExchangeTime=1488363159637, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:39 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=3, servers=3, clients=0, CPUs=144, heap=66.0GB] 17/03/01 04:12:39 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=40d089f0-7c80-4f1f-8659-350791f57a4c, addrs=[37, 127.0.0.1], sockAddrs=[hostName/37:47500, /127.0.0.1:47500], discPort=47500, order=4, intOrder=4, lastExchangeTime=1488363159749, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:39 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=4, servers=4, clients=0, CPUs=192, heap=81.0GB] 17/03/01 04:12:39 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=90532831-88fb-4eb8-adc9-db7a86744869, addrs=[0, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/0:47500], discPort=47500, order=5, intOrder=5, lastExchangeTime=1488363159749, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:39 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=5, servers=5, clients=0, CPUs=232, heap=96.0GB] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=d4a9fe7f-de19-4df7-874c-a084da78562f, addrs=[4, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/4:47500], discPort=47500, order=6, intOrder=6, lastExchangeTime=1488363159759, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=6, servers=6, clients=0, CPUs=272, heap=110.0GB] 17/03/01 04:12:40 INFO cache.GridCacheProcessor: Started cache [name=ignite-sys-cache, mode=REPLICATED] 17/03/01 04:12:40 INFO cache.GridCacheProcessor: Started cache [name=ignite-atomics-sys-cache, mode=PARTITIONED] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=5bc51e21-1dcf-498a-b87e-6dd24f7e36ad, addrs=[8, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/8:47500], discPort=47500, order=7, intOrder=7, lastExchangeTime=1488363159900, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=7, servers=7, clients=0, CPUs=312, heap=130.0GB] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=daed0152-83fc-4828-ada6-64c74787b190, addrs=[, 127.0.0.1], sockAddrs=[hostName/:47500, /127.0.0.1:47500], discPort=47500, order=8, intOrder=8, lastExchangeTime=1488363159910, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=8, servers=8, clients=0, CPUs=352, heap=140.0GB] 17/03/01 04:12:40 INFO cache.GridCacheProcessor: Started cache [name=WCAIgniteCache, mode=PARTITIONED] 17/03/01 04:12:40 INFO cache.GridCacheProcessor: Started cache [name=ignite-marshaller-sys-cache, mode=REPLICATED] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=29716cf1-ed55-4550-82bd-cf980a0aee2c, addrs=[, 127.0.0.1], sockAddrs=[hostName/:47501, /127.0.0.1:47501], discPort=47501, order=9, intOrder=9, lastExchangeTime=1488363159940, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=9, servers=9, clients=0, CPUs=392, heap=160.0GB] 17/03/01 04:12:40 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=0], evt=NODE_JOINED, node=90db2cab-26f6-463d-9755-d03d059a8723] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=717de453-fc6b-4a46-91b2-b5c54ab8a4be, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=10, intOrder=10, lastExchangeTime=1488363159961, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=10, servers=10, clients=0, CPUs=432, heap=170.0GB] 17/03/01 04:12:40 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_JOINED, node=3e101db5-8c5c-47b7-bbdb-a9a892c4bada] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=ffe19475-7849-4027-8648-ce56598ff50f, addrs=[7, 127.0.0.1], sockAddrs=[/127.0.0.1:47501, hostName/7:47501], discPort=47501, order=11, intOrder=11, lastExchangeTime=1488363159961, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=11, servers=11, clients=0, CPUs=472, heap=190.0GB] 17/03/01 04:12:40 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_JOINED, node=40d089f0-7c80-4f1f-8659-350791f57a4c] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=8be1bd05-d62c-4f1a-83f2-91dcb3f3b62a, addrs=[07, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/07:47500], discPort=47500, order=12, intOrder=12, lastExchangeTime=1488363159961, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=12, servers=12, clients=0, CPUs=504, heap=200.0GB] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=133c388f-3399-4cc8-b2f1-7ae8ba971b03, addrs=[7, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/7:47500], discPort=47500, order=13, intOrder=13, lastExchangeTime=1488363160011, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=13, servers=13, clients=0, CPUs=544, heap=220.0GB] 17/03/01 04:12:40 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=5, minorTopVer=0], evt=NODE_JOINED, node=90532831-88fb-4eb8-adc9-db7a86744869] 17/03/01 04:12:40 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=6, minorTopVer=0], evt=NODE_JOINED, node=d4a9fe7f-de19-4df7-874c-a084da78562f] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=23f61699-e2c9-4ff6-8731-2483934e84c4, addrs=[0, 127.0.0.1], sockAddrs=[hostName/0:47500, /127.0.0.1:47500], discPort=47500, order=14, intOrder=14, lastExchangeTime=1488363160011, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=14, servers=14, clients=0, CPUs=584, heap=230.0GB] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=95f164b5-4b73-438f-804f-62854d615b5b, addrs=[9, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/9:47500], discPort=47500, order=15, intOrder=15, lastExchangeTime=1488363160011, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=15, servers=15, clients=0, CPUs=624, heap=250.0GB] 17/03/01 04:12:41 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=7, minorTopVer=0], evt=NODE_JOINED, node=5bc51e21-1dcf-498a-b87e-6dd24f7e36ad] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=c4f4f6bb-b71a-4a29-9575-afee2ddc1b2d, addrs=[6, 127.0.0.1], sockAddrs=[hostName/6:47500, /127.0.0.1:47500], discPort=47500, order=16, intOrder=16, lastExchangeTime=1488363160021, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=16, servers=16, clients=0, CPUs=664, heap=260.0GB] 17/03/01 04:12:41 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=8, minorTopVer=0], evt=NODE_JOINED, node=daed0152-83fc-4828-ada6-64c74787b190] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=ddc47224-d030-4d1f-ba66-08f61368a395, addrs=[4, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/4:47500], discPort=47500, order=17, intOrder=17, lastExchangeTime=1488363160021, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=17, servers=17, clients=0, CPUs=704, heap=280.0GB] 17/03/01 04:12:41 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=9, minorTopVer=0], evt=NODE_JOINED, node=29716cf1-ed55-4550-82bd-cf980a0aee2c] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=47c1a0d8-9d4d-4d0d-9b27-388bd7f49278, addrs=[1, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/1:47500], discPort=47500, order=18, intOrder=18, lastExchangeTime=1488363160021, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=18, servers=18, clients=0, CPUs=744, heap=290.0GB] 17/03/01 04:12:41 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=10, minorTopVer=0], evt=NODE_JOINED, node=717de453-fc6b-4a46-91b2-b5c54ab8a4be] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=e87f12ce-5981-4418-8468-f6bfed0a0cd8, addrs=[6, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/6:47500], discPort=47500, order=19, intOrder=19, lastExchangeTime=1488363160031, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=19, servers=19, clients=0, CPUs=784, heap=310.0GB] 17/03/01 04:12:41 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=11, minorTopVer=0], evt=NODE_JOINED, node=ffe19475-7849-4027-8648-ce56598ff50f] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=e2cba212-89dd-48dd-8d7e-821b5725fe03, addrs=[8, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/8:47500], discPort=47500, order=20, intOrder=20, lastExchangeTime=1488363160122, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=20, servers=20, clients=0, CPUs=816, heap=320.0GB] 17/03/01 04:12:41 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=12, minorTopVer=0], evt=NODE_JOINED, node=8be1bd05-d62c-4f1a-83f2-91dcb3f3b62a] 17/03/01 04:12:41 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=13, minorTopVer=0], evt=NODE_JOINED, node=133c388f-3399-4cc8-b2f1-7ae8ba971b03] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=f9ce8dd7-2060-4c34-b597-d7bee86ebedb, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=21, intOrder=21, lastExchangeTime=1488363160152, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=21, servers=21, clients=0, CPUs=856, heap=340.0GB] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=14, minorTopVer=0], evt=NODE_JOINED, node=23f61699-e2c9-4ff6-8731-2483934e84c4] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=6b1889dd-9de5-4f1b-8ec9-c123c7df8ea2, addrs=[, 127.0.0.1], sockAddrs=[hostName/:47500, /127.0.0.1:47500], discPort=47500, order=22, intOrder=22, lastExchangeTime=1488363160213, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=22, servers=22, clients=0, CPUs=896, heap=350.0GB] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=15, minorTopVer=0], evt=NODE_JOINED, node=95f164b5-4b73-438f-804f-62854d615b5b] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=9fb6e583-cea0-4f78-b403-b403a8bc9a0e, addrs=[7, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/7:47500], discPort=47500, order=23, intOrder=23, lastExchangeTime=1488363160223, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=23, servers=23, clients=0, CPUs=936, heap=370.0GB] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=20860cae-2881-4311-a3f5-edaa160ef37f, addrs=[7, 127.0.0.1], sockAddrs=[hostName/7:47500, /127.0.0.1:47500], discPort=47500, order=24, intOrder=24, lastExchangeTime=1488363160223, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=24, servers=24, clients=0, CPUs=976, heap=380.0GB] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=16, minorTopVer=0], evt=NODE_JOINED, node=c4f4f6bb-b71a-4a29-9575-afee2ddc1b2d] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=0d675d57-b9b9-4cff-a994-77337d618bbe, addrs=[4, 127.0.0.1], sockAddrs=[hostName/4:47500, /127.0.0.1:47500], discPort=47500, order=25, intOrder=25, lastExchangeTime=1488363160223, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=25, servers=25, clients=0, CPUs=1016, heap=400.0GB] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=17, minorTopVer=0], evt=NODE_JOINED, node=ddc47224-d030-4d1f-ba66-08f61368a395] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=a6343860-6e84-4d9c-9b87-84ffd76280cd, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=26, intOrder=26, lastExchangeTime=1488363160233, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=26, servers=26, clients=0, CPUs=1056, heap=410.0GB] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=18, minorTopVer=0], evt=NODE_JOINED, node=47c1a0d8-9d4d-4d0d-9b27-388bd7f49278] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=19, minorTopVer=0], evt=NODE_JOINED, node=e87f12ce-5981-4418-8468-f6bfed0a0cd8] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=479b18e6-54af-4313-85f7-c7525f6229a4, addrs=[, 127.0.0.1], sockAddrs=[hostName/:47500, /127.0.0.1:47500], discPort=47500, order=27, intOrder=27, lastExchangeTime=1488363160333, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=27, servers=27, clients=0, CPUs=1104, heap=430.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=20, minorTopVer=0], evt=NODE_JOINED, node=e2cba212-89dd-48dd-8d7e-821b5725fe03] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=058a99e8-3b65-4ec9-84b0-6f3502c2afce, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=28, intOrder=28, lastExchangeTime=1488363160615, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=28, servers=28, clients=0, CPUs=1144, heap=440.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=21, minorTopVer=0], evt=NODE_JOINED, node=f9ce8dd7-2060-4c34-b597-d7bee86ebedb] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=57c09d88-a4dc-4179-98b4-1144fd97d8cc, addrs=[35, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/35:47500], discPort=47500, order=29, intOrder=29, lastExchangeTime=1488363160656, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=29, servers=29, clients=0, CPUs=1192, heap=460.0GB] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=58298821-7aa9-4b58-ba15-e7f1ef2830fb, addrs=[3, 127.0.0.1], sockAddrs=[hostName/3:47500, /127.0.0.1:47500], discPort=47500, order=30, intOrder=30, lastExchangeTime=1488363160666, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=30, servers=30, clients=0, CPUs=1232, heap=470.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=22, minorTopVer=0], evt=NODE_JOINED, node=6b1889dd-9de5-4f1b-8ec9-c123c7df8ea2] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4d5de2f3-d975-4b28-b593-0cc0481cdc74, addrs=[03, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/03:47500], discPort=47500, order=31, intOrder=31, lastExchangeTime=1488363160777, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=31, servers=31, clients=0, CPUs=1280, heap=490.0GB] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=fa09caab-f4dc-43b6-ac8b-4a4bae6e7da6, addrs=[01, 127.0.0.1], sockAddrs=[hostName/01:47500, /127.0.0.1:47500], discPort=47500, order=32, intOrder=32, lastExchangeTime=1488363161432, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=32, servers=32, clients=0, CPUs=1320, heap=500.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=23, minorTopVer=0], evt=NODE_JOINED, node=9fb6e583-cea0-4f78-b403-b403a8bc9a0e] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=24, minorTopVer=0], evt=NODE_JOINED, node=20860cae-2881-4311-a3f5-edaa160ef37f] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=af5837f0-25ec-4f3d-a1c1-90c09dc424cb, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=33, intOrder=33, lastExchangeTime=1488363161573, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=33, servers=33, clients=0, CPUs=1360, heap=520.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=25, minorTopVer=0], evt=NODE_JOINED, node=0d675d57-b9b9-4cff-a994-77337d618bbe] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=e9e49d2d-5eeb-474f-8757-e447efc8ca8f, addrs=[6, 127.0.0.1], sockAddrs=[hostName/6:47500, /127.0.0.1:47500], discPort=47500, order=34, intOrder=34, lastExchangeTime=1488363161573, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=34, servers=34, clients=0, CPUs=1400, heap=530.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=26, minorTopVer=0], evt=NODE_JOINED, node=a6343860-6e84-4d9c-9b87-84ffd76280cd] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4b90e5a3-253a-435b-84ca-6b592610cf0c, addrs=[4, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/4:47500], discPort=47500, order=35, intOrder=35, lastExchangeTime=1488363161573, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=35, servers=35, clients=0, CPUs=1432, heap=550.0GB] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=8fd4eea2-2a45-4563-ae87-1848fd388a98, addrs=[3, 127.0.0.1], sockAddrs=[hostName/3:47500, /127.0.0.1:47500], discPort=47500, order=36, intOrder=36, lastExchangeTime=1488363161583, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=36, servers=36, clients=0, CPUs=1472, heap=560.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=27, minorTopVer=0], evt=NODE_JOINED, node=479b18e6-54af-4313-85f7-c7525f6229a4] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=28, minorTopVer=0], evt=NODE_JOINED, node=058a99e8-3b65-4ec9-84b0-6f3502c2afce] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=d7b45a02-0411-4028-acdf-f004e592f294, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=37, intOrder=37, lastExchangeTime=1488363161875, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=37, servers=37, clients=0, CPUs=1512, heap=580.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=29, minorTopVer=0], evt=NODE_JOINED, node=57c09d88-a4dc-4179-98b4-1144fd97d8cc] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=cf4e6e83-207e-42da-a55c-5621bc20b891, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=38, intOrder=38, lastExchangeTime=1488363162636, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=38, servers=38, clients=0, CPUs=1552, heap=590.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=30, minorTopVer=0], evt=NODE_JOINED, node=58298821-7aa9-4b58-ba15-e7f1ef2830fb] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=d8926a2c-2c00-4445-beb4-633c2d656c41, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=39, intOrder=39, lastExchangeTime=1488363162646, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=39, servers=39, clients=0, CPUs=1584, heap=610.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=31, minorTopVer=0], evt=NODE_JOINED, node=4d5de2f3-d975-4b28-b593-0cc0481cdc74] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4136a0c9-14d5-42b3-9a60-81689c800438, addrs=[3, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/3:47500], discPort=47500, order=40, intOrder=40, lastExchangeTime=1488363162868, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=40, servers=40, clients=0, CPUs=1624, heap=620.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=32, minorTopVer=0], evt=NODE_JOINED, node=fa09caab-f4dc-43b6-ac8b-4a4bae6e7da6] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=694a80b8-02a3-44c9-a2dd-45bed7d20a50, addrs=[1, 127.0.0.1], sockAddrs=[hostName/1:47500, /127.0.0.1:47500], discPort=47500, order=41, intOrder=41, lastExchangeTime=1488363162878, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=41, servers=41, clients=0, CPUs=1664, heap=640.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=33, minorTopVer=0], evt=NODE_JOINED, node=af5837f0-25ec-4f3d-a1c1-90c09dc424cb] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=34, minorTopVer=0], evt=NODE_JOINED, node=e9e49d2d-5eeb-474f-8757-e447efc8ca8f] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=35, minorTopVer=0], evt=NODE_JOINED, node=4b90e5a3-253a-435b-84ca-6b592610cf0c] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=36, minorTopVer=0], evt=NODE_JOINED, node=8fd4eea2-2a45-4563-ae87-1848fd388a98] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=37, minorTopVer=0], evt=NODE_JOINED, node=d7b45a02-0411-4028-acdf-f004e592f294] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=38, minorTopVer=0], evt=NODE_JOINED, node=cf4e6e83-207e-42da-a55c-5621bc20b891] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=39, minorTopVer=0], evt=NODE_JOINED, node=d8926a2c-2c00-4445-beb4-633c2d656c41] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=40, minorTopVer=0], evt=NODE_JOINED, node=4136a0c9-14d5-42b3-9a60-81689c800438] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-sys-cache, waitList=[]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-marshaller-sys-cache, waitList=[]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-atomics-sys-cache, waitList=[ignite-sys-cache, ignite-marshaller-sys-cache]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=WCAIgniteCache, waitList=[ignite-sys-cache, ignite-marshaller-sys-cache, ignite-atomics-sys-cache]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Rebalancing required [top=AffinityTopologyVersion [topVer=41, minorTopVer=0], evt=NODE_JOINED, node=694a80b8-02a3-44c9-a2dd-45bed7d20a50] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-marshaller-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=20, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=40] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=100, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=40] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-marshaller-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=20 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=20 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-atomics-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=30, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=40] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-atomics-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=10 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=WCAIgniteCache, mode=ASYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=30, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=40] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=WCAIgniteCache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=0 ms] 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: >>> +----------------------------------------------------------------------+ >>> Ignite ver. 1.8.0#20161205-sha1:9ca40dbeb7d559fcb299bdb6f5c90cdf8ce7e533 >>> +----------------------------------------------------------------------+ >>> OS name: Linux 2.6.32-431.5.1.el6.x86_64 amd64 >>> CPU(s): 48 >>> Heap: 15.0GB >>> VM name: 29925@hostName >>> Grid name: WCA >>> Local node [ID=90DB2CAB-26F6-463D-9755-D03D059A8723, order=2, clientMode=false] >>> Local node addresses: [hostName/69, /127.0.0.1] >>> Local ports: TCP:11211 TCP:47100 TCP:47500 TCP:48100 17/03/01 04:12:47 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=2, servers=2, clients=0, CPUs=96, heap=51.0GB] 17/03/01 04:12:47 INFO resolver.CompanyResolverSparkTest: Started ignite node on executor 17/03/01 04:12:47 INFO executor.Executor: Finished task 4.0 in stage 4.0 (TID 126). 931 bytes result sent to driver 17/03/01 04:12:49 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 173 17/03/01 04:12:49 INFO executor.Executor: Running task 48.0 in stage 5.0 (TID 173) 17/03/01 04:12:49 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 128 17/03/01 04:12:49 INFO storage.MemoryStore: ensureFreeSpace(7311) called with curMem=12208, maxMem=8334920908 17/03/01 04:12:49 INFO storage.MemoryStore: Block broadcast_128_piece0 stored as bytes in memory (estimated size 7.1 KB, free 7.8 GB) 17/03/01 04:12:49 INFO broadcast.TorrentBroadcast: Reading broadcast variable 128 took 6 ms 17/03/01 04:12:49 INFO storage.MemoryStore: ensureFreeSpace(28168) called with curMem=19519, maxMem=8334920908 17/03/01 04:12:49 INFO storage.MemoryStore: Block broadcast_128 stored as values in memory (estimated size 27.5 KB, free 7.8 GB) 17/03/01 04:12:49 INFO rdd.HadoopRDD: Input split: avro path/part-r-00036-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:0+117914948 17/03/01 04:12:49 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 112 17/03/01 04:12:49 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=47687, maxMem=8334920908 17/03/01 04:12:49 INFO storage.MemoryStore: Block broadcast_112_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:12:49 INFO broadcast.TorrentBroadcast: Reading broadcast variable 112 took 5 ms 17/03/01 04:12:49 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=72330, maxMem=8334920908 17/03/01 04:12:49 INFO storage.MemoryStore: Block broadcast_112 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:12:49 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=41, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, node=6172ee3a-eb33-4bf5-9080-c255f52caed8] 17/03/01 04:13:07 INFO executor.Executor: Finished task 48.0 in stage 5.0 (TID 173). 2098 bytes result sent to driver 17/03/01 04:13:07 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 212 17/03/01 04:13:07 INFO executor.Executor: Running task 66.0 in stage 5.0 (TID 212) 17/03/01 04:13:07 INFO rdd.HadoopRDD: Input split: avro path/part-r-00019-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:0+69615127 17/03/01 04:13:07 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 121 17/03/01 04:13:07 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=407194, maxMem=8334920908 17/03/01 04:13:07 INFO storage.MemoryStore: Block broadcast_121_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:13:07 INFO broadcast.TorrentBroadcast: Reading broadcast variable 121 took 16 ms 17/03/01 04:13:07 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=431837, maxMem=8334920908 17/03/01 04:13:07 INFO storage.MemoryStore: Block broadcast_121 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:13:16 INFO executor.Executor: Finished task 66.0 in stage 5.0 (TID 212). 2098 bytes result sent to driver 17/03/01 04:13:16 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 220 17/03/01 04:13:16 INFO executor.Executor: Running task 67.0 in stage 5.0 (TID 220) 17/03/01 04:13:16 INFO rdd.HadoopRDD: Input split: avro path/part-r-00019-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:69615127+69615128 17/03/01 04:13:26 INFO executor.Executor: Finished task 67.0 in stage 5.0 (TID 220). 2098 bytes result sent to driver 17/03/01 04:13:26 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 226 17/03/01 04:13:26 INFO executor.Executor: Running task 76.0 in stage 5.0 (TID 226) 17/03/01 04:13:26 INFO rdd.HadoopRDD: Input split: avro path/part-r-00035-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:0+32162696 17/03/01 04:13:26 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 126 17/03/01 04:13:26 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=778909, maxMem=8334920908 17/03/01 04:13:26 INFO storage.MemoryStore: Block broadcast_126_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:13:26 INFO broadcast.TorrentBroadcast: Reading broadcast variable 126 took 14 ms 17/03/01 04:13:26 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=803552, maxMem=8334920908 17/03/01 04:13:26 INFO storage.MemoryStore: Block broadcast_126 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:13:30 INFO executor.Executor: Finished task 76.0 in stage 5.0 (TID 226). 2098 bytes result sent to driver 17/03/01 04:13:30 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 230 17/03/01 04:13:30 INFO executor.Executor: Running task 77.0 in stage 5.0 (TID 230) 17/03/01 04:13:30 INFO rdd.HadoopRDD: Input split: avro path/part-r-00035-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:32162696+32162697 17/03/01 04:13:36 INFO executor.Executor: Finished task 77.0 in stage 5.0 (TID 230). 2098 bytes result sent to driver 17/03/01 04:13:47 INFO internal.IgniteKernal%WCA: Metrics for local node (to disable set 'metricsLogFrequency' to 0) ^-- Node [id=90db2cab, name=WCA, uptime=00:01:00:000] ^-- H/N/C [hosts=41, nodes=41, CPUs=1664] ^-- CPU [cur=1.37%, avg=4.4%, GC=0%] ^-- Heap [used=5319MB, free=63.49%, comm=14570MB] ^-- Non heap [used=121MB, free=-1%, comm=123MB] ^-- Public thread pool [active=0, idle=0, qSize=0] ^-- System thread pool [active=0, idle=96, qSize=0] ^-- Outbound messages queue [size=0] 17/03/01 04:13:49 INFO cluster.GridUpdateNotifier: Update status is not available. 17/03/01 04:14:00 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 264 17/03/01 04:14:00 INFO executor.Executor: Running task 20.0 in stage 7.0 (TID 264) 17/03/01 04:14:00 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 131 17/03/01 04:14:00 INFO storage.MemoryStore: ensureFreeSpace(2732) called with curMem=1150624, maxMem=8334920908 17/03/01 04:14:00 INFO storage.MemoryStore: Block broadcast_131_piece0 stored as bytes in memory (estimated size 2.7 KB, free 7.8 GB) 17/03/01 04:14:00 INFO broadcast.TorrentBroadcast: Reading broadcast variable 131 took 24 ms 17/03/01 04:14:00 INFO storage.MemoryStore: ensureFreeSpace(7336) called with curMem=1153356, maxMem=8334920908 17/03/01 04:14:00 INFO storage.MemoryStore: Block broadcast_131 stored as values in memory (estimated size 7.2 KB, free 7.8 GB) 17/03/01 04:14:00 INFO dao.CompanyDAO: testing[ipaddress:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509] 17/03/01 04:14:00 INFO dao.CompanyDAO: input company name inside Contains searchCARLISLE V 17/03/01 04:14:09 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=e9e49d2d-5eeb-474f-8757-e447efc8ca8f, taskHash=0], locFut=null, sndId=e9e49d2d-5eeb-474f-8757-e447efc8ca8f, reqId=352, incMeta=false, all=false], node=90db2cab-26f6-463d-9755-d03d059a8723] java.lang.NullPointerException at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneFile.numBuffers(GridLuceneFile.java:109) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneInputStream.switchCurrentBuffer(GridLuceneInputStream.java:132) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneInputStream.seek(GridLuceneInputStream.java:224) at org.apache.lucene.index.CompoundFileReader$CSIndexInput.readInternal(CompoundFileReader.java:273) at org.apache.lucene.store.BufferedIndexInput.refill(BufferedIndexInput.java:229) at org.apache.lucene.store.BufferedIndexInput.readByte(BufferedIndexInput.java:39) at org.apache.lucene.store.DataInput.readVInt(DataInput.java:105) at org.apache.lucene.store.BufferedIndexInput.readVInt(BufferedIndexInput.java:197) at org.apache.lucene.index.FieldsReader.doc(FieldsReader.java:235) at org.apache.lucene.index.SegmentReader.document(SegmentReader.java:477) at org.apache.lucene.index.DirectoryReader.document(DirectoryReader.java:583) at org.apache.lucene.index.IndexReader.document(IndexReader.java:1115) at org.apache.lucene.search.IndexSearcher.doc(IndexSearcher.java:258) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneIndex$It.findNext(GridLuceneIndex.java:383) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneIndex$It.onNext(GridLuceneIndex.java:415) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneIndex$It.onNext(GridLuceneIndex.java:299) at org.apache.ignite.internal.util.GridCloseableIteratorAdapter.nextX(GridCloseableIteratorAdapter.java:41) at org.apache.ignite.internal.util.lang.GridIteratorAdapter.next(GridIteratorAdapter.java:35) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryManager.runQuery(GridCacheQueryManager.java:1512) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.processQueryRequest(GridCacheDistributedQueryManager.java:230) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$2.apply(GridCacheDistributedQueryManager.java:108) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$2.apply(GridCacheDistributedQueryManager.java:106) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.processMessage(GridCacheIoManager.java:827) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.onMessage0(GridCacheIoManager.java:369) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.handleMessage(GridCacheIoManager.java:293) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.access$000(GridCacheIoManager.java:95) at org.apache.ignite.internal.processors.cache.GridCacheIoManager$1.onMessage(GridCacheIoManager.java:238) at org.apache.ignite.internal.managers.communication.GridIoManager.invokeListener(GridIoManager.java:1082) at org.apache.ignite.internal.managers.communication.GridIoManager.processRegularMessage0(GridIoManager.java:710) at org.apache.ignite.internal.managers.communication.GridIoManager.access$1700(GridIoManager.java:102) at org.apache.ignite.internal.managers.communication.GridIoManager$5.run(GridIoManager.java:673) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 17/03/01 04:14:10 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=47c1a0d8-9d4d-4d0d-9b27-388bd7f49278, taskHash=0], locFut=null, sndId=47c1a0d8-9d4d-4d0d-9b27-388bd7f49278, reqId=369, incMeta=false, all=false], node=90db2cab-26f6-463d-9755-d03d059a8723] java.lang.NullPointerException at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneFile.numBuffers(GridLuceneFile.java:109) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneInputStream.switchCurrentBuffer(GridLuceneInputStream.java:132) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneInputStream.readBytes(GridLuceneInputStream.java:108) at org.apache.lucene.store.DataInput.readBytes(DataInput.java:70) at org.apache.lucene.index.CompoundFileReader$CSIndexInput.readInternal(CompoundFileReader.java:274) at org.apache.lucene.store.BufferedIndexInput.refill(BufferedIndexInput.java:229) at org.apache.lucene.store.BufferedIndexInput.readByte(BufferedIndexInput.java:39) at org.apache.lucene.store.DataInput.readInt(DataInput.java:84) at org.apache.lucene.store.BufferedIndexInput.readInt(BufferedIndexInput.java:169) at org.apache.lucene.store.DataInput.readLong(DataInput.java:126) at org.apache.lucene.store.BufferedIndexInput.readLong(BufferedIndexInput.java:182) at org.apache.lucene.index.FieldsReader.doc(FieldsReader.java:231) at org.apache.lucene.index.SegmentReader.document(SegmentReader.java:477) at org.apache.lucene.index.DirectoryReader.document(DirectoryReader.java:583) at org.apache.lucene.index.IndexReader.document(IndexReader.java:1115) at org.apache.lucene.search.IndexSearcher.doc(IndexSearcher.java:258) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneIndex$It.findNext(GridLuceneIndex.java:383) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneIndex$It.onNext(GridLuceneIndex.java:415) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneIndex$It.onNext(GridLuceneIndex.java:299) at org.apache.ignite.internal.util.GridCloseableIteratorAdapter.nextX(GridCloseableIteratorAdapter.java:41) at org.apache.ignite.internal.util.lang.GridIteratorAdapter.next(GridIteratorAdapter.java:35) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryManager.runQuery(GridCacheQueryManager.java:1512) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.processQueryRequest(GridCacheDistributedQueryManager.java:230) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$2.apply(GridCacheDistributedQueryManager.java:108) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$2.apply(GridCacheDistributedQueryManager.java:106) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.processMessage(GridCacheIoManager.java:827) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.onMessage0(GridCacheIoManager.java:369) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.handleMessage(GridCacheIoManager.java:293) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.access$000(GridCacheIoManager.java:95) at org.apache.ignite.internal.processors.cache.GridCacheIoManager$1.onMessage(GridCacheIoManager.java:238) at org.apache.ignite.internal.managers.communication.GridIoManager.invokeListener(GridIoManager.java:1082) at org.apache.ignite.internal.managers.communication.GridIoManager.processRegularMessage0(GridIoManager.java:710) at org.apache.ignite.internal.managers.communication.GridIoManager.access$1700(GridIoManager.java:102) at org.apache.ignite.internal.managers.communication.GridIoManager$5.run(GridIoManager.java:673) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 17/03/01 04:14:10 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=90db2cab-26f6-463d-9755-d03d059a8723, taskHash=0], locFut=null, sndId=90db2cab-26f6-463d-9755-d03d059a8723, reqId=543, incMeta=false, all=false], node=90db2cab-26f6-463d-9755-d03d059a8723] java.lang.NullPointerException at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneFile.numBuffers(GridLuceneFile.java:109) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneInputStream.switchCurrentBuffer(GridLuceneInputStream.java:132) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneInputStream.seek(GridLuceneInputStream.java:224) at org.apache.lucene.index.CompoundFileReader$CSIndexInput.readInternal(CompoundFileReader.java:273) at org.apache.lucene.store.BufferedIndexInput.refill(BufferedIndexInput.java:229) at org.apache.lucene.store.BufferedIndexInput.readByte(BufferedIndexInput.java:39) at org.apache.lucene.store.DataInput.readVInt(DataInput.java:105) at org.apache.lucene.store.BufferedIndexInput.readVInt(BufferedIndexInput.java:197) at org.apache.lucene.index.FieldsReader.doc(FieldsReader.java:235) at org.apache.lucene.index.SegmentReader.document(SegmentReader.java:477) at org.apache.lucene.index.DirectoryReader.document(DirectoryReader.java:583) at org.apache.lucene.index.IndexReader.document(IndexReader.java:1115) at org.apache.lucene.search.IndexSearcher.doc(IndexSearcher.java:258) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneIndex$It.findNext(GridLuceneIndex.java:383) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneIndex$It.onNext(GridLuceneIndex.java:415) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneIndex$It.onNext(GridLuceneIndex.java:299) at org.apache.ignite.internal.util.GridCloseableIteratorAdapter.nextX(GridCloseableIteratorAdapter.java:41) at org.apache.ignite.internal.util.lang.GridIteratorAdapter.next(GridIteratorAdapter.java:35) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryManager.runQuery(GridCacheQueryManager.java:1512) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.processQueryRequest(GridCacheDistributedQueryManager.java:230) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$8.call(GridCacheDistributedQueryManager.java:816) at org.apache.ignite.internal.util.IgniteUtils.wrapThreadLoader(IgniteUtils.java:6564) at org.apache.ignite.internal.processors.closure.GridClosureProcessor$2.body(GridClosureProcessor.java:906) at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 17/03/01 04:14:10 ERROR executor.Executor: Exception in task 20.0 in stage 7.0 (TID 264) javax.cache.CacheException: class org.apache.ignite.IgniteCheckedException: Query execution failed: GridCacheQueryBean [qry=GridCacheQueryAdapter [type=TEXT, clsName=CompanyVO1, clause=CARLISLE V, filter=null, transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=true, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=90db2cab-26f6-463d-9755-d03d059a8723, taskHash=0], rdc=null, trans=null] at org.apache.ignite.internal.processors.cache.GridCacheUtils.convertToCacheException(GridCacheUtils.java:1440) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.next(GridCacheQueryFutureAdapter.java:174) at org.apache.ignite.internal.processors.cache.IgniteCacheProxy$5.onHasNext(IgniteCacheProxy.java:600) at org.apache.ignite.internal.util.GridCloseableIteratorAdapter.hasNextX(GridCloseableIteratorAdapter.java:53) at org.apache.ignite.internal.util.lang.GridIteratorAdapter.hasNext(GridIteratorAdapter.java:45) at un.api.resolver.dao.CompanyDAO.getVarCompContains(CompanyDAO.scala:242) at un.api.resolver.accessor.CompanyAccessor.getVarCompContains(CompanyAccessor.scala:27) at un.api.resolver.CompanyResolverSparkTest$$anonfun$main$7.apply(CompanyResolverSparkTest.scala:291) at un.api.resolver.CompanyResolverSparkTest$$anonfun$main$7.apply(CompanyResolverSparkTest.scala:289) at scala.collection.Iterator$$anon$11.next(Iterator.scala:328) at org.apache.spark.util.Utils$.getIteratorSize(Utils.scala:1554) at org.apache.spark.rdd.RDD$$anonfun$count$1.apply(RDD.scala:1121) at org.apache.spark.rdd.RDD$$anonfun$count$1.apply(RDD.scala:1121) at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1850) at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1850) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:66) at org.apache.spark.scheduler.Task.run(Task.scala:88) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:214) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: class org.apache.ignite.IgniteCheckedException: Query execution failed: GridCacheQueryBean [qry=GridCacheQueryAdapter [type=TEXT, clsName=CompanyVO1, clause=CARLISLE V, filter=null, transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=true, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=90db2cab-26f6-463d-9755-d03d059a8723, taskHash=0], rdc=null, trans=null] at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.checkError(GridCacheQueryFutureAdapter.java:260) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.internalIterator(GridCacheQueryFutureAdapter.java:318) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.next(GridCacheQueryFutureAdapter.java:164) ... 19 more Caused by: class org.apache.ignite.IgniteCheckedException: Failed to execute query on node [query=GridCacheQueryBean [qry=GridCacheQueryAdapter [type=TEXT, clsName=CompanyVO1, clause=CARLISLE V, filter=null, transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=true, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=90db2cab-26f6-463d-9755-d03d059a8723, taskHash=0], rdc=null, trans=null], nodeId=90db2cab-26f6-463d-9755-d03d059a8723] at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.onPage(GridCacheQueryFutureAdapter.java:383) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.processQueryResponse(GridCacheDistributedQueryManager.java:398) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.access$000(GridCacheDistributedQueryManager.java:63) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$1.apply(GridCacheDistributedQueryManager.java:93) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$1.apply(GridCacheDistributedQueryManager.java:91) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.processMessage(GridCacheIoManager.java:827) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.onMessage0(GridCacheIoManager.java:369) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.access$400(GridCacheIoManager.java:95) at org.apache.ignite.internal.processors.cache.GridCacheIoManager$OrderedMessageListener.onMessage(GridCacheIoManager.java:1345) at org.apache.ignite.internal.managers.communication.GridIoManager.invokeListener(GridIoManager.java:1082) at org.apache.ignite.internal.managers.communication.GridIoManager.access$1600(GridIoManager.java:102) at org.apache.ignite.internal.managers.communication.GridIoManager$GridCommunicationMessageSet.unwind(GridIoManager.java:2332) at org.apache.ignite.internal.managers.communication.GridIoManager.unwindMessageSet(GridIoManager.java:1042) at org.apache.ignite.internal.managers.communication.GridIoManager.processOrderedMessage(GridIoManager.java:999) at org.apache.ignite.internal.managers.communication.GridIoManager.send(GridIoManager.java:1135) at org.apache.ignite.internal.managers.communication.GridIoManager.sendOrderedMessage(GridIoManager.java:1252) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.sendOrderedMessage(GridCacheIoManager.java:1081) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.sendQueryResponse(GridCacheDistributedQueryManager.java:323) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.onPageReady(GridCacheDistributedQueryManager.java:452) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryManager.runQuery(GridCacheQueryManager.java:1693) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.processQueryRequest(GridCacheDistributedQueryManager.java:230) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$8.call(GridCacheDistributedQueryManager.java:816) at org.apache.ignite.internal.util.IgniteUtils.wrapThreadLoader(IgniteUtils.java:6564) at org.apache.ignite.internal.processors.closure.GridClosureProcessor$2.body(GridClosureProcessor.java:906) at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110) ... 3 more Caused by: java.lang.NullPointerException at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneFile.numBuffers(GridLuceneFile.java:109) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneInputStream.switchCurrentBuffer(GridLuceneInputStream.java:132) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneInputStream.seek(GridLuceneInputStream.java:224) at org.apache.lucene.index.CompoundFileReader$CSIndexInput.readInternal(CompoundFileReader.java:273) at org.apache.lucene.store.BufferedIndexInput.refill(BufferedIndexInput.java:229) at org.apache.lucene.store.BufferedIndexInput.readByte(BufferedIndexInput.java:39) at org.apache.lucene.store.DataInput.readVInt(DataInput.java:105) at org.apache.lucene.store.BufferedIndexInput.readVInt(BufferedIndexInput.java:197) at org.apache.lucene.index.FieldsReader.doc(FieldsReader.java:235) at org.apache.lucene.index.SegmentReader.document(SegmentReader.java:477) at org.apache.lucene.index.DirectoryReader.document(DirectoryReader.java:583) at org.apache.lucene.index.IndexReader.document(IndexReader.java:1115) at org.apache.lucene.search.IndexSearcher.doc(IndexSearcher.java:258) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneIndex$It.findNext(GridLuceneIndex.java:383) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneIndex$It.onNext(GridLuceneIndex.java:415) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneIndex$It.onNext(GridLuceneIndex.java:299) at org.apache.ignite.internal.util.GridCloseableIteratorAdapter.nextX(GridCloseableIteratorAdapter.java:41) at org.apache.ignite.internal.util.lang.GridIteratorAdapter.next(GridIteratorAdapter.java:35) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryManager.runQuery(GridCacheQueryManager.java:1512) ... 8 more 17/03/01 04:14:10 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=a6343860-6e84-4d9c-9b87-84ffd76280cd, res=GridCacheQueryResponse [finished=true, reqId=543, err=java.lang.NullPointerException, fields=false, metadata=null]] 17/03/01 04:14:10 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=23f61699-e2c9-4ff6-8731-2483934e84c4, res=GridCacheQueryResponse [finished=true, reqId=543, err=java.lang.NullPointerException, fields=false, metadata=null]] 17/03/01 04:14:10 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=4136a0c9-14d5-42b3-9a60-81689c800438, res=GridCacheQueryResponse [finished=true, reqId=543, err=null, fields=false, metadata=null]] 17/03/01 04:14:10 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 286 17/03/01 04:14:10 INFO executor.Executor: Running task 20.1 in stage 7.0 (TID 286) 17/03/01 04:14:10 INFO dao.CompanyDAO: testing[ipaddress:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509] 17/03/01 04:14:10 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=717de453-fc6b-4a46-91b2-b5c54ab8a4be, taskHash=0], locFut=null, sndId=717de453-fc6b-4a46-91b2-b5c54ab8a4be, reqId=297, incMeta=false, all=false], node=90db2cab-26f6-463d-9755-d03d059a8723] java.lang.NullPointerException at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneFile.numBuffers(GridLuceneFile.java:109) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneInputStream.switchCurrentBuffer(GridLuceneInputStream.java:132) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneInputStream.readBytes(GridLuceneInputStream.java:108) at org.apache.lucene.store.DataInput.readBytes(DataInput.java:70) at org.apache.lucene.index.CompoundFileReader$CSIndexInput.readInternal(CompoundFileReader.java:274) at org.apache.lucene.store.BufferedIndexInput.refill(BufferedIndexInput.java:229) at org.apache.lucene.store.BufferedIndexInput.readByte(BufferedIndexInput.java:39) at org.apache.lucene.store.DataInput.readInt(DataInput.java:84) at org.apache.lucene.store.BufferedIndexInput.readInt(BufferedIndexInput.java:169) at org.apache.lucene.store.DataInput.readLong(DataInput.java:126) at org.apache.lucene.store.BufferedIndexInput.readLong(BufferedIndexInput.java:182) at org.apache.lucene.index.FieldsReader.doc(FieldsReader.java:231) at org.apache.lucene.index.SegmentReader.document(SegmentReader.java:477) at org.apache.lucene.index.DirectoryReader.document(DirectoryReader.java:583) at org.apache.lucene.index.IndexReader.document(IndexReader.java:1115) at org.apache.lucene.search.IndexSearcher.doc(IndexSearcher.java:258) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneIndex$It.findNext(GridLuceneIndex.java:383) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneIndex$It.onNext(GridLuceneIndex.java:415) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneIndex$It.onNext(GridLuceneIndex.java:299) at org.apache.ignite.internal.util.GridCloseableIteratorAdapter.nextX(GridCloseableIteratorAdapter.java:41) at org.apache.ignite.internal.util.lang.GridIteratorAdapter.next(GridIteratorAdapter.java:35) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryManager.runQuery(GridCacheQueryManager.java:1512) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.processQueryRequest(GridCacheDistributedQueryManager.java:230) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$2.apply(GridCacheDistributedQueryManager.java:108) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$2.apply(GridCacheDistributedQueryManager.java:106) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.processMessage(GridCacheIoManager.java:827) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.onMessage0(GridCacheIoManager.java:369) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.handleMessage(GridCacheIoManager.java:293) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.access$000(GridCacheIoManager.java:95) at org.apache.ignite.internal.processors.cache.GridCacheIoManager$1.onMessage(GridCacheIoManager.java:238) at org.apache.ignite.internal.managers.communication.GridIoManager.invokeListener(GridIoManager.java:1082) at org.apache.ignite.internal.managers.communication.GridIoManager.processRegularMessage0(GridIoManager.java:710) at org.apache.ignite.internal.managers.communication.GridIoManager.access$1700(GridIoManager.java:102) at org.apache.ignite.internal.managers.communication.GridIoManager$5.run(GridIoManager.java:673) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 17/03/01 04:14:10 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=ddc47224-d030-4d1f-ba66-08f61368a395, taskHash=0], locFut=null, sndId=ddc47224-d030-4d1f-ba66-08f61368a395, reqId=411, incMeta=false, all=false], node=90db2cab-26f6-463d-9755-d03d059a8723] java.lang.NullPointerException at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneFile.numBuffers(GridLuceneFile.java:109) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneInputStream.switchCurrentBuffer(GridLuceneInputStream.java:132) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneInputStream.seek(GridLuceneInputStream.java:224) at org.apache.lucene.index.CompoundFileReader$CSIndexInput.readInternal(CompoundFileReader.java:273) at org.apache.lucene.store.BufferedIndexInput.refill(BufferedIndexInput.java:229) at org.apache.lucene.store.BufferedIndexInput.readByte(BufferedIndexInput.java:39) at org.apache.lucene.store.DataInput.readInt(DataInput.java:84) at org.apache.lucene.store.BufferedIndexInput.readInt(BufferedIndexInput.java:169) at org.apache.lucene.store.DataInput.readLong(DataInput.java:126) at org.apache.lucene.store.BufferedIndexInput.readLong(BufferedIndexInput.java:182) at org.apache.lucene.index.FieldsReader.doc(FieldsReader.java:231) at org.apache.lucene.index.SegmentReader.document(SegmentReader.java:477) at org.apache.lucene.index.DirectoryReader.document(DirectoryReader.java:583) at org.apache.lucene.index.IndexReader.document(IndexReader.java:1115) at org.apache.lucene.search.IndexSearcher.doc(IndexSearcher.java:258) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneIndex$It.findNext(GridLuceneIndex.java:383) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneIndex$It.onNext(GridLuceneIndex.java:415) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneIndex$It.onNext(GridLuceneIndex.java:299) at org.apache.ignite.internal.util.GridCloseableIteratorAdapter.nextX(GridCloseableIteratorAdapter.java:41) at org.apache.ignite.internal.util.lang.GridIteratorAdapter.next(GridIteratorAdapter.java:35) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryManager.runQuery(GridCacheQueryManager.java:1512) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.processQueryRequest(GridCacheDistributedQueryManager.java:230) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$2.apply(GridCacheDistributedQueryManager.java:108) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$2.apply(GridCacheDistributedQueryManager.java:106) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.processMessage(GridCacheIoManager.java:827) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.onMessage0(GridCacheIoManager.java:369) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.handleMessage(GridCacheIoManager.java:293) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.access$000(GridCacheIoManager.java:95) at org.apache.ignite.internal.processors.cache.GridCacheIoManager$1.onMessage(GridCacheIoManager.java:238) at org.apache.ignite.internal.managers.communication.GridIoManager.invokeListener(GridIoManager.java:1082) at org.apache.ignite.internal.managers.communication.GridIoManager.processRegularMessage0(GridIoManager.java:710) at org.apache.ignite.internal.managers.communication.GridIoManager.access$1700(GridIoManager.java:102) at org.apache.ignite.internal.managers.communication.GridIoManager$5.run(GridIoManager.java:673) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 17/03/01 04:14:10 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=058a99e8-3b65-4ec9-84b0-6f3502c2afce, taskHash=0], locFut=null, sndId=058a99e8-3b65-4ec9-84b0-6f3502c2afce, reqId=359, incMeta=false, all=false], node=90db2cab-26f6-463d-9755-d03d059a8723] java.lang.NullPointerException 17/03/01 04:14:10 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=d4a9fe7f-de19-4df7-874c-a084da78562f, taskHash=0], locFut=null, sndId=d4a9fe7f-de19-4df7-874c-a084da78562f, reqId=382, incMeta=false, all=false], node=90db2cab-26f6-463d-9755-d03d059a8723] java.lang.NullPointerException 17/03/01 04:14:11 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=d8926a2c-2c00-4445-beb4-633c2d656c41, taskHash=0], locFut=null, sndId=d8926a2c-2c00-4445-beb4-633c2d656c41, reqId=385, incMeta=false, all=false], node=90db2cab-26f6-463d-9755-d03d059a8723] java.lang.NullPointerException 17/03/01 04:14:11 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=0d675d57-b9b9-4cff-a994-77337d618bbe, taskHash=0], locFut=null, sndId=0d675d57-b9b9-4cff-a994-77337d618bbe, reqId=279, incMeta=false, all=false], node=90db2cab-26f6-463d-9755-d03d059a8723] java.lang.NullPointerException 17/03/01 04:14:11 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=8fd4eea2-2a45-4563-ae87-1848fd388a98, taskHash=0], locFut=null, sndId=8fd4eea2-2a45-4563-ae87-1848fd388a98, reqId=268, incMeta=false, all=false], node=90db2cab-26f6-463d-9755-d03d059a8723] java.lang.NullPointerException 17/03/01 04:14:11 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=90532831-88fb-4eb8-adc9-db7a86744869, taskHash=0], locFut=null, sndId=90532831-88fb-4eb8-adc9-db7a86744869, reqId=385, incMeta=false, all=false], node=90db2cab-26f6-463d-9755-d03d059a8723] java.lang.NullPointerException 17/03/01 04:14:11 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=fa09caab-f4dc-43b6-ac8b-4a4bae6e7da6, taskHash=0], locFut=null, sndId=fa09caab-f4dc-43b6-ac8b-4a4bae6e7da6, reqId=5786, incMeta=false, all=false], node=90db2cab-26f6-463d-9755-d03d059a8723] java.lang.NullPointerException 17/03/01 04:14:11 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=e87f12ce-5981-4418-8468-f6bfed0a0cd8, taskHash=0], locFut=null, sndId=e87f12ce-5981-4418-8468-f6bfed0a0cd8, reqId=369, incMeta=false, all=false], node=90db2cab-26f6-463d-9755-d03d059a8723] java.lang.NullPointerException 17/03/01 04:14:11 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=daed0152-83fc-4828-ada6-64c74787b190, taskHash=0], locFut=null, sndId=daed0152-83fc-4828-ada6-64c74787b190, reqId=381, incMeta=false, all=false], node=90db2cab-26f6-463d-9755-d03d059a8723] java.lang.NullPointerException 17/03/01 04:14:11 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=694a80b8-02a3-44c9-a2dd-45bed7d20a50, taskHash=0], locFut=null, sndId=694a80b8-02a3-44c9-a2dd-45bed7d20a50, reqId=262, incMeta=false, all=false], node=90db2cab-26f6-463d-9755-d03d059a8723] java.lang.NullPointerException 17/03/01 04:14:11 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=5bc51e21-1dcf-498a-b87e-6dd24f7e36ad, taskHash=0], locFut=null, sndId=5bc51e21-1dcf-498a-b87e-6dd24f7e36ad, reqId=420, incMeta=false, all=false], node=90db2cab-26f6-463d-9755-d03d059a8723] java.lang.NullPointerException 17/03/01 04:14:11 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=40d089f0-7c80-4f1f-8659-350791f57a4c, taskHash=0], locFut=null, sndId=40d089f0-7c80-4f1f-8659-350791f57a4c, reqId=502, incMeta=false, all=false], node=90db2cab-26f6-463d-9755-d03d059a8723] java.lang.NullPointerException 17/03/01 04:14:11 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=9fb6e583-cea0-4f78-b403-b403a8bc9a0e, taskHash=0], locFut=null, sndId=9fb6e583-cea0-4f78-b403-b403a8bc9a0e, reqId=364, incMeta=false, all=false], node=90db2cab-26f6-463d-9755-d03d059a8723] java.lang.NullPointerException 17/03/01 04:14:11 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=c4f4f6bb-b71a-4a29-9575-afee2ddc1b2d, taskHash=0], locFut=null, sndId=c4f4f6bb-b71a-4a29-9575-afee2ddc1b2d, reqId=289, incMeta=false, all=false], node=90db2cab-26f6-463d-9755-d03d059a8723] java.lang.NullPointerException 17/03/01 04:14:11 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=95f164b5-4b73-438f-804f-62854d615b5b, taskHash=0], locFut=null, sndId=95f164b5-4b73-438f-804f-62854d615b5b, reqId=413, incMeta=false, all=false], node=90db2cab-26f6-463d-9755-d03d059a8723] java.lang.NullPointerException 17/03/01 04:14:28 INFO executor.Executor: Finished task 20.1 in stage 7.0 (TID 286). 969 bytes result sent to driver 17/03/01 04:14:47 INFO internal.IgniteKernal%WCA: Metrics for local node (to disable set 'metricsLogFrequency' to 0) ^-- Node [id=90db2cab, name=WCA, uptime=00:02:00:023] ^-- H/N/C [hosts=41, nodes=41, CPUs=1664] ^-- CPU [cur=0.1%, avg=3.79%, GC=0%] ^-- Heap [used=5594MB, free=61.89%, comm=14680MB] ^-- Non heap [used=126MB, free=-1%, comm=128MB] ^-- Public thread pool [active=0, idle=0, qSize=0] ^-- System thread pool [active=0, idle=96, qSize=0] ^-- Outbound messages queue [size=0] 17/03/01 04:14:49 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 336 17/03/01 04:14:49 INFO executor.Executor: Running task 23.0 in stage 8.0 (TID 336) 17/03/01 04:14:49 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 132 17/03/01 04:14:49 INFO storage.MemoryStore: ensureFreeSpace(887) called with curMem=1160692, maxMem=8334920908 17/03/01 04:14:49 INFO storage.MemoryStore: Block broadcast_132_piece0 stored as bytes in memory (estimated size 887.0 B, free 7.8 GB) 17/03/01 04:14:49 INFO broadcast.TorrentBroadcast: Reading broadcast variable 132 took 69 ms 17/03/01 04:14:49 INFO storage.MemoryStore: ensureFreeSpace(1216) called with curMem=1161579, maxMem=8334920908 17/03/01 04:14:49 INFO storage.MemoryStore: Block broadcast_132 stored as values in memory (estimated size 1216.0 B, free 7.8 GB) 17/03/01 04:14:49 INFO tcp.GridTcpRestProtocol: Command protocol successfully stopped: TCP binary 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=4136a0c9-14d5-42b3-9a60-81689c800438, addrs=[3, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/3:47500], discPort=47500, order=40, intOrder=40, lastExchangeTime=1488363162868, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=42, servers=40, clients=0, CPUs=1624, heap=620.0GB] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=cf4e6e83-207e-42da-a55c-5621bc20b891, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=38, intOrder=38, lastExchangeTime=1488363162636, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=43, servers=39, clients=0, CPUs=1584, heap=610.0GB] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=d8926a2c-2c00-4445-beb4-633c2d656c41, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=39, intOrder=39, lastExchangeTime=1488363162646, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=44, servers=38, clients=0, CPUs=1552, heap=590.0GB] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=e9e49d2d-5eeb-474f-8757-e447efc8ca8f, addrs=[6, 127.0.0.1], sockAddrs=[hostName/6:47500, /127.0.0.1:47500], discPort=47500, order=34, intOrder=34, lastExchangeTime=1488363161573, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=45, servers=37, clients=0, CPUs=1512, heap=580.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=57c09d88-a4dc-4179-98b4-1144fd97d8cc, addrs=[35, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/35:47500], discPort=47500, order=29, intOrder=29, lastExchangeTime=1488363160656, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=46, servers=36, clients=0, CPUs=1464, heap=560.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=0d675d57-b9b9-4cff-a994-77337d618bbe, addrs=[4, 127.0.0.1], sockAddrs=[hostName/4:47500, /127.0.0.1:47500], discPort=47500, order=25, intOrder=25, lastExchangeTime=1488363160223, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=47, servers=35, clients=0, CPUs=1424, heap=550.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=a6343860-6e84-4d9c-9b87-84ffd76280cd, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=26, intOrder=26, lastExchangeTime=1488363160233, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=48, servers=34, clients=0, CPUs=1384, heap=530.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=9fb6e583-cea0-4f78-b403-b403a8bc9a0e, addrs=[7, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/7:47500], discPort=47500, order=23, intOrder=23, lastExchangeTime=1488363160223, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=49, servers=33, clients=0, CPUs=1344, heap=520.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=23f61699-e2c9-4ff6-8731-2483934e84c4, addrs=[0, 127.0.0.1], sockAddrs=[hostName/0:47500, /127.0.0.1:47500], discPort=47500, order=14, intOrder=14, lastExchangeTime=1488363160011, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=50, servers=32, clients=0, CPUs=1304, heap=500.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=ddc47224-d030-4d1f-ba66-08f61368a395, addrs=[4, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/4:47500], discPort=47500, order=17, intOrder=17, lastExchangeTime=1488363160021, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=51, servers=31, clients=0, CPUs=1264, heap=490.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=e87f12ce-5981-4418-8468-f6bfed0a0cd8, addrs=[6, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/6:47500], discPort=47500, order=19, intOrder=19, lastExchangeTime=1488363160031, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=52, servers=30, clients=0, CPUs=1224, heap=470.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=40d089f0-7c80-4f1f-8659-350791f57a4c, addrs=[37, 127.0.0.1], sockAddrs=[hostName/37:47500, /127.0.0.1:47500], discPort=47500, order=4, intOrder=4, lastExchangeTime=1488363159749, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=53, servers=29, clients=0, CPUs=1176, heap=460.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=29716cf1-ed55-4550-82bd-cf980a0aee2c, addrs=[, 127.0.0.1], sockAddrs=[hostName/:47501, /127.0.0.1:47501], discPort=47501, order=9, intOrder=9, lastExchangeTime=1488363159940, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=54, servers=28, clients=0, CPUs=1136, heap=440.0GB] 17/03/01 04:14:51 WARN tcp.TcpDiscoverySpi: Failed to ping node (status check will be initiated): 8fd4eea2-2a45-4563-ae87-1848fd388a98 17/03/01 04:14:52 INFO cache.GridCacheProcessor: Stopped cache: ignite-marshaller-sys-cache 17/03/01 04:14:52 INFO cache.GridCacheProcessor: Stopped cache: ignite-sys-cache 17/03/01 04:14:52 INFO cache.GridCacheProcessor: Stopped cache: ignite-atomics-sys-cache 17/03/01 04:14:52 INFO cache.GridCacheProcessor: Stopped cache: WCAIgniteCache 17/03/01 04:14:53 INFO internal.IgniteKernal%WCA: >>> +---------------------------------------------------------------------------------+ >>> Ignite ver. 1.8.0#20161205-sha1:9ca40dbeb7d559fcb299bdb6f5c90cdf8ce7e533 stopped OK >>> +---------------------------------------------------------------------------------+ >>> Grid name: WCA >>> Grid uptime: 00:02:05:592 17/03/01 04:14:53 INFO executor.Executor: Finished task 23.0 in stage 8.0 (TID 336). 931 bytes result sent to driver 17/03/01 04:14:53 INFO executor.CoarseGrainedExecutorBackend: Driver commanded a shutdown 17/03/01 04:14:53 INFO storage.MemoryStore: MemoryStore cleared 17/03/01 04:14:53 INFO storage.BlockManager: BlockManager stopped 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Shutting down remote daemon. 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remote daemon shut down; proceeding with flushing remote transports. 17/03/01 04:14:53 INFO Remoting: Remoting shut down 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remoting shut down. 17/03/01 04:14:53 INFO util.ShutdownHookManager: Shutdown hook called LogType:stdout Log Upload Time:Wed Mar 01 04:14:58 -0600 2017 LogLength:5575 Log Contents: rEnd of the programe - [04:12:38] __________ ________________ [04:12:38] / _/ ___/ |/ / _/_ __/ __/ [04:12:38] _/ // (7 7 // / / / / _/ [04:12:38] /___/\___/_/|_/___/ /_/ /___/ [04:12:38] [04:12:38] ver. 1.8.0#20161205-sha1:9ca40dbe [04:12:38] 2016 Copyright(C) Apache Software Foundation [04:12:38] [04:12:38] Ignite documentation: http://ignite.apache.org [04:12:38] [04:12:38] Quiet mode. [04:12:38] ^-- To see **FULL** console log here add -DIGNITE_QUIET=false or "-v" to ignite.{sh|bat} [04:12:38] [04:12:38] OS: Linux 2.6.32-431.5.1.el6.x86_64 amd64 [04:12:38] VM information: Java(TM) SE Runtime Environment 1.8.0_60-b27 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.60-b23 [04:12:38] Configured plugins: [04:12:38] ^-- None [04:12:38] [04:12:38] Security status [authentication=off, tls/ssl=off] [04:12:39] Topology snapshot [ver=3, servers=3, clients=0, CPUs=144, heap=66.0GB] [04:12:39] Topology snapshot [ver=4, servers=4, clients=0, CPUs=192, heap=81.0GB] [04:12:39] Topology snapshot [ver=5, servers=5, clients=0, CPUs=232, heap=96.0GB] [04:12:40] Topology snapshot [ver=6, servers=6, clients=0, CPUs=272, heap=110.0GB] [04:12:40] Topology snapshot [ver=7, servers=7, clients=0, CPUs=312, heap=130.0GB] [04:12:40] Topology snapshot [ver=8, servers=8, clients=0, CPUs=352, heap=140.0GB] [04:12:40] Topology snapshot [ver=9, servers=9, clients=0, CPUs=392, heap=160.0GB] [04:12:40] Topology snapshot [ver=10, servers=10, clients=0, CPUs=432, heap=170.0GB] [04:12:40] Topology snapshot [ver=11, servers=11, clients=0, CPUs=472, heap=190.0GB] [04:12:40] Topology snapshot [ver=12, servers=12, clients=0, CPUs=504, heap=200.0GB] [04:12:40] Topology snapshot [ver=13, servers=13, clients=0, CPUs=544, heap=220.0GB] [04:12:40] Topology snapshot [ver=14, servers=14, clients=0, CPUs=584, heap=230.0GB] [04:12:41] Topology snapshot [ver=15, servers=15, clients=0, CPUs=624, heap=250.0GB] [04:12:41] Topology snapshot [ver=16, servers=16, clients=0, CPUs=664, heap=260.0GB] [04:12:41] Topology snapshot [ver=17, servers=17, clients=0, CPUs=704, heap=280.0GB] [04:12:41] Topology snapshot [ver=18, servers=18, clients=0, CPUs=744, heap=290.0GB] [04:12:41] Topology snapshot [ver=19, servers=19, clients=0, CPUs=784, heap=310.0GB] [04:12:41] Topology snapshot [ver=20, servers=20, clients=0, CPUs=816, heap=320.0GB] [04:12:41] Topology snapshot [ver=21, servers=21, clients=0, CPUs=856, heap=340.0GB] [04:12:42] Topology snapshot [ver=22, servers=22, clients=0, CPUs=896, heap=350.0GB] [04:12:42] Topology snapshot [ver=23, servers=23, clients=0, CPUs=936, heap=370.0GB] [04:12:42] Topology snapshot [ver=24, servers=24, clients=0, CPUs=976, heap=380.0GB] [04:12:42] Topology snapshot [ver=25, servers=25, clients=0, CPUs=1016, heap=400.0GB] [04:12:42] Topology snapshot [ver=26, servers=26, clients=0, CPUs=1056, heap=410.0GB] [04:12:42] Topology snapshot [ver=27, servers=27, clients=0, CPUs=1104, heap=430.0GB] [04:12:43] Topology snapshot [ver=28, servers=28, clients=0, CPUs=1144, heap=440.0GB] [04:12:43] Topology snapshot [ver=29, servers=29, clients=0, CPUs=1192, heap=460.0GB] [04:12:43] Topology snapshot [ver=30, servers=30, clients=0, CPUs=1232, heap=470.0GB] [04:12:43] Topology snapshot [ver=31, servers=31, clients=0, CPUs=1280, heap=490.0GB] [04:12:43] Topology snapshot [ver=32, servers=32, clients=0, CPUs=1320, heap=500.0GB] [04:12:43] Topology snapshot [ver=33, servers=33, clients=0, CPUs=1360, heap=520.0GB] [04:12:44] Topology snapshot [ver=34, servers=34, clients=0, CPUs=1400, heap=530.0GB] [04:12:44] Topology snapshot [ver=35, servers=35, clients=0, CPUs=1432, heap=550.0GB] [04:12:44] Topology snapshot [ver=36, servers=36, clients=0, CPUs=1472, heap=560.0GB] [04:12:44] Topology snapshot [ver=37, servers=37, clients=0, CPUs=1512, heap=580.0GB] [04:12:44] Topology snapshot [ver=38, servers=38, clients=0, CPUs=1552, heap=590.0GB] [04:12:45] Topology snapshot [ver=39, servers=39, clients=0, CPUs=1584, heap=610.0GB] [04:12:45] Topology snapshot [ver=40, servers=40, clients=0, CPUs=1624, heap=620.0GB] [04:12:45] Topology snapshot [ver=41, servers=41, clients=0, CPUs=1664, heap=640.0GB] [04:12:47] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [04:12:47] [04:12:47] Ignite node started OK (id=90db2cab, grid=WCA) [04:12:47] Topology snapshot [ver=2, servers=2, clients=0, CPUs=96, heap=51.0GB] [04:14:49] Topology snapshot [ver=42, servers=40, clients=0, CPUs=1624, heap=620.0GB] [04:14:49] Topology snapshot [ver=43, servers=39, clients=0, CPUs=1584, heap=610.0GB] [04:14:49] Topology snapshot [ver=44, servers=38, clients=0, CPUs=1552, heap=590.0GB] [04:14:49] Topology snapshot [ver=45, servers=37, clients=0, CPUs=1512, heap=580.0GB] [04:14:51] Topology snapshot [ver=46, servers=36, clients=0, CPUs=1464, heap=560.0GB] [04:14:51] Topology snapshot [ver=47, servers=35, clients=0, CPUs=1424, heap=550.0GB] [04:14:51] Topology snapshot [ver=48, servers=34, clients=0, CPUs=1384, heap=530.0GB] [04:14:51] Topology snapshot [ver=49, servers=33, clients=0, CPUs=1344, heap=520.0GB] [04:14:51] Topology snapshot [ver=50, servers=32, clients=0, CPUs=1304, heap=500.0GB] [04:14:51] Topology snapshot [ver=51, servers=31, clients=0, CPUs=1264, heap=490.0GB] [04:14:51] Topology snapshot [ver=52, servers=30, clients=0, CPUs=1224, heap=470.0GB] [04:14:51] Topology snapshot [ver=53, servers=29, clients=0, CPUs=1176, heap=460.0GB] [04:14:51] Topology snapshot [ver=54, servers=28, clients=0, CPUs=1136, heap=440.0GB] [04:14:53] Ignite node stopped OK [name=WCA, uptime=00:02:05:592] Container: container_e76_1487862040010_131981_01_000015 on hostName_8041 =========================================================================================== LogType:stderr Log Upload Time:Wed Mar 01 04:14:58 -0600 2017 LogLength:75833 Log Contents: 17/03/01 04:10:59 INFO executor.CoarseGrainedExecutorBackend: Registered signal handlers for [TERM, HUP, INT] 17/03/01 04:11:00 INFO spark.SecurityManager: Changing view acls to: userName 17/03/01 04:11:00 INFO spark.SecurityManager: Changing modify acls to: userName 17/03/01 04:11:00 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(userName); users with modify permissions: Set(userName) 17/03/01 04:11:00 INFO slf4j.Slf4jLogger: Slf4jLogger started 17/03/01 04:11:00 INFO Remoting: Starting remoting 17/03/01 04:11:00 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://driverPropsFetcher@hostName:54034] 17/03/01 04:11:00 INFO Remoting: Remoting now listens on addresses: [akka.tcp://driverPropsFetcher@hostName:54034] 17/03/01 04:11:00 INFO util.Utils: Successfully started service 'driverPropsFetcher' on port 54034. 17/03/01 04:11:00 INFO spark.SecurityManager: Changing view acls to: userName 17/03/01 04:11:00 INFO spark.SecurityManager: Changing modify acls to: userName 17/03/01 04:11:00 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(userName); users with modify permissions: Set(userName) 17/03/01 04:11:00 INFO remote.RemoteActorRefProvider$RemotingTerminator: Shutting down remote daemon. 17/03/01 04:11:00 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remote daemon shut down; proceeding with flushing remote transports. 17/03/01 04:11:00 INFO slf4j.Slf4jLogger: Slf4jLogger started 17/03/01 04:11:00 INFO Remoting: Starting remoting 17/03/01 04:11:00 INFO Remoting: Remoting shut down 17/03/01 04:11:00 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remoting shut down. 17/03/01 04:11:00 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://sparkExecutor@hostName:51249] 17/03/01 04:11:00 INFO Remoting: Remoting now listens on addresses: [akka.tcp://sparkExecutor@hostName:51249] 17/03/01 04:11:00 INFO util.Utils: Successfully started service 'sparkExecutor' on port 51249. 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/1/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-2bdb64cd-a438-453e-b476-81b35878478c 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/2/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-f4157eb9-2309-4f1c-83c9-1cdda48cbea5 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/3/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-69288403-8e48-4240-a095-63b192964f9f 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/4/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-e6566d2c-d555-4147-9594-8a158fcdeed1 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/5/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-320d2d93-3414-47da-87b0-b3d12450d78b 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/6/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-0775931e-4719-47ee-a6c9-0c8e10229de0 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/7/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-88d64ff7-dd0a-4bd2-80f7-323bb7886b4a 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/8/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-36fc3550-9267-4e9a-b42b-0ab694e4a0fc 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/9/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-6de4c792-179a-4a04-9378-3d1bcac26c1d 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/10/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-835a498d-9124-4855-b317-7bc4c9ce300b 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/11/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-b040c61b-b6cc-4908-926e-d6f1baed9fa4 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/12/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-301dfced-41ce-4b92-b555-012f0bc05bd2 17/03/01 04:11:00 INFO storage.MemoryStore: MemoryStore started with capacity 7.8 GB 17/03/01 04:11:01 INFO executor.CoarseGrainedExecutorBackend: Connecting to driver: akka.tcp://sparkDriver@ipaddress:38995/user/CoarseGrainedScheduler 17/03/01 04:11:01 INFO executor.CoarseGrainedExecutorBackend: Successfully registered with driver 17/03/01 04:11:01 INFO executor.Executor: Starting executor ID 12 on host hostName 17/03/01 04:11:01 INFO util.Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 46027. 17/03/01 04:11:01 INFO netty.NettyBlockTransferService: Server created on 46027 17/03/01 04:11:01 INFO storage.BlockManagerMaster: Trying to register BlockManager 17/03/01 04:11:01 INFO storage.BlockManagerMaster: Registered BlockManager 17/03/01 04:11:02 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 1 17/03/01 04:11:02 INFO executor.Executor: Running task 1.0 in stage 0.0 (TID 1) 17/03/01 04:11:02 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 0 17/03/01 04:11:02 INFO storage.MemoryStore: ensureFreeSpace(1310) called with curMem=0, maxMem=8334920908 17/03/01 04:11:02 INFO storage.MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 1310.0 B, free 7.8 GB) 17/03/01 04:11:02 INFO broadcast.TorrentBroadcast: Reading broadcast variable 0 took 241 ms 17/03/01 04:11:02 INFO storage.MemoryStore: ensureFreeSpace(2064) called with curMem=1310, maxMem=8334920908 17/03/01 04:11:02 INFO storage.MemoryStore: Block broadcast_0 stored as values in memory (estimated size 2.0 KB, free 7.8 GB) 17/03/01 04:11:02 INFO resolver.CompanyResolverSparkTest: Ranjit exec test 17/03/01 04:11:02 INFO executor.Executor: Finished task 1.0 in stage 0.0 (TID 1). 972 bytes result sent to driver 17/03/01 04:12:16 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 82 17/03/01 04:12:16 INFO executor.Executor: Running task 79.0 in stage 2.0 (TID 82) 17/03/01 04:12:16 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 84 17/03/01 04:12:16 INFO storage.MemoryStore: ensureFreeSpace(9240) called with curMem=3374, maxMem=8334920908 17/03/01 04:12:16 INFO storage.MemoryStore: Block broadcast_84_piece0 stored as bytes in memory (estimated size 9.0 KB, free 7.8 GB) 17/03/01 04:12:16 INFO broadcast.TorrentBroadcast: Reading broadcast variable 84 took 46 ms 17/03/01 04:12:16 INFO storage.MemoryStore: ensureFreeSpace(32704) called with curMem=12614, maxMem=8334920908 17/03/01 04:12:16 INFO storage.MemoryStore: Block broadcast_84 stored as values in memory (estimated size 31.9 KB, free 7.8 GB) 17/03/01 04:12:17 INFO codegen.GenerateMutableProjection: Code generated in 96.001265 ms 17/03/01 04:12:17 INFO codegen.GenerateUnsafeProjection: Code generated in 9.652485 ms 17/03/01 04:12:17 INFO codegen.GenerateMutableProjection: Code generated in 13.868379 ms 17/03/01 04:12:17 INFO codegen.GenerateUnsafeRowJoiner: Code generated in 9.304971 ms 17/03/01 04:12:17 INFO codegen.GenerateUnsafeProjection: Code generated in 9.109232 ms 17/03/01 04:12:17 INFO rdd.HadoopRDD: Input split: avro path/part-r-00017-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:37491126+37491126 17/03/01 04:12:17 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 83 17/03/01 04:12:17 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=45318, maxMem=8334920908 17/03/01 04:12:17 INFO storage.MemoryStore: Block broadcast_83_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:12:17 INFO broadcast.TorrentBroadcast: Reading broadcast variable 83 took 50 ms 17/03/01 04:12:18 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=69961, maxMem=8334920908 17/03/01 04:12:18 INFO storage.MemoryStore: Block broadcast_83 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:12:18 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 17/03/01 04:12:18 INFO Configuration.deprecation: mapred.tip.id is deprecated. Instead, use mapreduce.task.id 17/03/01 04:12:18 INFO Configuration.deprecation: mapred.task.id is deprecated. Instead, use mapreduce.task.attempt.id 17/03/01 04:12:18 INFO Configuration.deprecation: mapred.task.is.map is deprecated. Instead, use mapreduce.task.ismap 17/03/01 04:12:18 INFO Configuration.deprecation: mapred.task.partition is deprecated. Instead, use mapreduce.task.partition 17/03/01 04:12:18 INFO Configuration.deprecation: mapred.job.id is deprecated. Instead, use mapreduce.job.id 17/03/01 04:12:18 WARN security.UserGroupInformation: PriviledgedActionException as:userName (auth:SIMPLE) cause:org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:12:18 WARN ipc.Client: Exception encountered while connecting to the server : org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:12:18 WARN security.UserGroupInformation: PriviledgedActionException as:userName (auth:SIMPLE) cause:org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:12:20 INFO executor.Executor: Finished task 79.0 in stage 2.0 (TID 82). 2495 bytes result sent to driver 17/03/01 04:12:31 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 120 17/03/01 04:12:31 INFO executor.Executor: Running task 64.0 in stage 2.0 (TID 120) 17/03/01 04:12:31 INFO rdd.HadoopRDD: Input split: avro path/part-r-00011-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:0+91130664 17/03/01 04:12:31 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 76 17/03/01 04:12:31 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=417033, maxMem=8334920908 17/03/01 04:12:31 INFO storage.MemoryStore: Block broadcast_76_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:12:31 INFO broadcast.TorrentBroadcast: Reading broadcast variable 76 took 10 ms 17/03/01 04:12:31 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=441676, maxMem=8334920908 17/03/01 04:12:31 INFO storage.MemoryStore: Block broadcast_76 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:12:35 INFO executor.Executor: Finished task 64.0 in stage 2.0 (TID 120). 2495 bytes result sent to driver 17/03/01 04:12:38 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 157 17/03/01 04:12:38 INFO executor.Executor: Running task 35.0 in stage 4.0 (TID 157) 17/03/01 04:12:38 INFO spark.MapOutputTrackerWorker: Updating epoch to 1 and clearing cache 17/03/01 04:12:38 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 86 17/03/01 04:12:38 INFO storage.MemoryStore: ensureFreeSpace(2290) called with curMem=788748, maxMem=8334920908 17/03/01 04:12:38 INFO storage.MemoryStore: Block broadcast_86_piece0 stored as bytes in memory (estimated size 2.2 KB, free 7.8 GB) 17/03/01 04:12:38 INFO broadcast.TorrentBroadcast: Reading broadcast variable 86 took 8 ms 17/03/01 04:12:38 INFO storage.MemoryStore: ensureFreeSpace(6544) called with curMem=791038, maxMem=8334920908 17/03/01 04:12:38 INFO storage.MemoryStore: Block broadcast_86 stored as values in memory (estimated size 6.4 KB, free 7.8 GB) 17/03/01 04:12:38 INFO resolver.CompanyResolverSparkTest: testing worker[ipaddress:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509] 17/03/01 04:12:38 ERROR : Failed to resolve default logging config file: config/java.util.logging.properties Console logging handler is not configured. 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: >>> __________ ________________ >>> / _/ ___/ |/ / _/_ __/ __/ >>> _/ // (7 7 // / / / / _/ >>> /___/\___/_/|_/___/ /_/ /___/ >>> >>> ver. 1.8.0#20161205-sha1:9ca40dbe >>> 2016 Copyright(C) Apache Software Foundation >>> >>> Ignite documentation: http://ignite.apache.org 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Config URL: n/a 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Daemon mode: off 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: OS: Linux 2.6.32-431.5.1.el6.x86_64 amd64 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: OS user: userName 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: PID: 40578 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Language runtime: Java Platform API Specification ver. 1.8 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM information: Java(TM) SE Runtime Environment 1.8.0_60-b27 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.60-b23 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM total memory: 14.0GB 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Remote Management [restart: off, REST: on, JMX (remote: off)] 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: IGNITE_HOME=null 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM arguments: [-XX:OnOutOfMemoryError=kill %p, -Xms15360m, -Xmx15360m, -Djava.io.tmpdir=/data/2/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/container_e76_1487862040010_131981_01_000015/tmp, -Dspark.driver.port=38995, -Dspark.ui.port=0, -Dspark.yarn.app.container.log.dir=/data/11/yarn/log/container/application_1487862040010_131981/container_e76_1487862040010_131981_01_000015] 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Configured caches ['ignite-marshaller-sys-cache', 'ignite-sys-cache', 'ignite-atomics-sys-cache'] 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: Configured plugins: 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: ^-- None 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: IPC shared memory server endpoint started [port=48100, tokDir=/data/2/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/container_e76_1487862040010_131981_01_000015/tmp/ignite/work/ipc/shmem/daed0152-83fc-4828-ada6-64c74787b190-40578] 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: Successfully bound shared memory communication to TCP port [port=48100, locHost=0.0.0.0/0.0.0.0] 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: Successfully bound to TCP port [port=47100, locHost=0.0.0.0/0.0.0.0] 17/03/01 04:12:38 WARN noop.NoopCheckpointSpi: Checkpoints are disabled (to enable configure any GridCheckpointSpi implementation) 17/03/01 04:12:38 WARN collision.GridCollisionManager: Collision resolution is disabled (all jobs will be activated upon arrival). 17/03/01 04:12:38 WARN noop.NoopSwapSpaceSpi: Swap space is disabled. To enable use FileSwapSpaceSpi. 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Security status [authentication=off, tls/ssl=off] 17/03/01 04:12:39 INFO tcp.GridTcpRestProtocol: Command protocol successfully started [name=TCP binary, host=0.0.0.0/0.0.0.0, port=11211] 17/03/01 04:12:39 INFO internal.IgniteKernal%WCA: Non-loopback local IPs: 17/03/01 04:12:39 INFO internal.IgniteKernal%WCA: Enabled local MACs: 44A8421028BC 17/03/01 04:12:39 INFO tcp.TcpDiscoverySpi: Successfully bound to TCP port [port=47500, localHost=0.0.0.0/0.0.0.0, locNodeId=daed0152-83fc-4828-ada6-64c74787b190] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=29716cf1-ed55-4550-82bd-cf980a0aee2c, addrs=[, 127.0.0.1], sockAddrs=[hostName/:47501, /127.0.0.1:47501], discPort=47501, order=9, intOrder=9, lastExchangeTime=1488363160186, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=9, servers=9, clients=0, CPUs=392, heap=160.0GB] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=717de453-fc6b-4a46-91b2-b5c54ab8a4be, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=10, intOrder=10, lastExchangeTime=1488363160186, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=10, servers=10, clients=0, CPUs=432, heap=170.0GB] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=ffe19475-7849-4027-8648-ce56598ff50f, addrs=[7, 127.0.0.1], sockAddrs=[/127.0.0.1:47501, hostName/7:47501], discPort=47501, order=11, intOrder=11, lastExchangeTime=1488363160196, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=11, servers=11, clients=0, CPUs=472, heap=190.0GB] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=8be1bd05-d62c-4f1a-83f2-91dcb3f3b62a, addrs=[07, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/07:47500], discPort=47500, order=12, intOrder=12, lastExchangeTime=1488363160206, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=12, servers=12, clients=0, CPUs=504, heap=200.0GB] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=133c388f-3399-4cc8-b2f1-7ae8ba971b03, addrs=[7, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/7:47500], discPort=47500, order=13, intOrder=13, lastExchangeTime=1488363160216, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=13, servers=13, clients=0, CPUs=544, heap=220.0GB] 17/03/01 04:12:40 INFO cache.GridCacheProcessor: Started cache [name=ignite-sys-cache, mode=REPLICATED] 17/03/01 04:12:40 INFO cache.GridCacheProcessor: Started cache [name=ignite-atomics-sys-cache, mode=PARTITIONED] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=23f61699-e2c9-4ff6-8731-2483934e84c4, addrs=[0, 127.0.0.1], sockAddrs=[hostName/0:47500, /127.0.0.1:47500], discPort=47500, order=14, intOrder=14, lastExchangeTime=1488363160226, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=14, servers=14, clients=0, CPUs=584, heap=230.0GB] 17/03/01 04:12:41 INFO cache.GridCacheProcessor: Started cache [name=WCAIgniteCache, mode=PARTITIONED] 17/03/01 04:12:41 INFO cache.GridCacheProcessor: Started cache [name=ignite-marshaller-sys-cache, mode=REPLICATED] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=95f164b5-4b73-438f-804f-62854d615b5b, addrs=[9, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/9:47500], discPort=47500, order=15, intOrder=15, lastExchangeTime=1488363160236, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=15, servers=15, clients=0, CPUs=624, heap=250.0GB] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=c4f4f6bb-b71a-4a29-9575-afee2ddc1b2d, addrs=[6, 127.0.0.1], sockAddrs=[hostName/6:47500, /127.0.0.1:47500], discPort=47500, order=16, intOrder=16, lastExchangeTime=1488363160236, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=16, servers=16, clients=0, CPUs=664, heap=260.0GB] 17/03/01 04:12:41 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=8, minorTopVer=0], evt=NODE_JOINED, node=daed0152-83fc-4828-ada6-64c74787b190] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=ddc47224-d030-4d1f-ba66-08f61368a395, addrs=[4, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/4:47500], discPort=47500, order=17, intOrder=17, lastExchangeTime=1488363160246, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=17, servers=17, clients=0, CPUs=704, heap=280.0GB] 17/03/01 04:12:41 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=9, minorTopVer=0], evt=NODE_JOINED, node=29716cf1-ed55-4550-82bd-cf980a0aee2c] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=47c1a0d8-9d4d-4d0d-9b27-388bd7f49278, addrs=[1, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/1:47500], discPort=47500, order=18, intOrder=18, lastExchangeTime=1488363160246, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=18, servers=18, clients=0, CPUs=744, heap=290.0GB] 17/03/01 04:12:41 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=10, minorTopVer=0], evt=NODE_JOINED, node=717de453-fc6b-4a46-91b2-b5c54ab8a4be] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=e87f12ce-5981-4418-8468-f6bfed0a0cd8, addrs=[6, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/6:47500], discPort=47500, order=19, intOrder=19, lastExchangeTime=1488363160270, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=19, servers=19, clients=0, CPUs=784, heap=310.0GB] 17/03/01 04:12:41 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=11, minorTopVer=0], evt=NODE_JOINED, node=ffe19475-7849-4027-8648-ce56598ff50f] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=e2cba212-89dd-48dd-8d7e-821b5725fe03, addrs=[8, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/8:47500], discPort=47500, order=20, intOrder=20, lastExchangeTime=1488363160300, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=12, minorTopVer=0], evt=NODE_JOINED, node=8be1bd05-d62c-4f1a-83f2-91dcb3f3b62a] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=20, servers=20, clients=0, CPUs=816, heap=320.0GB] 17/03/01 04:12:41 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=13, minorTopVer=0], evt=NODE_JOINED, node=133c388f-3399-4cc8-b2f1-7ae8ba971b03] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=f9ce8dd7-2060-4c34-b597-d7bee86ebedb, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=21, intOrder=21, lastExchangeTime=1488363160310, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=21, servers=21, clients=0, CPUs=856, heap=340.0GB] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=14, minorTopVer=0], evt=NODE_JOINED, node=23f61699-e2c9-4ff6-8731-2483934e84c4] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=6b1889dd-9de5-4f1b-8ec9-c123c7df8ea2, addrs=[, 127.0.0.1], sockAddrs=[hostName/:47500, /127.0.0.1:47500], discPort=47500, order=22, intOrder=22, lastExchangeTime=1488363160320, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=22, servers=22, clients=0, CPUs=896, heap=350.0GB] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=15, minorTopVer=0], evt=NODE_JOINED, node=95f164b5-4b73-438f-804f-62854d615b5b] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=9fb6e583-cea0-4f78-b403-b403a8bc9a0e, addrs=[7, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/7:47500], discPort=47500, order=23, intOrder=23, lastExchangeTime=1488363160340, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=23, servers=23, clients=0, CPUs=936, heap=370.0GB] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=20860cae-2881-4311-a3f5-edaa160ef37f, addrs=[7, 127.0.0.1], sockAddrs=[hostName/7:47500, /127.0.0.1:47500], discPort=47500, order=24, intOrder=24, lastExchangeTime=1488363160350, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=24, servers=24, clients=0, CPUs=976, heap=380.0GB] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=16, minorTopVer=0], evt=NODE_JOINED, node=c4f4f6bb-b71a-4a29-9575-afee2ddc1b2d] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=0d675d57-b9b9-4cff-a994-77337d618bbe, addrs=[4, 127.0.0.1], sockAddrs=[hostName/4:47500, /127.0.0.1:47500], discPort=47500, order=25, intOrder=25, lastExchangeTime=1488363160350, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=25, servers=25, clients=0, CPUs=1016, heap=400.0GB] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=17, minorTopVer=0], evt=NODE_JOINED, node=ddc47224-d030-4d1f-ba66-08f61368a395] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=a6343860-6e84-4d9c-9b87-84ffd76280cd, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=26, intOrder=26, lastExchangeTime=1488363160360, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=26, servers=26, clients=0, CPUs=1056, heap=410.0GB] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=18, minorTopVer=0], evt=NODE_JOINED, node=47c1a0d8-9d4d-4d0d-9b27-388bd7f49278] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=19, minorTopVer=0], evt=NODE_JOINED, node=e87f12ce-5981-4418-8468-f6bfed0a0cd8] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=479b18e6-54af-4313-85f7-c7525f6229a4, addrs=[, 127.0.0.1], sockAddrs=[hostName/:47500, /127.0.0.1:47500], discPort=47500, order=27, intOrder=27, lastExchangeTime=1488363160370, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=27, servers=27, clients=0, CPUs=1104, heap=430.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=20, minorTopVer=0], evt=NODE_JOINED, node=e2cba212-89dd-48dd-8d7e-821b5725fe03] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=058a99e8-3b65-4ec9-84b0-6f3502c2afce, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=28, intOrder=28, lastExchangeTime=1488363160652, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=28, servers=28, clients=0, CPUs=1144, heap=440.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=21, minorTopVer=0], evt=NODE_JOINED, node=f9ce8dd7-2060-4c34-b597-d7bee86ebedb] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=57c09d88-a4dc-4179-98b4-1144fd97d8cc, addrs=[35, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/35:47500], discPort=47500, order=29, intOrder=29, lastExchangeTime=1488363160683, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=29, servers=29, clients=0, CPUs=1192, heap=460.0GB] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=58298821-7aa9-4b58-ba15-e7f1ef2830fb, addrs=[3, 127.0.0.1], sockAddrs=[hostName/3:47500, /127.0.0.1:47500], discPort=47500, order=30, intOrder=30, lastExchangeTime=1488363160693, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=30, servers=30, clients=0, CPUs=1232, heap=470.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=22, minorTopVer=0], evt=NODE_JOINED, node=6b1889dd-9de5-4f1b-8ec9-c123c7df8ea2] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4d5de2f3-d975-4b28-b593-0cc0481cdc74, addrs=[03, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/03:47500], discPort=47500, order=31, intOrder=31, lastExchangeTime=1488363160804, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=31, servers=31, clients=0, CPUs=1280, heap=490.0GB] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=fa09caab-f4dc-43b6-ac8b-4a4bae6e7da6, addrs=[01, 127.0.0.1], sockAddrs=[hostName/01:47500, /127.0.0.1:47500], discPort=47500, order=32, intOrder=32, lastExchangeTime=1488363161458, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=32, servers=32, clients=0, CPUs=1320, heap=500.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=23, minorTopVer=0], evt=NODE_JOINED, node=9fb6e583-cea0-4f78-b403-b403a8bc9a0e] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=24, minorTopVer=0], evt=NODE_JOINED, node=20860cae-2881-4311-a3f5-edaa160ef37f] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=af5837f0-25ec-4f3d-a1c1-90c09dc424cb, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=33, intOrder=33, lastExchangeTime=1488363161599, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=33, servers=33, clients=0, CPUs=1360, heap=520.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=25, minorTopVer=0], evt=NODE_JOINED, node=0d675d57-b9b9-4cff-a994-77337d618bbe] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=e9e49d2d-5eeb-474f-8757-e447efc8ca8f, addrs=[6, 127.0.0.1], sockAddrs=[hostName/6:47500, /127.0.0.1:47500], discPort=47500, order=34, intOrder=34, lastExchangeTime=1488363161599, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=34, servers=34, clients=0, CPUs=1400, heap=530.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=26, minorTopVer=0], evt=NODE_JOINED, node=a6343860-6e84-4d9c-9b87-84ffd76280cd] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4b90e5a3-253a-435b-84ca-6b592610cf0c, addrs=[4, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/4:47500], discPort=47500, order=35, intOrder=35, lastExchangeTime=1488363161609, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=35, servers=35, clients=0, CPUs=1432, heap=550.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=27, minorTopVer=0], evt=NODE_JOINED, node=479b18e6-54af-4313-85f7-c7525f6229a4] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=8fd4eea2-2a45-4563-ae87-1848fd388a98, addrs=[3, 127.0.0.1], sockAddrs=[hostName/3:47500, /127.0.0.1:47500], discPort=47500, order=36, intOrder=36, lastExchangeTime=1488363161609, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=36, servers=36, clients=0, CPUs=1472, heap=560.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=28, minorTopVer=0], evt=NODE_JOINED, node=058a99e8-3b65-4ec9-84b0-6f3502c2afce] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=d7b45a02-0411-4028-acdf-f004e592f294, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=37, intOrder=37, lastExchangeTime=1488363161903, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=37, servers=37, clients=0, CPUs=1512, heap=580.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=29, minorTopVer=0], evt=NODE_JOINED, node=57c09d88-a4dc-4179-98b4-1144fd97d8cc] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=cf4e6e83-207e-42da-a55c-5621bc20b891, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=38, intOrder=38, lastExchangeTime=1488363162660, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=38, servers=38, clients=0, CPUs=1552, heap=590.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=30, minorTopVer=0], evt=NODE_JOINED, node=58298821-7aa9-4b58-ba15-e7f1ef2830fb] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=d8926a2c-2c00-4445-beb4-633c2d656c41, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=39, intOrder=39, lastExchangeTime=1488363162670, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=39, servers=39, clients=0, CPUs=1584, heap=610.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=31, minorTopVer=0], evt=NODE_JOINED, node=4d5de2f3-d975-4b28-b593-0cc0481cdc74] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4136a0c9-14d5-42b3-9a60-81689c800438, addrs=[3, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/3:47500], discPort=47500, order=40, intOrder=40, lastExchangeTime=1488363162892, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=40, servers=40, clients=0, CPUs=1624, heap=620.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=32, minorTopVer=0], evt=NODE_JOINED, node=fa09caab-f4dc-43b6-ac8b-4a4bae6e7da6] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=694a80b8-02a3-44c9-a2dd-45bed7d20a50, addrs=[1, 127.0.0.1], sockAddrs=[hostName/1:47500, /127.0.0.1:47500], discPort=47500, order=41, intOrder=41, lastExchangeTime=1488363162902, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=41, servers=41, clients=0, CPUs=1664, heap=640.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=33, minorTopVer=0], evt=NODE_JOINED, node=af5837f0-25ec-4f3d-a1c1-90c09dc424cb] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=34, minorTopVer=0], evt=NODE_JOINED, node=e9e49d2d-5eeb-474f-8757-e447efc8ca8f] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=35, minorTopVer=0], evt=NODE_JOINED, node=4b90e5a3-253a-435b-84ca-6b592610cf0c] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=36, minorTopVer=0], evt=NODE_JOINED, node=8fd4eea2-2a45-4563-ae87-1848fd388a98] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=37, minorTopVer=0], evt=NODE_JOINED, node=d7b45a02-0411-4028-acdf-f004e592f294] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=38, minorTopVer=0], evt=NODE_JOINED, node=cf4e6e83-207e-42da-a55c-5621bc20b891] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=39, minorTopVer=0], evt=NODE_JOINED, node=d8926a2c-2c00-4445-beb4-633c2d656c41] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=40, minorTopVer=0], evt=NODE_JOINED, node=4136a0c9-14d5-42b3-9a60-81689c800438] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-sys-cache, waitList=[]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-marshaller-sys-cache, waitList=[]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-atomics-sys-cache, waitList=[ignite-sys-cache, ignite-marshaller-sys-cache]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=WCAIgniteCache, waitList=[ignite-sys-cache, ignite-marshaller-sys-cache, ignite-atomics-sys-cache]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Rebalancing required [top=AffinityTopologyVersion [topVer=41, minorTopVer=0], evt=NODE_JOINED, node=694a80b8-02a3-44c9-a2dd-45bed7d20a50] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-marshaller-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=20, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=34] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=100, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=34] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-marshaller-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=20 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=20 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-atomics-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=26, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=34] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-atomics-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=10 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=WCAIgniteCache, mode=ASYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=26, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=34] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=WCAIgniteCache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=0 ms] 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: >>> +----------------------------------------------------------------------+ >>> Ignite ver. 1.8.0#20161205-sha1:9ca40dbeb7d559fcb299bdb6f5c90cdf8ce7e533 >>> +----------------------------------------------------------------------+ >>> OS name: Linux 2.6.32-431.5.1.el6.x86_64 amd64 >>> CPU(s): 40 >>> Heap: 15.0GB >>> VM name: 40578@hostName >>> Grid name: WCA >>> Local node [ID=DAED0152-83FC-4828-ADA6-64C74787B190, order=8, clientMode=false] >>> Local node addresses: [hostName/, /127.0.0.1] >>> Local ports: TCP:11211 TCP:47100 TCP:47500 TCP:48100 17/03/01 04:12:47 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=8, servers=8, clients=0, CPUs=352, heap=140.0GB] 17/03/01 04:12:47 INFO resolver.CompanyResolverSparkTest: Started ignite node on executor 17/03/01 04:12:47 INFO executor.Executor: Finished task 35.0 in stage 4.0 (TID 157). 931 bytes result sent to driver 17/03/01 04:12:49 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=41, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, node=6172ee3a-eb33-4bf5-9080-c255f52caed8] 17/03/01 04:12:52 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 190 17/03/01 04:12:52 INFO executor.Executor: Running task 25.0 in stage 5.0 (TID 190) 17/03/01 04:12:52 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 128 17/03/01 04:12:52 INFO storage.MemoryStore: ensureFreeSpace(7311) called with curMem=0, maxMem=8334920908 17/03/01 04:12:52 INFO storage.MemoryStore: Block broadcast_128_piece0 stored as bytes in memory (estimated size 7.1 KB, free 7.8 GB) 17/03/01 04:12:52 INFO broadcast.TorrentBroadcast: Reading broadcast variable 128 took 10 ms 17/03/01 04:12:52 INFO storage.MemoryStore: ensureFreeSpace(28168) called with curMem=7311, maxMem=8334920908 17/03/01 04:12:52 INFO storage.MemoryStore: Block broadcast_128 stored as values in memory (estimated size 27.5 KB, free 7.8 GB) 17/03/01 04:12:52 INFO rdd.HadoopRDD: Input split: avro path/part-r-00002-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:112498680+112498681 17/03/01 04:12:52 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 100 17/03/01 04:12:52 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=35479, maxMem=8334920908 17/03/01 04:12:52 INFO storage.MemoryStore: Block broadcast_100_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:12:52 INFO broadcast.TorrentBroadcast: Reading broadcast variable 100 took 7 ms 17/03/01 04:12:52 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=60122, maxMem=8334920908 17/03/01 04:12:52 INFO storage.MemoryStore: Block broadcast_100 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:13:12 INFO executor.Executor: Finished task 25.0 in stage 5.0 (TID 190). 2098 bytes result sent to driver 17/03/01 04:13:47 INFO internal.IgniteKernal%WCA: Metrics for local node (to disable set 'metricsLogFrequency' to 0) ^-- Node [id=daed0152, name=WCA, uptime=00:01:00:000] ^-- H/N/C [hosts=41, nodes=41, CPUs=1664] ^-- CPU [cur=4.83%, avg=3.02%, GC=0.17%] ^-- Heap [used=1607MB, free=88.92%, comm=14509MB] ^-- Non heap [used=121MB, free=-1%, comm=124MB] ^-- Public thread pool [active=0, idle=0, qSize=0] ^-- System thread pool [active=0, idle=80, qSize=0] ^-- Outbound messages queue [size=0] 17/03/01 04:13:50 INFO cluster.GridUpdateNotifier: Update status is not available. 17/03/01 04:14:00 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 270 17/03/01 04:14:00 INFO executor.Executor: Running task 26.0 in stage 7.0 (TID 270) 17/03/01 04:14:00 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 131 17/03/01 04:14:00 INFO storage.MemoryStore: ensureFreeSpace(2732) called with curMem=407194, maxMem=8334920908 17/03/01 04:14:00 INFO storage.MemoryStore: Block broadcast_131_piece0 stored as bytes in memory (estimated size 2.7 KB, free 7.8 GB) 17/03/01 04:14:00 INFO broadcast.TorrentBroadcast: Reading broadcast variable 131 took 31 ms 17/03/01 04:14:00 INFO storage.MemoryStore: ensureFreeSpace(7336) called with curMem=409926, maxMem=8334920908 17/03/01 04:14:00 INFO storage.MemoryStore: Block broadcast_131 stored as values in memory (estimated size 7.2 KB, free 7.8 GB) 17/03/01 04:14:00 INFO dao.CompanyDAO: testing[ipaddress:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509] 17/03/01 04:14:00 INFO dao.CompanyDAO: input company name inside Contains searchGEOLOGICAL SOCIETY OF AMERICATHE 17/03/01 04:14:11 ERROR executor.Executor: Exception in task 26.0 in stage 7.0 (TID 270) javax.cache.CacheException: class org.apache.ignite.IgniteCheckedException: Query execution failed: GridCacheQueryBean [qry=GridCacheQueryAdapter [type=TEXT, clsName=CompanyVO1, clause=GEOLOGICAL SOCIETY OF AMERICATHE, filter=null, transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=true, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=daed0152-83fc-4828-ada6-64c74787b190, taskHash=0], rdc=null, trans=null] at org.apache.ignite.internal.processors.cache.GridCacheUtils.convertToCacheException(GridCacheUtils.java:1440) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.next(GridCacheQueryFutureAdapter.java:174) at org.apache.ignite.internal.processors.cache.IgniteCacheProxy$5.onHasNext(IgniteCacheProxy.java:600) at org.apache.ignite.internal.util.GridCloseableIteratorAdapter.hasNextX(GridCloseableIteratorAdapter.java:53) at org.apache.ignite.internal.util.lang.GridIteratorAdapter.hasNext(GridIteratorAdapter.java:45) at un.api.resolver.dao.CompanyDAO.getVarCompContains(CompanyDAO.scala:242) at un.api.resolver.accessor.CompanyAccessor.getVarCompContains(CompanyAccessor.scala:27) at un.api.resolver.CompanyResolverSparkTest$$anonfun$main$7.apply(CompanyResolverSparkTest.scala:291) at un.api.resolver.CompanyResolverSparkTest$$anonfun$main$7.apply(CompanyResolverSparkTest.scala:289) at scala.collection.Iterator$$anon$11.next(Iterator.scala:328) at org.apache.spark.util.Utils$.getIteratorSize(Utils.scala:1554) at org.apache.spark.rdd.RDD$$anonfun$count$1.apply(RDD.scala:1121) at org.apache.spark.rdd.RDD$$anonfun$count$1.apply(RDD.scala:1121) at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1850) at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1850) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:66) at org.apache.spark.scheduler.Task.run(Task.scala:88) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:214) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: class org.apache.ignite.IgniteCheckedException: Query execution failed: GridCacheQueryBean [qry=GridCacheQueryAdapter [type=TEXT, clsName=CompanyVO1, clause=GEOLOGICAL SOCIETY OF AMERICATHE, filter=null, transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=true, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=daed0152-83fc-4828-ada6-64c74787b190, taskHash=0], rdc=null, trans=null] at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.checkError(GridCacheQueryFutureAdapter.java:260) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.internalIterator(GridCacheQueryFutureAdapter.java:318) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.next(GridCacheQueryFutureAdapter.java:164) ... 19 more Caused by: class org.apache.ignite.IgniteCheckedException: Failed to execute query on node [query=GridCacheQueryBean [qry=GridCacheQueryAdapter [type=TEXT, clsName=CompanyVO1, clause=GEOLOGICAL SOCIETY OF AMERICATHE, filter=null, transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=true, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=daed0152-83fc-4828-ada6-64c74787b190, taskHash=0], rdc=null, trans=null], nodeId=694a80b8-02a3-44c9-a2dd-45bed7d20a50] at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.onPage(GridCacheQueryFutureAdapter.java:383) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.processQueryResponse(GridCacheDistributedQueryManager.java:398) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.access$000(GridCacheDistributedQueryManager.java:63) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$1.apply(GridCacheDistributedQueryManager.java:93) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$1.apply(GridCacheDistributedQueryManager.java:91) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.processMessage(GridCacheIoManager.java:827) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.onMessage0(GridCacheIoManager.java:369) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.access$400(GridCacheIoManager.java:95) at org.apache.ignite.internal.processors.cache.GridCacheIoManager$OrderedMessageListener.onMessage(GridCacheIoManager.java:1345) at org.apache.ignite.internal.managers.communication.GridIoManager.invokeListener(GridIoManager.java:1082) at org.apache.ignite.internal.managers.communication.GridIoManager.access$1600(GridIoManager.java:102) at org.apache.ignite.internal.managers.communication.GridIoManager$GridCommunicationMessageSet.unwind(GridIoManager.java:2332) at org.apache.ignite.internal.managers.communication.GridIoManager.unwindMessageSet(GridIoManager.java:1042) at org.apache.ignite.internal.managers.communication.GridIoManager.access$1900(GridIoManager.java:102) at org.apache.ignite.internal.managers.communication.GridIoManager$6.run(GridIoManager.java:1011) ... 3 more Caused by: java.lang.NullPointerException 17/03/01 04:14:11 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 297 17/03/01 04:14:11 INFO executor.Executor: Running task 26.1 in stage 7.0 (TID 297) 17/03/01 04:14:11 INFO dao.CompanyDAO: testing[ipaddress:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509] 17/03/01 04:14:11 INFO dao.CompanyDAO: input company name inside Contains searchGEOLOGICAL SOCIETY OF AMERICATHE 17/03/01 04:14:15 INFO dao.CompanyDAO: resultList() 17/03/01 04:14:15 INFO dao.CompanyDAO: Cache Size43857742 17/03/01 04:14:15 INFO dao.CompanyDAO: resultList() 17/03/01 04:14:15 INFO dao.CompanyDAO: look up time contains-4311 17/03/01 04:14:15 INFO dao.CompanyDAO: testing[ipaddress:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509] 17/03/01 04:14:15 INFO dao.CompanyDAO: input company name inside Contains searchSTERLING COLLEGE 17/03/01 04:14:20 INFO dao.CompanyDAO: look up time contains-2873 17/03/01 04:14:20 INFO executor.Executor: Finished task 26.1 in stage 7.0 (TID 297). 969 bytes result sent to driver 17/03/01 04:14:47 INFO internal.IgniteKernal%WCA: Metrics for local node (to disable set 'metricsLogFrequency' to 0) ^-- Node [id=daed0152, name=WCA, uptime=00:02:00:014] ^-- H/N/C [hosts=41, nodes=41, CPUs=1664] ^-- CPU [cur=0.13%, avg=2.64%, GC=0%] ^-- Heap [used=4356MB, free=69.57%, comm=14316MB] ^-- Non heap [used=125MB, free=-1%, comm=127MB] ^-- Public thread pool [active=0, idle=0, qSize=0] ^-- System thread pool [active=0, idle=80, qSize=0] ^-- Outbound messages queue [size=0] 17/03/01 04:14:49 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 341 17/03/01 04:14:49 INFO executor.Executor: Running task 28.0 in stage 8.0 (TID 341) 17/03/01 04:14:49 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 132 17/03/01 04:14:49 INFO storage.MemoryStore: ensureFreeSpace(887) called with curMem=417262, maxMem=8334920908 17/03/01 04:14:49 INFO storage.MemoryStore: Block broadcast_132_piece0 stored as bytes in memory (estimated size 887.0 B, free 7.8 GB) 17/03/01 04:14:49 INFO broadcast.TorrentBroadcast: Reading broadcast variable 132 took 82 ms 17/03/01 04:14:49 INFO storage.MemoryStore: ensureFreeSpace(1216) called with curMem=418149, maxMem=8334920908 17/03/01 04:14:49 INFO storage.MemoryStore: Block broadcast_132 stored as values in memory (estimated size 1216.0 B, free 7.8 GB) 17/03/01 04:14:49 INFO tcp.GridTcpRestProtocol: Command protocol successfully stopped: TCP binary 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=4136a0c9-14d5-42b3-9a60-81689c800438, addrs=[3, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/3:47500], discPort=47500, order=40, intOrder=40, lastExchangeTime=1488363162892, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=42, servers=40, clients=0, CPUs=1624, heap=620.0GB] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=cf4e6e83-207e-42da-a55c-5621bc20b891, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=38, intOrder=38, lastExchangeTime=1488363162660, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=43, servers=39, clients=0, CPUs=1584, heap=610.0GB] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=d8926a2c-2c00-4445-beb4-633c2d656c41, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=39, intOrder=39, lastExchangeTime=1488363162670, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=44, servers=38, clients=0, CPUs=1552, heap=590.0GB] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=e9e49d2d-5eeb-474f-8757-e447efc8ca8f, addrs=[6, 127.0.0.1], sockAddrs=[hostName/6:47500, /127.0.0.1:47500], discPort=47500, order=34, intOrder=34, lastExchangeTime=1488363161599, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=45, servers=37, clients=0, CPUs=1512, heap=580.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=57c09d88-a4dc-4179-98b4-1144fd97d8cc, addrs=[35, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/35:47500], discPort=47500, order=29, intOrder=29, lastExchangeTime=1488363160683, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=46, servers=36, clients=0, CPUs=1464, heap=560.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=0d675d57-b9b9-4cff-a994-77337d618bbe, addrs=[4, 127.0.0.1], sockAddrs=[hostName/4:47500, /127.0.0.1:47500], discPort=47500, order=25, intOrder=25, lastExchangeTime=1488363160350, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=47, servers=35, clients=0, CPUs=1424, heap=550.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=a6343860-6e84-4d9c-9b87-84ffd76280cd, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=26, intOrder=26, lastExchangeTime=1488363160360, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=48, servers=34, clients=0, CPUs=1384, heap=530.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=9fb6e583-cea0-4f78-b403-b403a8bc9a0e, addrs=[7, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/7:47500], discPort=47500, order=23, intOrder=23, lastExchangeTime=1488363160340, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=49, servers=33, clients=0, CPUs=1344, heap=520.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=23f61699-e2c9-4ff6-8731-2483934e84c4, addrs=[0, 127.0.0.1], sockAddrs=[hostName/0:47500, /127.0.0.1:47500], discPort=47500, order=14, intOrder=14, lastExchangeTime=1488363160226, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=50, servers=32, clients=0, CPUs=1304, heap=500.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=ddc47224-d030-4d1f-ba66-08f61368a395, addrs=[4, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/4:47500], discPort=47500, order=17, intOrder=17, lastExchangeTime=1488363160246, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=51, servers=31, clients=0, CPUs=1264, heap=490.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=e87f12ce-5981-4418-8468-f6bfed0a0cd8, addrs=[6, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/6:47500], discPort=47500, order=19, intOrder=19, lastExchangeTime=1488363160270, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=52, servers=30, clients=0, CPUs=1224, heap=470.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=40d089f0-7c80-4f1f-8659-350791f57a4c, addrs=[37, 127.0.0.1], sockAddrs=[hostName/37:47500, /127.0.0.1:47500], discPort=47500, order=4, intOrder=4, lastExchangeTime=1488363160156, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=53, servers=29, clients=0, CPUs=1176, heap=460.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=29716cf1-ed55-4550-82bd-cf980a0aee2c, addrs=[, 127.0.0.1], sockAddrs=[hostName/:47501, /127.0.0.1:47501], discPort=47501, order=9, intOrder=9, lastExchangeTime=1488363160186, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=54, servers=28, clients=0, CPUs=1136, heap=440.0GB] 17/03/01 04:14:51 WARN tcp.TcpDiscoverySpi: Failed to ping node (status check will be initiated): 8fd4eea2-2a45-4563-ae87-1848fd388a98 17/03/01 04:14:52 INFO cache.GridCacheProcessor: Stopped cache: ignite-marshaller-sys-cache 17/03/01 04:14:52 INFO cache.GridCacheProcessor: Stopped cache: ignite-sys-cache 17/03/01 04:14:52 INFO cache.GridCacheProcessor: Stopped cache: ignite-atomics-sys-cache 17/03/01 04:14:52 INFO cache.GridCacheProcessor: Stopped cache: WCAIgniteCache 17/03/01 04:14:52 INFO internal.IgniteKernal%WCA: >>> +---------------------------------------------------------------------------------+ >>> Ignite ver. 1.8.0#20161205-sha1:9ca40dbeb7d559fcb299bdb6f5c90cdf8ce7e533 stopped OK >>> +---------------------------------------------------------------------------------+ >>> Grid name: WCA >>> Grid uptime: 00:02:05:544 17/03/01 04:14:52 INFO executor.Executor: Finished task 28.0 in stage 8.0 (TID 341). 931 bytes result sent to driver 17/03/01 04:14:53 INFO executor.CoarseGrainedExecutorBackend: Driver commanded a shutdown 17/03/01 04:14:53 INFO storage.MemoryStore: MemoryStore cleared 17/03/01 04:14:53 INFO storage.BlockManager: BlockManager stopped 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Shutting down remote daemon. 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remote daemon shut down; proceeding with flushing remote transports. 17/03/01 04:14:53 INFO Remoting: Remoting shut down 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remoting shut down. 17/03/01 04:14:53 INFO util.ShutdownHookManager: Shutdown hook called LogType:stdout Log Upload Time:Wed Mar 01 04:14:58 -0600 2017 LogLength:5082 Log Contents: rEnd of the programe - [04:12:38] __________ ________________ [04:12:38] / _/ ___/ |/ / _/_ __/ __/ [04:12:38] _/ // (7 7 // / / / / _/ [04:12:38] /___/\___/_/|_/___/ /_/ /___/ [04:12:38] [04:12:38] ver. 1.8.0#20161205-sha1:9ca40dbe [04:12:38] 2016 Copyright(C) Apache Software Foundation [04:12:38] [04:12:38] Ignite documentation: http://ignite.apache.org [04:12:38] [04:12:38] Quiet mode. [04:12:38] ^-- To see **FULL** console log here add -DIGNITE_QUIET=false or "-v" to ignite.{sh|bat} [04:12:38] [04:12:38] OS: Linux 2.6.32-431.5.1.el6.x86_64 amd64 [04:12:38] VM information: Java(TM) SE Runtime Environment 1.8.0_60-b27 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.60-b23 [04:12:38] Configured plugins: [04:12:38] ^-- None [04:12:38] [04:12:38] Security status [authentication=off, tls/ssl=off] [04:12:40] Topology snapshot [ver=9, servers=9, clients=0, CPUs=392, heap=160.0GB] [04:12:40] Topology snapshot [ver=10, servers=10, clients=0, CPUs=432, heap=170.0GB] [04:12:40] Topology snapshot [ver=11, servers=11, clients=0, CPUs=472, heap=190.0GB] [04:12:40] Topology snapshot [ver=12, servers=12, clients=0, CPUs=504, heap=200.0GB] [04:12:40] Topology snapshot [ver=13, servers=13, clients=0, CPUs=544, heap=220.0GB] [04:12:40] Topology snapshot [ver=14, servers=14, clients=0, CPUs=584, heap=230.0GB] [04:12:41] Topology snapshot [ver=15, servers=15, clients=0, CPUs=624, heap=250.0GB] [04:12:41] Topology snapshot [ver=16, servers=16, clients=0, CPUs=664, heap=260.0GB] [04:12:41] Topology snapshot [ver=17, servers=17, clients=0, CPUs=704, heap=280.0GB] [04:12:41] Topology snapshot [ver=18, servers=18, clients=0, CPUs=744, heap=290.0GB] [04:12:41] Topology snapshot [ver=19, servers=19, clients=0, CPUs=784, heap=310.0GB] [04:12:41] Topology snapshot [ver=20, servers=20, clients=0, CPUs=816, heap=320.0GB] [04:12:41] Topology snapshot [ver=21, servers=21, clients=0, CPUs=856, heap=340.0GB] [04:12:42] Topology snapshot [ver=22, servers=22, clients=0, CPUs=896, heap=350.0GB] [04:12:42] Topology snapshot [ver=23, servers=23, clients=0, CPUs=936, heap=370.0GB] [04:12:42] Topology snapshot [ver=24, servers=24, clients=0, CPUs=976, heap=380.0GB] [04:12:42] Topology snapshot [ver=25, servers=25, clients=0, CPUs=1016, heap=400.0GB] [04:12:42] Topology snapshot [ver=26, servers=26, clients=0, CPUs=1056, heap=410.0GB] [04:12:42] Topology snapshot [ver=27, servers=27, clients=0, CPUs=1104, heap=430.0GB] [04:12:43] Topology snapshot [ver=28, servers=28, clients=0, CPUs=1144, heap=440.0GB] [04:12:43] Topology snapshot [ver=29, servers=29, clients=0, CPUs=1192, heap=460.0GB] [04:12:43] Topology snapshot [ver=30, servers=30, clients=0, CPUs=1232, heap=470.0GB] [04:12:43] Topology snapshot [ver=31, servers=31, clients=0, CPUs=1280, heap=490.0GB] [04:12:43] Topology snapshot [ver=32, servers=32, clients=0, CPUs=1320, heap=500.0GB] [04:12:43] Topology snapshot [ver=33, servers=33, clients=0, CPUs=1360, heap=520.0GB] [04:12:44] Topology snapshot [ver=34, servers=34, clients=0, CPUs=1400, heap=530.0GB] [04:12:44] Topology snapshot [ver=35, servers=35, clients=0, CPUs=1432, heap=550.0GB] [04:12:44] Topology snapshot [ver=36, servers=36, clients=0, CPUs=1472, heap=560.0GB] [04:12:44] Topology snapshot [ver=37, servers=37, clients=0, CPUs=1512, heap=580.0GB] [04:12:44] Topology snapshot [ver=38, servers=38, clients=0, CPUs=1552, heap=590.0GB] [04:12:45] Topology snapshot [ver=39, servers=39, clients=0, CPUs=1584, heap=610.0GB] [04:12:45] Topology snapshot [ver=40, servers=40, clients=0, CPUs=1624, heap=620.0GB] [04:12:45] Topology snapshot [ver=41, servers=41, clients=0, CPUs=1664, heap=640.0GB] [04:12:47] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [04:12:47] [04:12:47] Ignite node started OK (id=daed0152, grid=WCA) [04:12:47] Topology snapshot [ver=8, servers=8, clients=0, CPUs=352, heap=140.0GB] [04:14:49] Topology snapshot [ver=42, servers=40, clients=0, CPUs=1624, heap=620.0GB] [04:14:49] Topology snapshot [ver=43, servers=39, clients=0, CPUs=1584, heap=610.0GB] [04:14:49] Topology snapshot [ver=44, servers=38, clients=0, CPUs=1552, heap=590.0GB] [04:14:49] Topology snapshot [ver=45, servers=37, clients=0, CPUs=1512, heap=580.0GB] [04:14:51] Topology snapshot [ver=46, servers=36, clients=0, CPUs=1464, heap=560.0GB] [04:14:51] Topology snapshot [ver=47, servers=35, clients=0, CPUs=1424, heap=550.0GB] [04:14:51] Topology snapshot [ver=48, servers=34, clients=0, CPUs=1384, heap=530.0GB] [04:14:51] Topology snapshot [ver=49, servers=33, clients=0, CPUs=1344, heap=520.0GB] [04:14:51] Topology snapshot [ver=50, servers=32, clients=0, CPUs=1304, heap=500.0GB] [04:14:51] Topology snapshot [ver=51, servers=31, clients=0, CPUs=1264, heap=490.0GB] [04:14:51] Topology snapshot [ver=52, servers=30, clients=0, CPUs=1224, heap=470.0GB] [04:14:51] Topology snapshot [ver=53, servers=29, clients=0, CPUs=1176, heap=460.0GB] [04:14:51] Topology snapshot [ver=54, servers=28, clients=0, CPUs=1136, heap=440.0GB] [04:14:52] Ignite node stopped OK [name=WCA, uptime=00:02:05:544] Container: container_e76_1487862040010_131981_01_000036 on hostName_8041 =========================================================================================== LogType:stderr Log Upload Time:Wed Mar 01 04:14:58 -0600 2017 LogLength:55967 Log Contents: 17/03/01 04:11:00 INFO executor.CoarseGrainedExecutorBackend: Registered signal handlers for [TERM, HUP, INT] 17/03/01 04:11:01 INFO spark.SecurityManager: Changing view acls to: userName 17/03/01 04:11:01 INFO spark.SecurityManager: Changing modify acls to: userName 17/03/01 04:11:01 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(userName); users with modify permissions: Set(userName) 17/03/01 04:11:01 INFO slf4j.Slf4jLogger: Slf4jLogger started 17/03/01 04:11:01 INFO Remoting: Starting remoting 17/03/01 04:11:01 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://driverPropsFetcher@hostName:49042] 17/03/01 04:11:01 INFO Remoting: Remoting now listens on addresses: [akka.tcp://driverPropsFetcher@hostName:49042] 17/03/01 04:11:01 INFO util.Utils: Successfully started service 'driverPropsFetcher' on port 49042. 17/03/01 04:11:01 INFO spark.SecurityManager: Changing view acls to: userName 17/03/01 04:11:01 INFO spark.SecurityManager: Changing modify acls to: userName 17/03/01 04:11:01 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(userName); users with modify permissions: Set(userName) 17/03/01 04:11:01 INFO remote.RemoteActorRefProvider$RemotingTerminator: Shutting down remote daemon. 17/03/01 04:11:01 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remote daemon shut down; proceeding with flushing remote transports. 17/03/01 04:11:01 INFO slf4j.Slf4jLogger: Slf4jLogger started 17/03/01 04:11:01 INFO Remoting: Starting remoting 17/03/01 04:11:01 INFO Remoting: Remoting shut down 17/03/01 04:11:01 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remoting shut down. 17/03/01 04:11:01 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://sparkExecutor@hostName:44729] 17/03/01 04:11:01 INFO Remoting: Remoting now listens on addresses: [akka.tcp://sparkExecutor@hostName:44729] 17/03/01 04:11:01 INFO util.Utils: Successfully started service 'sparkExecutor' on port 44729. 17/03/01 04:11:02 INFO storage.DiskBlockManager: Created local directory at /data/1/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-09f96c15-017a-4987-8535-ac3534a8caa6 17/03/01 04:11:02 INFO storage.DiskBlockManager: Created local directory at /data/2/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-cc8e9ddb-1ac1-44b8-9e49-d1f728db8b59 17/03/01 04:11:02 INFO storage.DiskBlockManager: Created local directory at /data/3/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-70ebaa3e-5966-4f70-a69a-b076678d092f 17/03/01 04:11:02 INFO storage.DiskBlockManager: Created local directory at /data/4/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-396bf2e1-07f7-402b-9164-fe9efa6bbc59 17/03/01 04:11:02 INFO storage.DiskBlockManager: Created local directory at /data/5/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-ba559b32-d751-492a-88e2-234fa3ba8aed 17/03/01 04:11:02 INFO storage.DiskBlockManager: Created local directory at /data/6/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-0ff1849b-f18f-4ad3-9f5c-ebf7386112c1 17/03/01 04:11:02 INFO storage.DiskBlockManager: Created local directory at /data/7/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-b30640b1-7e2d-4dc5-94f3-289b9f779f10 17/03/01 04:11:02 INFO storage.DiskBlockManager: Created local directory at /data/8/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-8840e802-d8e5-48e1-b952-fcececed7b54 17/03/01 04:11:02 INFO storage.DiskBlockManager: Created local directory at /data/9/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-25ddccd7-f527-4798-82e7-ccb670693570 17/03/01 04:11:02 INFO storage.DiskBlockManager: Created local directory at /data/10/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-58001db6-879c-4b86-835e-524e92d1642c 17/03/01 04:11:02 INFO storage.DiskBlockManager: Created local directory at /data/11/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-774f1bea-91d6-4744-b655-650dace55832 17/03/01 04:11:02 INFO storage.DiskBlockManager: Created local directory at /data/12/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-3a98e989-1c56-4c51-842c-877940017237 17/03/01 04:11:02 INFO storage.MemoryStore: MemoryStore started with capacity 7.8 GB 17/03/01 04:11:02 INFO executor.CoarseGrainedExecutorBackend: Connecting to driver: akka.tcp://sparkDriver@ipaddress:38995/user/CoarseGrainedScheduler 17/03/01 04:11:02 INFO executor.CoarseGrainedExecutorBackend: Successfully registered with driver 17/03/01 04:11:02 INFO executor.Executor: Starting executor ID 33 on host hostName 17/03/01 04:11:02 INFO util.Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 33016. 17/03/01 04:11:02 INFO netty.NettyBlockTransferService: Server created on 33016 17/03/01 04:11:02 INFO storage.BlockManagerMaster: Trying to register BlockManager 17/03/01 04:11:02 INFO storage.BlockManagerMaster: Registered BlockManager 17/03/01 04:11:02 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 10 17/03/01 04:11:02 INFO executor.Executor: Running task 10.0 in stage 0.0 (TID 10) 17/03/01 04:11:02 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 0 17/03/01 04:11:02 INFO storage.MemoryStore: ensureFreeSpace(1310) called with curMem=0, maxMem=8334920908 17/03/01 04:11:02 INFO storage.MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 1310.0 B, free 7.8 GB) 17/03/01 04:11:02 INFO broadcast.TorrentBroadcast: Reading broadcast variable 0 took 116 ms 17/03/01 04:11:02 INFO storage.MemoryStore: ensureFreeSpace(2064) called with curMem=1310, maxMem=8334920908 17/03/01 04:11:02 INFO storage.MemoryStore: Block broadcast_0 stored as values in memory (estimated size 2.0 KB, free 7.8 GB) 17/03/01 04:11:02 INFO resolver.CompanyResolverSparkTest: Ranjit exec test 17/03/01 04:11:02 INFO executor.Executor: Finished task 10.0 in stage 0.0 (TID 10). 972 bytes result sent to driver 17/03/01 04:12:03 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 43 17/03/01 04:12:03 INFO executor.Executor: Running task 54.0 in stage 2.0 (TID 43) 17/03/01 04:12:03 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 84 17/03/01 04:12:03 INFO storage.MemoryStore: ensureFreeSpace(9240) called with curMem=3374, maxMem=8334920908 17/03/01 04:12:03 INFO storage.MemoryStore: Block broadcast_84_piece0 stored as bytes in memory (estimated size 9.0 KB, free 7.8 GB) 17/03/01 04:12:03 INFO broadcast.TorrentBroadcast: Reading broadcast variable 84 took 44 ms 17/03/01 04:12:03 INFO storage.MemoryStore: ensureFreeSpace(32704) called with curMem=12614, maxMem=8334920908 17/03/01 04:12:03 INFO storage.MemoryStore: Block broadcast_84 stored as values in memory (estimated size 31.9 KB, free 7.8 GB) 17/03/01 04:12:04 INFO codegen.GenerateMutableProjection: Code generated in 96.063786 ms 17/03/01 04:12:04 INFO codegen.GenerateUnsafeProjection: Code generated in 9.481062 ms 17/03/01 04:12:04 INFO codegen.GenerateMutableProjection: Code generated in 13.256161 ms 17/03/01 04:12:04 INFO codegen.GenerateUnsafeRowJoiner: Code generated in 7.605213 ms 17/03/01 04:12:04 INFO codegen.GenerateUnsafeProjection: Code generated in 7.414703 ms 17/03/01 04:12:04 INFO rdd.HadoopRDD: Input split: avro path/part-r-00004-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:0+58946811 17/03/01 04:12:04 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 71 17/03/01 04:12:04 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=45318, maxMem=8334920908 17/03/01 04:12:04 INFO storage.MemoryStore: Block broadcast_71_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:12:04 INFO broadcast.TorrentBroadcast: Reading broadcast variable 71 took 8 ms 17/03/01 04:12:04 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=69961, maxMem=8334920908 17/03/01 04:12:04 INFO storage.MemoryStore: Block broadcast_71 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:12:04 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 17/03/01 04:12:04 INFO Configuration.deprecation: mapred.tip.id is deprecated. Instead, use mapreduce.task.id 17/03/01 04:12:04 INFO Configuration.deprecation: mapred.task.id is deprecated. Instead, use mapreduce.task.attempt.id 17/03/01 04:12:04 INFO Configuration.deprecation: mapred.task.is.map is deprecated. Instead, use mapreduce.task.ismap 17/03/01 04:12:04 INFO Configuration.deprecation: mapred.task.partition is deprecated. Instead, use mapreduce.task.partition 17/03/01 04:12:04 INFO Configuration.deprecation: mapred.job.id is deprecated. Instead, use mapreduce.job.id 17/03/01 04:12:04 WARN security.UserGroupInformation: PriviledgedActionException as:userName (auth:SIMPLE) cause:org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:12:04 WARN ipc.Client: Exception encountered while connecting to the server : org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:12:04 WARN security.UserGroupInformation: PriviledgedActionException as:userName (auth:SIMPLE) cause:org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:12:07 INFO executor.Executor: Finished task 54.0 in stage 2.0 (TID 43). 2495 bytes result sent to driver 17/03/01 04:12:07 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 66 17/03/01 04:12:07 INFO executor.Executor: Running task 55.0 in stage 2.0 (TID 66) 17/03/01 04:12:07 INFO rdd.HadoopRDD: Input split: avro path/part-r-00004-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:58946811+58946812 17/03/01 04:12:10 INFO executor.Executor: Finished task 55.0 in stage 2.0 (TID 66). 2495 bytes result sent to driver 17/03/01 04:12:38 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 129 17/03/01 04:12:38 INFO executor.Executor: Running task 7.0 in stage 4.0 (TID 129) 17/03/01 04:12:38 INFO spark.MapOutputTrackerWorker: Updating epoch to 1 and clearing cache 17/03/01 04:12:38 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 86 17/03/01 04:12:38 INFO storage.MemoryStore: ensureFreeSpace(2290) called with curMem=417033, maxMem=8334920908 17/03/01 04:12:38 INFO storage.MemoryStore: Block broadcast_86_piece0 stored as bytes in memory (estimated size 2.2 KB, free 7.8 GB) 17/03/01 04:12:38 INFO broadcast.TorrentBroadcast: Reading broadcast variable 86 took 9 ms 17/03/01 04:12:38 INFO storage.MemoryStore: ensureFreeSpace(6544) called with curMem=419323, maxMem=8334920908 17/03/01 04:12:38 INFO storage.MemoryStore: Block broadcast_86 stored as values in memory (estimated size 6.4 KB, free 7.8 GB) 17/03/01 04:12:38 INFO resolver.CompanyResolverSparkTest: testing worker[ipaddress:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509] 17/03/01 04:12:38 ERROR : Failed to resolve default logging config file: config/java.util.logging.properties Console logging handler is not configured. 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: >>> __________ ________________ >>> / _/ ___/ |/ / _/_ __/ __/ >>> _/ // (7 7 // / / / / _/ >>> /___/\___/_/|_/___/ /_/ /___/ >>> >>> ver. 1.8.0#20161205-sha1:9ca40dbe >>> 2016 Copyright(C) Apache Software Foundation >>> >>> Ignite documentation: http://ignite.apache.org 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Config URL: n/a 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Daemon mode: off 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: OS: Linux 2.6.32-431.5.1.el6.x86_64 amd64 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: OS user: userName 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: PID: 16216 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Language runtime: Java Platform API Specification ver. 1.8 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM information: Java(TM) SE Runtime Environment 1.8.0_60-b27 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.60-b23 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM total memory: 14.0GB 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Remote Management [restart: off, REST: on, JMX (remote: off)] 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: IGNITE_HOME=null 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM arguments: [-XX:OnOutOfMemoryError=kill %p, -Xms15360m, -Xmx15360m, -Djava.io.tmpdir=/data/1/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/container_e76_1487862040010_131981_01_000036/tmp, -Dspark.driver.port=38995, -Dspark.ui.port=0, -Dspark.yarn.app.container.log.dir=/data/12/yarn/log/container/application_1487862040010_131981/container_e76_1487862040010_131981_01_000036] 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Configured caches ['ignite-marshaller-sys-cache', 'ignite-sys-cache', 'ignite-atomics-sys-cache'] 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: Configured plugins: 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: ^-- None 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: IPC shared memory server endpoint started [port=48100, tokDir=/data/1/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/container_e76_1487862040010_131981_01_000036/tmp/ignite/work/ipc/shmem/f9ce8dd7-2060-4c34-b597-d7bee86ebedb-16216] 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: Successfully bound shared memory communication to TCP port [port=48100, locHost=0.0.0.0/0.0.0.0] 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: Successfully bound to TCP port [port=47100, locHost=0.0.0.0/0.0.0.0] 17/03/01 04:12:38 WARN noop.NoopCheckpointSpi: Checkpoints are disabled (to enable configure any GridCheckpointSpi implementation) 17/03/01 04:12:38 WARN collision.GridCollisionManager: Collision resolution is disabled (all jobs will be activated upon arrival). 17/03/01 04:12:38 WARN noop.NoopSwapSpaceSpi: Swap space is disabled. To enable use FileSwapSpaceSpi. 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Security status [authentication=off, tls/ssl=off] 17/03/01 04:12:39 INFO tcp.GridTcpRestProtocol: Command protocol successfully started [name=TCP binary, host=0.0.0.0/0.0.0.0, port=11211] 17/03/01 04:12:39 INFO internal.IgniteKernal%WCA: Non-loopback local IPs: 17/03/01 04:12:39 INFO internal.IgniteKernal%WCA: Enabled local MACs: 44A842105880 17/03/01 04:12:39 INFO tcp.TcpDiscoverySpi: Successfully bound to TCP port [port=47500, localHost=0.0.0.0/0.0.0.0, locNodeId=f9ce8dd7-2060-4c34-b597-d7bee86ebedb] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=6b1889dd-9de5-4f1b-8ec9-c123c7df8ea2, addrs=[, 127.0.0.1], sockAddrs=[hostName/:47500, /127.0.0.1:47500], discPort=47500, order=22, intOrder=22, lastExchangeTime=1488363161824, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=22, servers=22, clients=0, CPUs=896, heap=350.0GB] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=9fb6e583-cea0-4f78-b403-b403a8bc9a0e, addrs=[7, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/7:47500], discPort=47500, order=23, intOrder=23, lastExchangeTime=1488363161834, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=23, servers=23, clients=0, CPUs=936, heap=370.0GB] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=20860cae-2881-4311-a3f5-edaa160ef37f, addrs=[7, 127.0.0.1], sockAddrs=[hostName/7:47500, /127.0.0.1:47500], discPort=47500, order=24, intOrder=24, lastExchangeTime=1488363161844, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=24, servers=24, clients=0, CPUs=976, heap=380.0GB] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=0d675d57-b9b9-4cff-a994-77337d618bbe, addrs=[4, 127.0.0.1], sockAddrs=[hostName/4:47500, /127.0.0.1:47500], discPort=47500, order=25, intOrder=25, lastExchangeTime=1488363161844, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=25, servers=25, clients=0, CPUs=1016, heap=400.0GB] 17/03/01 04:12:42 INFO cache.GridCacheProcessor: Started cache [name=ignite-sys-cache, mode=REPLICATED] 17/03/01 04:12:42 INFO cache.GridCacheProcessor: Started cache [name=ignite-atomics-sys-cache, mode=PARTITIONED] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=a6343860-6e84-4d9c-9b87-84ffd76280cd, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=26, intOrder=26, lastExchangeTime=1488363161854, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=26, servers=26, clients=0, CPUs=1056, heap=410.0GB] 17/03/01 04:12:42 INFO cache.GridCacheProcessor: Started cache [name=WCAIgniteCache, mode=PARTITIONED] 17/03/01 04:12:42 INFO cache.GridCacheProcessor: Started cache [name=ignite-marshaller-sys-cache, mode=REPLICATED] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=479b18e6-54af-4313-85f7-c7525f6229a4, addrs=[, 127.0.0.1], sockAddrs=[hostName/:47500, /127.0.0.1:47500], discPort=47500, order=27, intOrder=27, lastExchangeTime=1488363161864, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=27, servers=27, clients=0, CPUs=1104, heap=430.0GB] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=058a99e8-3b65-4ec9-84b0-6f3502c2afce, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=28, intOrder=28, lastExchangeTime=1488363161884, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=28, servers=28, clients=0, CPUs=1144, heap=440.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=21, minorTopVer=0], evt=NODE_JOINED, node=f9ce8dd7-2060-4c34-b597-d7bee86ebedb] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=57c09d88-a4dc-4179-98b4-1144fd97d8cc, addrs=[35, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/35:47500], discPort=47500, order=29, intOrder=29, lastExchangeTime=1488363161894, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=29, servers=29, clients=0, CPUs=1192, heap=460.0GB] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=58298821-7aa9-4b58-ba15-e7f1ef2830fb, addrs=[3, 127.0.0.1], sockAddrs=[hostName/3:47500, /127.0.0.1:47500], discPort=47500, order=30, intOrder=30, lastExchangeTime=1488363161904, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=30, servers=30, clients=0, CPUs=1232, heap=470.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=22, minorTopVer=0], evt=NODE_JOINED, node=6b1889dd-9de5-4f1b-8ec9-c123c7df8ea2] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4d5de2f3-d975-4b28-b593-0cc0481cdc74, addrs=[03, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/03:47500], discPort=47500, order=31, intOrder=31, lastExchangeTime=1488363161904, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=31, servers=31, clients=0, CPUs=1280, heap=490.0GB] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=fa09caab-f4dc-43b6-ac8b-4a4bae6e7da6, addrs=[01, 127.0.0.1], sockAddrs=[hostName/01:47500, /127.0.0.1:47500], discPort=47500, order=32, intOrder=32, lastExchangeTime=1488363161925, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=23, minorTopVer=0], evt=NODE_JOINED, node=9fb6e583-cea0-4f78-b403-b403a8bc9a0e] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=32, servers=32, clients=0, CPUs=1320, heap=500.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=24, minorTopVer=0], evt=NODE_JOINED, node=20860cae-2881-4311-a3f5-edaa160ef37f] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=af5837f0-25ec-4f3d-a1c1-90c09dc424cb, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=33, intOrder=33, lastExchangeTime=1488363161936, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=33, servers=33, clients=0, CPUs=1360, heap=520.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=25, minorTopVer=0], evt=NODE_JOINED, node=0d675d57-b9b9-4cff-a994-77337d618bbe] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=e9e49d2d-5eeb-474f-8757-e447efc8ca8f, addrs=[6, 127.0.0.1], sockAddrs=[hostName/6:47500, /127.0.0.1:47500], discPort=47500, order=34, intOrder=34, lastExchangeTime=1488363161946, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=34, servers=34, clients=0, CPUs=1400, heap=530.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=26, minorTopVer=0], evt=NODE_JOINED, node=a6343860-6e84-4d9c-9b87-84ffd76280cd] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4b90e5a3-253a-435b-84ca-6b592610cf0c, addrs=[4, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/4:47500], discPort=47500, order=35, intOrder=35, lastExchangeTime=1488363161946, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=35, servers=35, clients=0, CPUs=1432, heap=550.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=27, minorTopVer=0], evt=NODE_JOINED, node=479b18e6-54af-4313-85f7-c7525f6229a4] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=8fd4eea2-2a45-4563-ae87-1848fd388a98, addrs=[3, 127.0.0.1], sockAddrs=[hostName/3:47500, /127.0.0.1:47500], discPort=47500, order=36, intOrder=36, lastExchangeTime=1488363161956, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=36, servers=36, clients=0, CPUs=1472, heap=560.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=28, minorTopVer=0], evt=NODE_JOINED, node=058a99e8-3b65-4ec9-84b0-6f3502c2afce] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=d7b45a02-0411-4028-acdf-f004e592f294, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=37, intOrder=37, lastExchangeTime=1488363162017, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=37, servers=37, clients=0, CPUs=1512, heap=580.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=29, minorTopVer=0], evt=NODE_JOINED, node=57c09d88-a4dc-4179-98b4-1144fd97d8cc] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=cf4e6e83-207e-42da-a55c-5621bc20b891, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=38, intOrder=38, lastExchangeTime=1488363162742, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=38, servers=38, clients=0, CPUs=1552, heap=590.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=30, minorTopVer=0], evt=NODE_JOINED, node=58298821-7aa9-4b58-ba15-e7f1ef2830fb] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=d8926a2c-2c00-4445-beb4-633c2d656c41, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=39, intOrder=39, lastExchangeTime=1488363162752, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=39, servers=39, clients=0, CPUs=1584, heap=610.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=31, minorTopVer=0], evt=NODE_JOINED, node=4d5de2f3-d975-4b28-b593-0cc0481cdc74] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4136a0c9-14d5-42b3-9a60-81689c800438, addrs=[3, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/3:47500], discPort=47500, order=40, intOrder=40, lastExchangeTime=1488363162964, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=40, servers=40, clients=0, CPUs=1624, heap=620.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=32, minorTopVer=0], evt=NODE_JOINED, node=fa09caab-f4dc-43b6-ac8b-4a4bae6e7da6] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=694a80b8-02a3-44c9-a2dd-45bed7d20a50, addrs=[1, 127.0.0.1], sockAddrs=[hostName/1:47500, /127.0.0.1:47500], discPort=47500, order=41, intOrder=41, lastExchangeTime=1488363162974, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=41, servers=41, clients=0, CPUs=1664, heap=640.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=33, minorTopVer=0], evt=NODE_JOINED, node=af5837f0-25ec-4f3d-a1c1-90c09dc424cb] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=34, minorTopVer=0], evt=NODE_JOINED, node=e9e49d2d-5eeb-474f-8757-e447efc8ca8f] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=35, minorTopVer=0], evt=NODE_JOINED, node=4b90e5a3-253a-435b-84ca-6b592610cf0c] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=36, minorTopVer=0], evt=NODE_JOINED, node=8fd4eea2-2a45-4563-ae87-1848fd388a98] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=37, minorTopVer=0], evt=NODE_JOINED, node=d7b45a02-0411-4028-acdf-f004e592f294] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=38, minorTopVer=0], evt=NODE_JOINED, node=cf4e6e83-207e-42da-a55c-5621bc20b891] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=39, minorTopVer=0], evt=NODE_JOINED, node=d8926a2c-2c00-4445-beb4-633c2d656c41] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=40, minorTopVer=0], evt=NODE_JOINED, node=4136a0c9-14d5-42b3-9a60-81689c800438] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-sys-cache, waitList=[]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-marshaller-sys-cache, waitList=[]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-atomics-sys-cache, waitList=[ignite-sys-cache, ignite-marshaller-sys-cache]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=WCAIgniteCache, waitList=[ignite-sys-cache, ignite-marshaller-sys-cache, ignite-atomics-sys-cache]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Rebalancing required [top=AffinityTopologyVersion [topVer=41, minorTopVer=0], evt=NODE_JOINED, node=694a80b8-02a3-44c9-a2dd-45bed7d20a50] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-marshaller-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=20, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=21] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=100, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=21] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-marshaller-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=31 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=31 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-atomics-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=34, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=21] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-atomics-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=0 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=WCAIgniteCache, mode=ASYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=34, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=21] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=WCAIgniteCache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=0 ms] 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: >>> +----------------------------------------------------------------------+ >>> Ignite ver. 1.8.0#20161205-sha1:9ca40dbeb7d559fcb299bdb6f5c90cdf8ce7e533 >>> +----------------------------------------------------------------------+ >>> OS name: Linux 2.6.32-431.5.1.el6.x86_64 amd64 >>> CPU(s): 40 >>> Heap: 15.0GB >>> VM name: 16216@hostName >>> Grid name: WCA >>> Local node [ID=F9CE8DD7-2060-4C34-B597-D7BEE86EBEDB, order=21, clientMode=false] >>> Local node addresses: [hostName/, /127.0.0.1] >>> Local ports: TCP:11211 TCP:47100 TCP:47500 TCP:48100 17/03/01 04:12:47 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=21, servers=21, clients=0, CPUs=856, heap=340.0GB] 17/03/01 04:12:47 INFO resolver.CompanyResolverSparkTest: Started ignite node on executor 17/03/01 04:12:47 INFO executor.Executor: Finished task 7.0 in stage 4.0 (TID 129). 931 bytes result sent to driver 17/03/01 04:12:49 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 162 17/03/01 04:12:49 INFO executor.Executor: Running task 54.0 in stage 5.0 (TID 162) 17/03/01 04:12:49 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 128 17/03/01 04:12:49 INFO storage.MemoryStore: ensureFreeSpace(7311) called with curMem=12208, maxMem=8334920908 17/03/01 04:12:49 INFO storage.MemoryStore: Block broadcast_128_piece0 stored as bytes in memory (estimated size 7.1 KB, free 7.8 GB) 17/03/01 04:12:49 INFO broadcast.TorrentBroadcast: Reading broadcast variable 128 took 6 ms 17/03/01 04:12:49 INFO storage.MemoryStore: ensureFreeSpace(28168) called with curMem=19519, maxMem=8334920908 17/03/01 04:12:49 INFO storage.MemoryStore: Block broadcast_128 stored as values in memory (estimated size 27.5 KB, free 7.8 GB) 17/03/01 04:12:49 INFO rdd.HadoopRDD: Input split: avro path/part-r-00004-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:0+58946811 17/03/01 04:12:49 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 115 17/03/01 04:12:49 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=47687, maxMem=8334920908 17/03/01 04:12:49 INFO storage.MemoryStore: Block broadcast_115_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:12:49 INFO broadcast.TorrentBroadcast: Reading broadcast variable 115 took 7 ms 17/03/01 04:12:49 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=72330, maxMem=8334920908 17/03/01 04:12:49 INFO storage.MemoryStore: Block broadcast_115 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:12:49 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=41, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, node=6172ee3a-eb33-4bf5-9080-c255f52caed8] 17/03/01 04:12:58 INFO executor.Executor: Finished task 54.0 in stage 5.0 (TID 162). 2098 bytes result sent to driver 17/03/01 04:12:58 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 199 17/03/01 04:12:58 INFO executor.Executor: Running task 55.0 in stage 5.0 (TID 199) 17/03/01 04:12:58 INFO rdd.HadoopRDD: Input split: avro path/part-r-00004-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:58946811+58946812 17/03/01 04:13:09 INFO executor.Executor: Finished task 55.0 in stage 5.0 (TID 199). 2098 bytes result sent to driver 17/03/01 04:13:47 INFO internal.IgniteKernal%WCA: Metrics for local node (to disable set 'metricsLogFrequency' to 0) ^-- Node [id=f9ce8dd7, name=WCA, uptime=00:01:00:011] ^-- H/N/C [hosts=41, nodes=41, CPUs=1664] ^-- CPU [cur=3.5%, avg=5.75%, GC=0%] ^-- Heap [used=2667MB, free=81.51%, comm=14422MB] ^-- Non heap [used=121MB, free=-1%, comm=123MB] ^-- Public thread pool [active=0, idle=0, qSize=0] ^-- System thread pool [active=0, idle=80, qSize=0] ^-- Outbound messages queue [size=0] 17/03/01 04:13:52 INFO cluster.GridUpdateNotifier: Update status is not available. 17/03/01 04:14:00 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 265 17/03/01 04:14:00 INFO executor.Executor: Running task 21.0 in stage 7.0 (TID 265) 17/03/01 04:14:00 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 131 17/03/01 04:14:00 INFO storage.MemoryStore: ensureFreeSpace(2732) called with curMem=407194, maxMem=8334920908 17/03/01 04:14:00 INFO storage.MemoryStore: Block broadcast_131_piece0 stored as bytes in memory (estimated size 2.7 KB, free 7.8 GB) 17/03/01 04:14:00 INFO broadcast.TorrentBroadcast: Reading broadcast variable 131 took 34 ms 17/03/01 04:14:00 INFO storage.MemoryStore: ensureFreeSpace(7336) called with curMem=409926, maxMem=8334920908 17/03/01 04:14:00 INFO storage.MemoryStore: Block broadcast_131 stored as values in memory (estimated size 7.2 KB, free 7.8 GB) 17/03/01 04:14:23 INFO executor.Executor: Finished task 21.0 in stage 7.0 (TID 265). 969 bytes result sent to driver 17/03/01 04:14:47 INFO internal.IgniteKernal%WCA: Metrics for local node (to disable set 'metricsLogFrequency' to 0) ^-- Node [id=f9ce8dd7, name=WCA, uptime=00:02:00:026] ^-- H/N/C [hosts=41, nodes=41, CPUs=1664] ^-- CPU [cur=0.23%, avg=4.62%, GC=0%] ^-- Heap [used=2610MB, free=82.08%, comm=14569MB] ^-- Non heap [used=126MB, free=-1%, comm=127MB] ^-- Public thread pool [active=0, idle=0, qSize=0] ^-- System thread pool [active=0, idle=80, qSize=0] ^-- Outbound messages queue [size=0] 17/03/01 04:14:49 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 319 17/03/01 04:14:49 INFO executor.Executor: Running task 6.0 in stage 8.0 (TID 319) 17/03/01 04:14:49 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 132 17/03/01 04:14:49 INFO storage.MemoryStore: ensureFreeSpace(887) called with curMem=417262, maxMem=8334920908 17/03/01 04:14:49 INFO storage.MemoryStore: Block broadcast_132_piece0 stored as bytes in memory (estimated size 887.0 B, free 7.8 GB) 17/03/01 04:14:49 INFO broadcast.TorrentBroadcast: Reading broadcast variable 132 took 66 ms 17/03/01 04:14:49 INFO storage.MemoryStore: ensureFreeSpace(1216) called with curMem=418149, maxMem=8334920908 17/03/01 04:14:49 INFO storage.MemoryStore: Block broadcast_132 stored as values in memory (estimated size 1216.0 B, free 7.8 GB) 17/03/01 04:14:49 INFO tcp.GridTcpRestProtocol: Command protocol successfully stopped: TCP binary 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=4136a0c9-14d5-42b3-9a60-81689c800438, addrs=[3, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/3:47500], discPort=47500, order=40, intOrder=40, lastExchangeTime=1488363162964, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=42, servers=40, clients=0, CPUs=1624, heap=620.0GB] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=cf4e6e83-207e-42da-a55c-5621bc20b891, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=38, intOrder=38, lastExchangeTime=1488363162742, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=43, servers=39, clients=0, CPUs=1584, heap=610.0GB] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=d8926a2c-2c00-4445-beb4-633c2d656c41, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=39, intOrder=39, lastExchangeTime=1488363162752, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=44, servers=38, clients=0, CPUs=1552, heap=590.0GB] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=e9e49d2d-5eeb-474f-8757-e447efc8ca8f, addrs=[6, 127.0.0.1], sockAddrs=[hostName/6:47500, /127.0.0.1:47500], discPort=47500, order=34, intOrder=34, lastExchangeTime=1488363161946, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=45, servers=37, clients=0, CPUs=1512, heap=580.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=57c09d88-a4dc-4179-98b4-1144fd97d8cc, addrs=[35, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/35:47500], discPort=47500, order=29, intOrder=29, lastExchangeTime=1488363161894, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=46, servers=36, clients=0, CPUs=1464, heap=560.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=0d675d57-b9b9-4cff-a994-77337d618bbe, addrs=[4, 127.0.0.1], sockAddrs=[hostName/4:47500, /127.0.0.1:47500], discPort=47500, order=25, intOrder=25, lastExchangeTime=1488363161844, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=47, servers=35, clients=0, CPUs=1424, heap=550.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=a6343860-6e84-4d9c-9b87-84ffd76280cd, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=26, intOrder=26, lastExchangeTime=1488363161854, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=48, servers=34, clients=0, CPUs=1384, heap=530.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=9fb6e583-cea0-4f78-b403-b403a8bc9a0e, addrs=[7, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/7:47500], discPort=47500, order=23, intOrder=23, lastExchangeTime=1488363161834, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=49, servers=33, clients=0, CPUs=1344, heap=520.0GB] 17/03/01 04:14:51 WARN tcp.TcpDiscoverySpi: Failed to ping node (status check will be initiated): 8fd4eea2-2a45-4563-ae87-1848fd388a98 17/03/01 04:14:52 INFO cache.GridCacheProcessor: Stopped cache: ignite-marshaller-sys-cache 17/03/01 04:14:52 INFO cache.GridCacheProcessor: Stopped cache: ignite-sys-cache 17/03/01 04:14:52 INFO cache.GridCacheProcessor: Stopped cache: ignite-atomics-sys-cache 17/03/01 04:14:52 INFO cache.GridCacheProcessor: Stopped cache: WCAIgniteCache 17/03/01 04:14:52 INFO internal.IgniteKernal%WCA: >>> +---------------------------------------------------------------------------------+ >>> Ignite ver. 1.8.0#20161205-sha1:9ca40dbeb7d559fcb299bdb6f5c90cdf8ce7e533 stopped OK >>> +---------------------------------------------------------------------------------+ >>> Grid name: WCA >>> Grid uptime: 00:02:05:335 17/03/01 04:14:52 INFO executor.Executor: Finished task 6.0 in stage 8.0 (TID 319). 931 bytes result sent to driver 17/03/01 04:14:53 INFO executor.CoarseGrainedExecutorBackend: Driver commanded a shutdown 17/03/01 04:14:53 INFO storage.MemoryStore: MemoryStore cleared 17/03/01 04:14:53 INFO storage.BlockManager: BlockManager stopped 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Shutting down remote daemon. 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remote daemon shut down; proceeding with flushing remote transports. 17/03/01 04:14:53 INFO Remoting: Remoting shut down 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remoting shut down. 17/03/01 04:14:53 INFO util.ShutdownHookManager: Shutdown hook called LogType:stdout Log Upload Time:Wed Mar 01 04:14:58 -0600 2017 LogLength:3551 Log Contents: rEnd of the programe - [04:12:38] __________ ________________ [04:12:38] / _/ ___/ |/ / _/_ __/ __/ [04:12:38] _/ // (7 7 // / / / / _/ [04:12:38] /___/\___/_/|_/___/ /_/ /___/ [04:12:38] [04:12:38] ver. 1.8.0#20161205-sha1:9ca40dbe [04:12:38] 2016 Copyright(C) Apache Software Foundation [04:12:38] [04:12:38] Ignite documentation: http://ignite.apache.org [04:12:38] [04:12:38] Quiet mode. [04:12:38] ^-- To see **FULL** console log here add -DIGNITE_QUIET=false or "-v" to ignite.{sh|bat} [04:12:38] [04:12:38] OS: Linux 2.6.32-431.5.1.el6.x86_64 amd64 [04:12:38] VM information: Java(TM) SE Runtime Environment 1.8.0_60-b27 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.60-b23 [04:12:38] Configured plugins: [04:12:38] ^-- None [04:12:38] [04:12:38] Security status [authentication=off, tls/ssl=off] [04:12:42] Topology snapshot [ver=22, servers=22, clients=0, CPUs=896, heap=350.0GB] [04:12:42] Topology snapshot [ver=23, servers=23, clients=0, CPUs=936, heap=370.0GB] [04:12:42] Topology snapshot [ver=24, servers=24, clients=0, CPUs=976, heap=380.0GB] [04:12:42] Topology snapshot [ver=25, servers=25, clients=0, CPUs=1016, heap=400.0GB] [04:12:42] Topology snapshot [ver=26, servers=26, clients=0, CPUs=1056, heap=410.0GB] [04:12:42] Topology snapshot [ver=27, servers=27, clients=0, CPUs=1104, heap=430.0GB] [04:12:43] Topology snapshot [ver=28, servers=28, clients=0, CPUs=1144, heap=440.0GB] [04:12:43] Topology snapshot [ver=29, servers=29, clients=0, CPUs=1192, heap=460.0GB] [04:12:43] Topology snapshot [ver=30, servers=30, clients=0, CPUs=1232, heap=470.0GB] [04:12:43] Topology snapshot [ver=31, servers=31, clients=0, CPUs=1280, heap=490.0GB] [04:12:43] Topology snapshot [ver=32, servers=32, clients=0, CPUs=1320, heap=500.0GB] [04:12:44] Topology snapshot [ver=33, servers=33, clients=0, CPUs=1360, heap=520.0GB] [04:12:44] Topology snapshot [ver=34, servers=34, clients=0, CPUs=1400, heap=530.0GB] [04:12:44] Topology snapshot [ver=35, servers=35, clients=0, CPUs=1432, heap=550.0GB] [04:12:44] Topology snapshot [ver=36, servers=36, clients=0, CPUs=1472, heap=560.0GB] [04:12:44] Topology snapshot [ver=37, servers=37, clients=0, CPUs=1512, heap=580.0GB] [04:12:44] Topology snapshot [ver=38, servers=38, clients=0, CPUs=1552, heap=590.0GB] [04:12:45] Topology snapshot [ver=39, servers=39, clients=0, CPUs=1584, heap=610.0GB] [04:12:45] Topology snapshot [ver=40, servers=40, clients=0, CPUs=1624, heap=620.0GB] [04:12:45] Topology snapshot [ver=41, servers=41, clients=0, CPUs=1664, heap=640.0GB] [04:12:47] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [04:12:47] [04:12:47] Ignite node started OK (id=f9ce8dd7, grid=WCA) [04:12:47] Topology snapshot [ver=21, servers=21, clients=0, CPUs=856, heap=340.0GB] [04:14:49] Topology snapshot [ver=42, servers=40, clients=0, CPUs=1624, heap=620.0GB] [04:14:49] Topology snapshot [ver=43, servers=39, clients=0, CPUs=1584, heap=610.0GB] [04:14:49] Topology snapshot [ver=44, servers=38, clients=0, CPUs=1552, heap=590.0GB] [04:14:49] Topology snapshot [ver=45, servers=37, clients=0, CPUs=1512, heap=580.0GB] [04:14:51] Topology snapshot [ver=46, servers=36, clients=0, CPUs=1464, heap=560.0GB] [04:14:51] Topology snapshot [ver=47, servers=35, clients=0, CPUs=1424, heap=550.0GB] [04:14:51] Topology snapshot [ver=48, servers=34, clients=0, CPUs=1384, heap=530.0GB] [04:14:51] Topology snapshot [ver=49, servers=33, clients=0, CPUs=1344, heap=520.0GB] [04:14:52] Ignite node stopped OK [name=WCA, uptime=00:02:05:335] Container: container_e76_1487862040010_131981_01_000012 on hostName_8041 =========================================================================================== LogType:stderr Log Upload Time:Wed Mar 01 04:14:58 -0600 2017 LogLength:151446 Log Contents: 17/03/01 04:10:59 INFO executor.CoarseGrainedExecutorBackend: Registered signal handlers for [TERM, HUP, INT] 17/03/01 04:11:00 INFO spark.SecurityManager: Changing view acls to: userName 17/03/01 04:11:00 INFO spark.SecurityManager: Changing modify acls to: userName 17/03/01 04:11:00 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(userName); users with modify permissions: Set(userName) 17/03/01 04:11:00 INFO slf4j.Slf4jLogger: Slf4jLogger started 17/03/01 04:11:00 INFO Remoting: Starting remoting 17/03/01 04:11:00 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://driverPropsFetcher@hostName:38073] 17/03/01 04:11:00 INFO Remoting: Remoting now listens on addresses: [akka.tcp://driverPropsFetcher@hostName:38073] 17/03/01 04:11:00 INFO util.Utils: Successfully started service 'driverPropsFetcher' on port 38073. 17/03/01 04:11:01 INFO spark.SecurityManager: Changing view acls to: userName 17/03/01 04:11:01 INFO spark.SecurityManager: Changing modify acls to: userName 17/03/01 04:11:01 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(userName); users with modify permissions: Set(userName) 17/03/01 04:11:01 INFO remote.RemoteActorRefProvider$RemotingTerminator: Shutting down remote daemon. 17/03/01 04:11:01 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remote daemon shut down; proceeding with flushing remote transports. 17/03/01 04:11:01 INFO slf4j.Slf4jLogger: Slf4jLogger started 17/03/01 04:11:01 INFO Remoting: Starting remoting 17/03/01 04:11:01 INFO Remoting: Remoting shut down 17/03/01 04:11:01 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remoting shut down. 17/03/01 04:11:01 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://sparkExecutor@hostName:40325] 17/03/01 04:11:01 INFO Remoting: Remoting now listens on addresses: [akka.tcp://sparkExecutor@hostName:40325] 17/03/01 04:11:01 INFO util.Utils: Successfully started service 'sparkExecutor' on port 40325. 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/1/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-cd409a62-b699-4313-adc5-31868ca6e4fe 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/2/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-3361e5ca-171c-48c2-b8b2-3f905843cca8 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/3/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-542ec29b-26b2-416b-add3-d413b2e906a3 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/4/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-8b84d163-7567-4606-a5ea-abeb1f3ad649 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/5/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-2036619e-0365-4521-b285-6fcdfeb82899 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/6/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-0dc4dfea-9f10-4288-b7d4-46d0b2e1e629 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/7/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-b4c06973-7021-4264-a61c-27588b39c8e7 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/8/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-0e74379c-4e28-488b-9352-9c15035f104b 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/9/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-83bf0556-bf5d-4820-99bc-ef0f88c4dd93 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/10/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-e9545a61-b861-47b3-aac7-5b401a67d00d 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/11/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-2b7db16b-9044-44bf-983e-7bd26c98871b 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/12/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-afc45073-f474-436b-8886-5e258de9b7c1 17/03/01 04:11:01 INFO storage.MemoryStore: MemoryStore started with capacity 7.8 GB 17/03/01 04:11:01 INFO executor.CoarseGrainedExecutorBackend: Connecting to driver: akka.tcp://sparkDriver@ipaddress:38995/user/CoarseGrainedScheduler 17/03/01 04:11:01 INFO executor.CoarseGrainedExecutorBackend: Successfully registered with driver 17/03/01 04:11:01 INFO executor.Executor: Starting executor ID 9 on host hostName 17/03/01 04:11:01 INFO util.Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 43477. 17/03/01 04:11:01 INFO netty.NettyBlockTransferService: Server created on 43477 17/03/01 04:11:01 INFO storage.BlockManagerMaster: Trying to register BlockManager 17/03/01 04:11:01 INFO storage.BlockManagerMaster: Registered BlockManager 17/03/01 04:11:02 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 17 17/03/01 04:11:02 INFO executor.Executor: Running task 17.0 in stage 0.0 (TID 17) 17/03/01 04:11:02 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 0 17/03/01 04:11:02 INFO storage.MemoryStore: ensureFreeSpace(1310) called with curMem=0, maxMem=8334920908 17/03/01 04:11:02 INFO storage.MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 1310.0 B, free 7.8 GB) 17/03/01 04:11:02 INFO broadcast.TorrentBroadcast: Reading broadcast variable 0 took 237 ms 17/03/01 04:11:02 INFO storage.MemoryStore: ensureFreeSpace(2064) called with curMem=1310, maxMem=8334920908 17/03/01 04:11:02 INFO storage.MemoryStore: Block broadcast_0 stored as values in memory (estimated size 2.0 KB, free 7.8 GB) 17/03/01 04:11:02 INFO resolver.CompanyResolverSparkTest: Ranjit exec test 17/03/01 04:11:02 INFO executor.Executor: Finished task 17.0 in stage 0.0 (TID 17). 972 bytes result sent to driver 17/03/01 04:12:03 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 58 17/03/01 04:12:03 INFO executor.Executor: Running task 50.0 in stage 2.0 (TID 58) 17/03/01 04:12:03 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 84 17/03/01 04:12:03 INFO storage.MemoryStore: ensureFreeSpace(9240) called with curMem=3374, maxMem=8334920908 17/03/01 04:12:03 INFO storage.MemoryStore: Block broadcast_84_piece0 stored as bytes in memory (estimated size 9.0 KB, free 7.8 GB) 17/03/01 04:12:03 INFO broadcast.TorrentBroadcast: Reading broadcast variable 84 took 42 ms 17/03/01 04:12:03 INFO storage.MemoryStore: ensureFreeSpace(32704) called with curMem=12614, maxMem=8334920908 17/03/01 04:12:03 INFO storage.MemoryStore: Block broadcast_84 stored as values in memory (estimated size 31.9 KB, free 7.8 GB) 17/03/01 04:12:04 INFO codegen.GenerateMutableProjection: Code generated in 105.663337 ms 17/03/01 04:12:04 INFO codegen.GenerateUnsafeProjection: Code generated in 11.106917 ms 17/03/01 04:12:04 INFO codegen.GenerateMutableProjection: Code generated in 13.720138 ms 17/03/01 04:12:04 INFO codegen.GenerateUnsafeRowJoiner: Code generated in 7.750277 ms 17/03/01 04:12:04 INFO codegen.GenerateUnsafeProjection: Code generated in 7.135666 ms 17/03/01 04:12:04 INFO rdd.HadoopRDD: Input split: avro path/part-r-00007-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:0+48153468 17/03/01 04:12:04 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 69 17/03/01 04:12:04 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=45318, maxMem=8334920908 17/03/01 04:12:04 INFO storage.MemoryStore: Block broadcast_69_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:12:04 INFO broadcast.TorrentBroadcast: Reading broadcast variable 69 took 8 ms 17/03/01 04:12:04 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=69961, maxMem=8334920908 17/03/01 04:12:04 INFO storage.MemoryStore: Block broadcast_69 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:12:04 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 17/03/01 04:12:04 INFO Configuration.deprecation: mapred.tip.id is deprecated. Instead, use mapreduce.task.id 17/03/01 04:12:04 INFO Configuration.deprecation: mapred.task.id is deprecated. Instead, use mapreduce.task.attempt.id 17/03/01 04:12:04 INFO Configuration.deprecation: mapred.task.is.map is deprecated. Instead, use mapreduce.task.ismap 17/03/01 04:12:04 INFO Configuration.deprecation: mapred.task.partition is deprecated. Instead, use mapreduce.task.partition 17/03/01 04:12:04 INFO Configuration.deprecation: mapred.job.id is deprecated. Instead, use mapreduce.job.id 17/03/01 04:12:04 WARN security.UserGroupInformation: PriviledgedActionException as:userName (auth:SIMPLE) cause:org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:12:04 WARN ipc.Client: Exception encountered while connecting to the server : org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:12:04 WARN security.UserGroupInformation: PriviledgedActionException as:userName (auth:SIMPLE) cause:org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:12:07 INFO executor.Executor: Finished task 50.0 in stage 2.0 (TID 58). 2494 bytes result sent to driver 17/03/01 04:12:07 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 63 17/03/01 04:12:07 INFO executor.Executor: Running task 51.0 in stage 2.0 (TID 63) 17/03/01 04:12:07 INFO rdd.HadoopRDD: Input split: avro path/part-r-00007-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:48153468+48153468 17/03/01 04:12:09 INFO executor.Executor: Finished task 51.0 in stage 2.0 (TID 63). 2494 bytes result sent to driver 17/03/01 04:12:38 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 132 17/03/01 04:12:38 INFO executor.Executor: Running task 10.0 in stage 4.0 (TID 132) 17/03/01 04:12:38 INFO spark.MapOutputTrackerWorker: Updating epoch to 1 and clearing cache 17/03/01 04:12:38 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 86 17/03/01 04:12:38 INFO storage.MemoryStore: ensureFreeSpace(2290) called with curMem=417033, maxMem=8334920908 17/03/01 04:12:38 INFO storage.MemoryStore: Block broadcast_86_piece0 stored as bytes in memory (estimated size 2.2 KB, free 7.8 GB) 17/03/01 04:12:38 INFO broadcast.TorrentBroadcast: Reading broadcast variable 86 took 7 ms 17/03/01 04:12:38 INFO storage.MemoryStore: ensureFreeSpace(6544) called with curMem=419323, maxMem=8334920908 17/03/01 04:12:38 INFO storage.MemoryStore: Block broadcast_86 stored as values in memory (estimated size 6.4 KB, free 7.8 GB) 17/03/01 04:12:38 INFO resolver.CompanyResolverSparkTest: testing worker[ipaddress:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509] 17/03/01 04:12:38 ERROR : Failed to resolve default logging config file: config/java.util.logging.properties Console logging handler is not configured. 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: >>> __________ ________________ >>> / _/ ___/ |/ / _/_ __/ __/ >>> _/ // (7 7 // / / / / _/ >>> /___/\___/_/|_/___/ /_/ /___/ >>> >>> ver. 1.8.0#20161205-sha1:9ca40dbe >>> 2016 Copyright(C) Apache Software Foundation >>> >>> Ignite documentation: http://ignite.apache.org 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Config URL: n/a 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Daemon mode: off 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: OS: Linux 2.6.32-431.5.1.el6.x86_64 amd64 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: OS user: userName 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: PID: 9507 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Language runtime: Java Platform API Specification ver. 1.8 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM information: Java(TM) SE Runtime Environment 1.8.0_60-b27 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.60-b23 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM total memory: 14.0GB 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Remote Management [restart: off, REST: on, JMX (remote: off)] 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: IGNITE_HOME=null 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM arguments: [-XX:OnOutOfMemoryError=kill %p, -Xms15360m, -Xmx15360m, -Djava.io.tmpdir=/data/9/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/container_e76_1487862040010_131981_01_000012/tmp, -Dspark.driver.port=38995, -Dspark.ui.port=0, -Dspark.yarn.app.container.log.dir=/data/5/yarn/log/container/application_1487862040010_131981/container_e76_1487862040010_131981_01_000012] 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Configured caches ['ignite-marshaller-sys-cache', 'ignite-sys-cache', 'ignite-atomics-sys-cache'] 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: Configured plugins: 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: ^-- None 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: IPC shared memory server endpoint started [port=48100, tokDir=/data/9/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/container_e76_1487862040010_131981_01_000012/tmp/ignite/work/ipc/shmem/a6343860-6e84-4d9c-9b87-84ffd76280cd-9507] 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: Successfully bound shared memory communication to TCP port [port=48100, locHost=0.0.0.0/0.0.0.0] 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: Successfully bound to TCP port [port=47100, locHost=0.0.0.0/0.0.0.0] 17/03/01 04:12:38 WARN noop.NoopCheckpointSpi: Checkpoints are disabled (to enable configure any GridCheckpointSpi implementation) 17/03/01 04:12:38 WARN collision.GridCollisionManager: Collision resolution is disabled (all jobs will be activated upon arrival). 17/03/01 04:12:38 WARN noop.NoopSwapSpaceSpi: Swap space is disabled. To enable use FileSwapSpaceSpi. 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Security status [authentication=off, tls/ssl=off] 17/03/01 04:12:39 INFO tcp.GridTcpRestProtocol: Command protocol successfully started [name=TCP binary, host=0.0.0.0/0.0.0.0, port=11211] 17/03/01 04:12:39 INFO internal.IgniteKernal%WCA: Non-loopback local IPs: 17/03/01 04:12:39 INFO internal.IgniteKernal%WCA: Enabled local MACs: 44A842100550 17/03/01 04:12:39 INFO tcp.TcpDiscoverySpi: Successfully bound to TCP port [port=47500, localHost=0.0.0.0/0.0.0.0, locNodeId=a6343860-6e84-4d9c-9b87-84ffd76280cd] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=479b18e6-54af-4313-85f7-c7525f6229a4, addrs=[, 127.0.0.1], sockAddrs=[hostName/:47500, /127.0.0.1:47500], discPort=47500, order=27, intOrder=27, lastExchangeTime=1488363162603, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=27, servers=27, clients=0, CPUs=1104, heap=430.0GB] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=058a99e8-3b65-4ec9-84b0-6f3502c2afce, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=28, intOrder=28, lastExchangeTime=1488363162613, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=28, servers=28, clients=0, CPUs=1144, heap=440.0GB] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=57c09d88-a4dc-4179-98b4-1144fd97d8cc, addrs=[35, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/35:47500], discPort=47500, order=29, intOrder=29, lastExchangeTime=1488363162623, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=29, servers=29, clients=0, CPUs=1192, heap=460.0GB] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=58298821-7aa9-4b58-ba15-e7f1ef2830fb, addrs=[3, 127.0.0.1], sockAddrs=[hostName/3:47500, /127.0.0.1:47500], discPort=47500, order=30, intOrder=30, lastExchangeTime=1488363162633, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=30, servers=30, clients=0, CPUs=1232, heap=470.0GB] 17/03/01 04:12:43 INFO cache.GridCacheProcessor: Started cache [name=ignite-sys-cache, mode=REPLICATED] 17/03/01 04:12:43 INFO cache.GridCacheProcessor: Started cache [name=ignite-atomics-sys-cache, mode=PARTITIONED] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4d5de2f3-d975-4b28-b593-0cc0481cdc74, addrs=[03, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/03:47500], discPort=47500, order=31, intOrder=31, lastExchangeTime=1488363162643, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=31, servers=31, clients=0, CPUs=1280, heap=490.0GB] 17/03/01 04:12:43 INFO cache.GridCacheProcessor: Started cache [name=WCAIgniteCache, mode=PARTITIONED] 17/03/01 04:12:43 INFO cache.GridCacheProcessor: Started cache [name=ignite-marshaller-sys-cache, mode=REPLICATED] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=fa09caab-f4dc-43b6-ac8b-4a4bae6e7da6, addrs=[01, 127.0.0.1], sockAddrs=[hostName/01:47500, /127.0.0.1:47500], discPort=47500, order=32, intOrder=32, lastExchangeTime=1488363162653, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=32, servers=32, clients=0, CPUs=1320, heap=500.0GB] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=af5837f0-25ec-4f3d-a1c1-90c09dc424cb, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=33, intOrder=33, lastExchangeTime=1488363162673, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=33, servers=33, clients=0, CPUs=1360, heap=520.0GB] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=e9e49d2d-5eeb-474f-8757-e447efc8ca8f, addrs=[6, 127.0.0.1], sockAddrs=[hostName/6:47500, /127.0.0.1:47500], discPort=47500, order=34, intOrder=34, lastExchangeTime=1488363162673, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=34, servers=34, clients=0, CPUs=1400, heap=530.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=26, minorTopVer=0], evt=NODE_JOINED, node=a6343860-6e84-4d9c-9b87-84ffd76280cd] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4b90e5a3-253a-435b-84ca-6b592610cf0c, addrs=[4, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/4:47500], discPort=47500, order=35, intOrder=35, lastExchangeTime=1488363162683, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=35, servers=35, clients=0, CPUs=1432, heap=550.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=27, minorTopVer=0], evt=NODE_JOINED, node=479b18e6-54af-4313-85f7-c7525f6229a4] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=8fd4eea2-2a45-4563-ae87-1848fd388a98, addrs=[3, 127.0.0.1], sockAddrs=[hostName/3:47500, /127.0.0.1:47500], discPort=47500, order=36, intOrder=36, lastExchangeTime=1488363162683, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=36, servers=36, clients=0, CPUs=1472, heap=560.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=28, minorTopVer=0], evt=NODE_JOINED, node=058a99e8-3b65-4ec9-84b0-6f3502c2afce] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=d7b45a02-0411-4028-acdf-f004e592f294, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=37, intOrder=37, lastExchangeTime=1488363162714, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=37, servers=37, clients=0, CPUs=1512, heap=580.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=29, minorTopVer=0], evt=NODE_JOINED, node=57c09d88-a4dc-4179-98b4-1144fd97d8cc] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=cf4e6e83-207e-42da-a55c-5621bc20b891, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=38, intOrder=38, lastExchangeTime=1488363162774, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=38, servers=38, clients=0, CPUs=1552, heap=590.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=30, minorTopVer=0], evt=NODE_JOINED, node=58298821-7aa9-4b58-ba15-e7f1ef2830fb] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=d8926a2c-2c00-4445-beb4-633c2d656c41, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=39, intOrder=39, lastExchangeTime=1488363162784, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=39, servers=39, clients=0, CPUs=1584, heap=610.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=31, minorTopVer=0], evt=NODE_JOINED, node=4d5de2f3-d975-4b28-b593-0cc0481cdc74] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4136a0c9-14d5-42b3-9a60-81689c800438, addrs=[3, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/3:47500], discPort=47500, order=40, intOrder=40, lastExchangeTime=1488363162996, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=40, servers=40, clients=0, CPUs=1624, heap=620.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=32, minorTopVer=0], evt=NODE_JOINED, node=fa09caab-f4dc-43b6-ac8b-4a4bae6e7da6] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=694a80b8-02a3-44c9-a2dd-45bed7d20a50, addrs=[1, 127.0.0.1], sockAddrs=[hostName/1:47500, /127.0.0.1:47500], discPort=47500, order=41, intOrder=41, lastExchangeTime=1488363163016, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=41, servers=41, clients=0, CPUs=1664, heap=640.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=33, minorTopVer=0], evt=NODE_JOINED, node=af5837f0-25ec-4f3d-a1c1-90c09dc424cb] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=34, minorTopVer=0], evt=NODE_JOINED, node=e9e49d2d-5eeb-474f-8757-e447efc8ca8f] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=35, minorTopVer=0], evt=NODE_JOINED, node=4b90e5a3-253a-435b-84ca-6b592610cf0c] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=36, minorTopVer=0], evt=NODE_JOINED, node=8fd4eea2-2a45-4563-ae87-1848fd388a98] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=37, minorTopVer=0], evt=NODE_JOINED, node=d7b45a02-0411-4028-acdf-f004e592f294] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=38, minorTopVer=0], evt=NODE_JOINED, node=cf4e6e83-207e-42da-a55c-5621bc20b891] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=39, minorTopVer=0], evt=NODE_JOINED, node=d8926a2c-2c00-4445-beb4-633c2d656c41] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=40, minorTopVer=0], evt=NODE_JOINED, node=4136a0c9-14d5-42b3-9a60-81689c800438] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-sys-cache, waitList=[]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-marshaller-sys-cache, waitList=[]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-atomics-sys-cache, waitList=[ignite-sys-cache, ignite-marshaller-sys-cache]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=WCAIgniteCache, waitList=[ignite-sys-cache, ignite-marshaller-sys-cache, ignite-atomics-sys-cache]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Rebalancing required [top=AffinityTopologyVersion [topVer=41, minorTopVer=0], evt=NODE_JOINED, node=694a80b8-02a3-44c9-a2dd-45bed7d20a50] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-marshaller-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=20, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=16] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=100, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=16] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-marshaller-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=20 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=20 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-atomics-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=29, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=16] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-atomics-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=0 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=WCAIgniteCache, mode=ASYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=29, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=16] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=WCAIgniteCache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=0 ms] 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: >>> +----------------------------------------------------------------------+ >>> Ignite ver. 1.8.0#20161205-sha1:9ca40dbeb7d559fcb299bdb6f5c90cdf8ce7e533 >>> +----------------------------------------------------------------------+ >>> OS name: Linux 2.6.32-431.5.1.el6.x86_64 amd64 >>> CPU(s): 40 >>> Heap: 15.0GB >>> VM name: 9507@hostName >>> Grid name: WCA >>> Local node [ID=A6343860-6E84-4D9C-9B87-84FFD76280CD, order=26, clientMode=false] >>> Local node addresses: [hostName/, /127.0.0.1] >>> Local ports: TCP:11211 TCP:47100 TCP:47500 TCP:48100 17/03/01 04:12:47 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=26, servers=26, clients=0, CPUs=1056, heap=410.0GB] 17/03/01 04:12:47 INFO resolver.CompanyResolverSparkTest: Started ignite node on executor 17/03/01 04:12:47 INFO executor.Executor: Finished task 10.0 in stage 4.0 (TID 132). 931 bytes result sent to driver 17/03/01 04:12:49 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 165 17/03/01 04:12:49 INFO executor.Executor: Running task 50.0 in stage 5.0 (TID 165) 17/03/01 04:12:49 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 128 17/03/01 04:12:49 INFO storage.MemoryStore: ensureFreeSpace(7311) called with curMem=12208, maxMem=8334920908 17/03/01 04:12:49 INFO storage.MemoryStore: Block broadcast_128_piece0 stored as bytes in memory (estimated size 7.1 KB, free 7.8 GB) 17/03/01 04:12:49 INFO broadcast.TorrentBroadcast: Reading broadcast variable 128 took 7 ms 17/03/01 04:12:49 INFO storage.MemoryStore: ensureFreeSpace(28168) called with curMem=19519, maxMem=8334920908 17/03/01 04:12:49 INFO storage.MemoryStore: Block broadcast_128 stored as values in memory (estimated size 27.5 KB, free 7.8 GB) 17/03/01 04:12:49 INFO rdd.HadoopRDD: Input split: avro path/part-r-00007-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:0+48153468 17/03/01 04:12:49 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 113 17/03/01 04:12:49 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=47687, maxMem=8334920908 17/03/01 04:12:49 INFO storage.MemoryStore: Block broadcast_113_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:12:49 INFO broadcast.TorrentBroadcast: Reading broadcast variable 113 took 7 ms 17/03/01 04:12:49 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=72330, maxMem=8334920908 17/03/01 04:12:49 INFO storage.MemoryStore: Block broadcast_113 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:12:49 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=41, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, node=6172ee3a-eb33-4bf5-9080-c255f52caed8] 17/03/01 04:12:57 INFO executor.Executor: Finished task 50.0 in stage 5.0 (TID 165). 2098 bytes result sent to driver 17/03/01 04:12:57 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 197 17/03/01 04:12:57 INFO executor.Executor: Running task 51.0 in stage 5.0 (TID 197) 17/03/01 04:12:57 INFO rdd.HadoopRDD: Input split: avro path/part-r-00007-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:48153468+48153468 17/03/01 04:13:06 INFO executor.Executor: Finished task 51.0 in stage 5.0 (TID 197). 2098 bytes result sent to driver 17/03/01 04:13:06 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 211 17/03/01 04:13:06 INFO executor.Executor: Running task 79.0 in stage 5.0 (TID 211) 17/03/01 04:13:06 INFO rdd.HadoopRDD: Input split: avro path/part-r-00017-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:37491126+37491126 17/03/01 04:13:06 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 127 17/03/01 04:13:06 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=407194, maxMem=8334920908 17/03/01 04:13:06 INFO storage.MemoryStore: Block broadcast_127_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:13:06 INFO broadcast.TorrentBroadcast: Reading broadcast variable 127 took 12 ms 17/03/01 04:13:06 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=431837, maxMem=8334920908 17/03/01 04:13:06 INFO storage.MemoryStore: Block broadcast_127 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:13:12 INFO executor.Executor: Finished task 79.0 in stage 5.0 (TID 211). 2098 bytes result sent to driver 17/03/01 04:13:33 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 237 17/03/01 04:13:33 INFO executor.Executor: Running task 31.0 in stage 5.0 (TID 237) 17/03/01 04:13:33 INFO rdd.HadoopRDD: Input split: avro path/part-r-00027-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:58976207+58976208 17/03/01 04:13:33 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 103 17/03/01 04:13:33 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=778909, maxMem=8334920908 17/03/01 04:13:33 INFO storage.MemoryStore: Block broadcast_103_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:13:33 INFO broadcast.TorrentBroadcast: Reading broadcast variable 103 took 21 ms 17/03/01 04:13:33 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=803552, maxMem=8334920908 17/03/01 04:13:33 INFO storage.MemoryStore: Block broadcast_103 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:13:43 INFO executor.Executor: Finished task 31.0 in stage 5.0 (TID 237). 2098 bytes result sent to driver 17/03/01 04:13:47 INFO internal.IgniteKernal%WCA: Metrics for local node (to disable set 'metricsLogFrequency' to 0) ^-- Node [id=a6343860, name=WCA, uptime=00:01:00:007] ^-- H/N/C [hosts=41, nodes=41, CPUs=1664] ^-- CPU [cur=1.43%, avg=4.88%, GC=0%] ^-- Heap [used=3230MB, free=77.4%, comm=14294MB] ^-- Non heap [used=120MB, free=-1%, comm=122MB] ^-- Public thread pool [active=0, idle=0, qSize=0] ^-- System thread pool [active=0, idle=80, qSize=0] ^-- Outbound messages queue [size=0] 17/03/01 04:13:53 INFO cluster.GridUpdateNotifier: Update status is not available. 17/03/01 04:14:00 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 275 17/03/01 04:14:00 INFO executor.Executor: Running task 31.0 in stage 7.0 (TID 275) 17/03/01 04:14:00 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 131 17/03/01 04:14:00 INFO storage.MemoryStore: ensureFreeSpace(2732) called with curMem=1150624, maxMem=8334920908 17/03/01 04:14:00 INFO storage.MemoryStore: Block broadcast_131_piece0 stored as bytes in memory (estimated size 2.7 KB, free 7.8 GB) 17/03/01 04:14:00 INFO broadcast.TorrentBroadcast: Reading broadcast variable 131 took 23 ms 17/03/01 04:14:00 INFO storage.MemoryStore: ensureFreeSpace(7336) called with curMem=1153356, maxMem=8334920908 17/03/01 04:14:00 INFO storage.MemoryStore: Block broadcast_131 stored as values in memory (estimated size 7.2 KB, free 7.8 GB) 17/03/01 04:14:00 INFO dao.CompanyDAO: testing[ipaddress:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509] 17/03/01 04:14:00 INFO dao.CompanyDAO: input company name inside Contains searchMIDWEST COMMUNITY BANCSHARES 17/03/01 04:14:09 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=e9e49d2d-5eeb-474f-8757-e447efc8ca8f, taskHash=0], locFut=null, sndId=e9e49d2d-5eeb-474f-8757-e447efc8ca8f, reqId=352, incMeta=false, all=false], node=a6343860-6e84-4d9c-9b87-84ffd76280cd] java.lang.NullPointerException at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneFile.numBuffers(GridLuceneFile.java:109) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneInputStream.switchCurrentBuffer(GridLuceneInputStream.java:132) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneInputStream.seek(GridLuceneInputStream.java:224) at org.apache.lucene.index.CompoundFileReader$CSIndexInput.readInternal(CompoundFileReader.java:273) at org.apache.lucene.store.BufferedIndexInput.refill(BufferedIndexInput.java:229) at org.apache.lucene.store.BufferedIndexInput.readByte(BufferedIndexInput.java:39) at org.apache.lucene.store.DataInput.readInt(DataInput.java:84) at org.apache.lucene.store.BufferedIndexInput.readInt(BufferedIndexInput.java:169) at org.apache.lucene.store.DataInput.readLong(DataInput.java:126) at org.apache.lucene.store.BufferedIndexInput.readLong(BufferedIndexInput.java:182) at org.apache.lucene.index.FieldsReader.doc(FieldsReader.java:231) at org.apache.lucene.index.SegmentReader.document(SegmentReader.java:477) at org.apache.lucene.index.DirectoryReader.document(DirectoryReader.java:583) at org.apache.lucene.index.IndexReader.document(IndexReader.java:1115) at org.apache.lucene.search.IndexSearcher.doc(IndexSearcher.java:258) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneIndex$It.findNext(GridLuceneIndex.java:383) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneIndex$It.onNext(GridLuceneIndex.java:415) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneIndex$It.onNext(GridLuceneIndex.java:299) at org.apache.ignite.internal.util.GridCloseableIteratorAdapter.nextX(GridCloseableIteratorAdapter.java:41) at org.apache.ignite.internal.util.lang.GridIteratorAdapter.next(GridIteratorAdapter.java:35) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryManager.runQuery(GridCacheQueryManager.java:1512) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.processQueryRequest(GridCacheDistributedQueryManager.java:230) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$2.apply(GridCacheDistributedQueryManager.java:108) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$2.apply(GridCacheDistributedQueryManager.java:106) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.processMessage(GridCacheIoManager.java:827) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.onMessage0(GridCacheIoManager.java:369) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.handleMessage(GridCacheIoManager.java:293) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.access$000(GridCacheIoManager.java:95) at org.apache.ignite.internal.processors.cache.GridCacheIoManager$1.onMessage(GridCacheIoManager.java:238) at org.apache.ignite.internal.managers.communication.GridIoManager.invokeListener(GridIoManager.java:1082) at org.apache.ignite.internal.managers.communication.GridIoManager.processRegularMessage0(GridIoManager.java:710) at org.apache.ignite.internal.managers.communication.GridIoManager.access$1700(GridIoManager.java:102) at org.apache.ignite.internal.managers.communication.GridIoManager$5.run(GridIoManager.java:673) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 17/03/01 04:14:10 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=47c1a0d8-9d4d-4d0d-9b27-388bd7f49278, taskHash=0], locFut=null, sndId=47c1a0d8-9d4d-4d0d-9b27-388bd7f49278, reqId=369, incMeta=false, all=false], node=a6343860-6e84-4d9c-9b87-84ffd76280cd] java.lang.NullPointerException at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneFile.numBuffers(GridLuceneFile.java:109) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneInputStream.switchCurrentBuffer(GridLuceneInputStream.java:132) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneInputStream.seek(GridLuceneInputStream.java:224) at org.apache.lucene.index.CompoundFileReader$CSIndexInput.readInternal(CompoundFileReader.java:273) at org.apache.lucene.store.BufferedIndexInput.refill(BufferedIndexInput.java:229) at org.apache.lucene.store.BufferedIndexInput.readByte(BufferedIndexInput.java:39) at org.apache.lucene.store.DataInput.readVInt(DataInput.java:105) at org.apache.lucene.store.BufferedIndexInput.readVInt(BufferedIndexInput.java:197) at org.apache.lucene.index.FieldsReader.doc(FieldsReader.java:235) at org.apache.lucene.index.SegmentReader.document(SegmentReader.java:477) at org.apache.lucene.index.DirectoryReader.document(DirectoryReader.java:583) at org.apache.lucene.index.IndexReader.document(IndexReader.java:1115) at org.apache.lucene.search.IndexSearcher.doc(IndexSearcher.java:258) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneIndex$It.findNext(GridLuceneIndex.java:383) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneIndex$It.onNext(GridLuceneIndex.java:415) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneIndex$It.onNext(GridLuceneIndex.java:299) at org.apache.ignite.internal.util.GridCloseableIteratorAdapter.nextX(GridCloseableIteratorAdapter.java:41) at org.apache.ignite.internal.util.lang.GridIteratorAdapter.next(GridIteratorAdapter.java:35) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryManager.runQuery(GridCacheQueryManager.java:1512) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.processQueryRequest(GridCacheDistributedQueryManager.java:230) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$2.apply(GridCacheDistributedQueryManager.java:108) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$2.apply(GridCacheDistributedQueryManager.java:106) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.processMessage(GridCacheIoManager.java:827) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.onMessage0(GridCacheIoManager.java:369) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.handleMessage(GridCacheIoManager.java:293) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.access$000(GridCacheIoManager.java:95) at org.apache.ignite.internal.processors.cache.GridCacheIoManager$1.onMessage(GridCacheIoManager.java:238) at org.apache.ignite.internal.managers.communication.GridIoManager.invokeListener(GridIoManager.java:1082) at org.apache.ignite.internal.managers.communication.GridIoManager.processRegularMessage0(GridIoManager.java:710) at org.apache.ignite.internal.managers.communication.GridIoManager.access$1700(GridIoManager.java:102) at org.apache.ignite.internal.managers.communication.GridIoManager$5.run(GridIoManager.java:673) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 17/03/01 04:14:10 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=90db2cab-26f6-463d-9755-d03d059a8723, taskHash=0], locFut=null, sndId=90db2cab-26f6-463d-9755-d03d059a8723, reqId=543, incMeta=false, all=false], node=a6343860-6e84-4d9c-9b87-84ffd76280cd] java.lang.NullPointerException at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneFile.numBuffers(GridLuceneFile.java:109) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneInputStream.switchCurrentBuffer(GridLuceneInputStream.java:132) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneInputStream.seek(GridLuceneInputStream.java:224) at org.apache.lucene.index.CompoundFileReader$CSIndexInput.readInternal(CompoundFileReader.java:273) at org.apache.lucene.store.BufferedIndexInput.refill(BufferedIndexInput.java:229) at org.apache.lucene.store.BufferedIndexInput.readByte(BufferedIndexInput.java:39) at org.apache.lucene.store.DataInput.readVInt(DataInput.java:105) at org.apache.lucene.store.BufferedIndexInput.readVInt(BufferedIndexInput.java:197) at org.apache.lucene.index.FieldsReader.doc(FieldsReader.java:235) at org.apache.lucene.index.SegmentReader.document(SegmentReader.java:477) at org.apache.lucene.index.DirectoryReader.document(DirectoryReader.java:583) at org.apache.lucene.index.IndexReader.document(IndexReader.java:1115) at org.apache.lucene.search.IndexSearcher.doc(IndexSearcher.java:258) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneIndex$It.findNext(GridLuceneIndex.java:383) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneIndex$It.onNext(GridLuceneIndex.java:415) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneIndex$It.onNext(GridLuceneIndex.java:299) at org.apache.ignite.internal.util.GridCloseableIteratorAdapter.nextX(GridCloseableIteratorAdapter.java:41) at org.apache.ignite.internal.util.lang.GridIteratorAdapter.next(GridIteratorAdapter.java:35) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryManager.runQuery(GridCacheQueryManager.java:1512) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.processQueryRequest(GridCacheDistributedQueryManager.java:230) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$2.apply(GridCacheDistributedQueryManager.java:108) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$2.apply(GridCacheDistributedQueryManager.java:106) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.processMessage(GridCacheIoManager.java:827) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.onMessage0(GridCacheIoManager.java:369) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.handleMessage(GridCacheIoManager.java:293) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.access$000(GridCacheIoManager.java:95) at org.apache.ignite.internal.processors.cache.GridCacheIoManager$1.onMessage(GridCacheIoManager.java:238) at org.apache.ignite.internal.managers.communication.GridIoManager.invokeListener(GridIoManager.java:1082) at org.apache.ignite.internal.managers.communication.GridIoManager.processRegularMessage0(GridIoManager.java:710) at org.apache.ignite.internal.managers.communication.GridIoManager.access$1700(GridIoManager.java:102) at org.apache.ignite.internal.managers.communication.GridIoManager$5.run(GridIoManager.java:673) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 17/03/01 04:14:10 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=717de453-fc6b-4a46-91b2-b5c54ab8a4be, taskHash=0], locFut=null, sndId=717de453-fc6b-4a46-91b2-b5c54ab8a4be, reqId=297, incMeta=false, all=false], node=a6343860-6e84-4d9c-9b87-84ffd76280cd] java.lang.NullPointerException 17/03/01 04:14:10 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=ddc47224-d030-4d1f-ba66-08f61368a395, taskHash=0], locFut=null, sndId=ddc47224-d030-4d1f-ba66-08f61368a395, reqId=411, incMeta=false, all=false], node=a6343860-6e84-4d9c-9b87-84ffd76280cd] java.lang.NullPointerException 17/03/01 04:14:10 ERROR executor.Executor: Exception in task 31.0 in stage 7.0 (TID 275) javax.cache.CacheException: class org.apache.ignite.IgniteCheckedException: Query execution failed: GridCacheQueryBean [qry=GridCacheQueryAdapter [type=TEXT, clsName=CompanyVO1, clause=MIDWEST COMMUNITY BANCSHARES, filter=null, transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=true, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=a6343860-6e84-4d9c-9b87-84ffd76280cd, taskHash=0], rdc=null, trans=null] at org.apache.ignite.internal.processors.cache.GridCacheUtils.convertToCacheException(GridCacheUtils.java:1440) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.next(GridCacheQueryFutureAdapter.java:174) at org.apache.ignite.internal.processors.cache.IgniteCacheProxy$5.onHasNext(IgniteCacheProxy.java:600) at org.apache.ignite.internal.util.GridCloseableIteratorAdapter.hasNextX(GridCloseableIteratorAdapter.java:53) at org.apache.ignite.internal.util.lang.GridIteratorAdapter.hasNext(GridIteratorAdapter.java:45) at un.api.resolver.dao.CompanyDAO.getVarCompContains(CompanyDAO.scala:242) at un.api.resolver.accessor.CompanyAccessor.getVarCompContains(CompanyAccessor.scala:27) at un.api.resolver.CompanyResolverSparkTest$$anonfun$main$7.apply(CompanyResolverSparkTest.scala:291) at un.api.resolver.CompanyResolverSparkTest$$anonfun$main$7.apply(CompanyResolverSparkTest.scala:289) at scala.collection.Iterator$$anon$11.next(Iterator.scala:328) at org.apache.spark.util.Utils$.getIteratorSize(Utils.scala:1554) at org.apache.spark.rdd.RDD$$anonfun$count$1.apply(RDD.scala:1121) at org.apache.spark.rdd.RDD$$anonfun$count$1.apply(RDD.scala:1121) at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1850) at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1850) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:66) at org.apache.spark.scheduler.Task.run(Task.scala:88) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:214) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: class org.apache.ignite.IgniteCheckedException: Query execution failed: GridCacheQueryBean [qry=GridCacheQueryAdapter [type=TEXT, clsName=CompanyVO1, clause=MIDWEST COMMUNITY BANCSHARES, filter=null, transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=true, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=a6343860-6e84-4d9c-9b87-84ffd76280cd, taskHash=0], rdc=null, trans=null] at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.checkError(GridCacheQueryFutureAdapter.java:260) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.internalIterator(GridCacheQueryFutureAdapter.java:318) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.next(GridCacheQueryFutureAdapter.java:164) ... 19 more Caused by: class org.apache.ignite.IgniteCheckedException: Failed to execute query on node [query=GridCacheQueryBean [qry=GridCacheQueryAdapter [type=TEXT, clsName=CompanyVO1, clause=MIDWEST COMMUNITY BANCSHARES, filter=null, transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=true, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=a6343860-6e84-4d9c-9b87-84ffd76280cd, taskHash=0], rdc=null, trans=null], nodeId=23f61699-e2c9-4ff6-8731-2483934e84c4] at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.onPage(GridCacheQueryFutureAdapter.java:383) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.processQueryResponse(GridCacheDistributedQueryManager.java:398) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.access$000(GridCacheDistributedQueryManager.java:63) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$1.apply(GridCacheDistributedQueryManager.java:93) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$1.apply(GridCacheDistributedQueryManager.java:91) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.processMessage(GridCacheIoManager.java:827) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.onMessage0(GridCacheIoManager.java:369) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.access$400(GridCacheIoManager.java:95) at org.apache.ignite.internal.processors.cache.GridCacheIoManager$OrderedMessageListener.onMessage(GridCacheIoManager.java:1345) at org.apache.ignite.internal.managers.communication.GridIoManager.invokeListener(GridIoManager.java:1082) at org.apache.ignite.internal.managers.communication.GridIoManager.access$1600(GridIoManager.java:102) at org.apache.ignite.internal.managers.communication.GridIoManager$GridCommunicationMessageSet.unwind(GridIoManager.java:2332) at org.apache.ignite.internal.managers.communication.GridIoManager.unwindMessageSet(GridIoManager.java:1042) at org.apache.ignite.internal.managers.communication.GridIoManager.access$1900(GridIoManager.java:102) at org.apache.ignite.internal.managers.communication.GridIoManager$6.run(GridIoManager.java:1011) ... 3 more Caused by: java.lang.NullPointerException at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneFile.numBuffers(GridLuceneFile.java:109) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneInputStream.switchCurrentBuffer(GridLuceneInputStream.java:132) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneInputStream.seek(GridLuceneInputStream.java:224) at org.apache.lucene.index.FieldsReader.doc(FieldsReader.java:232) at org.apache.lucene.index.SegmentReader.document(SegmentReader.java:477) at org.apache.lucene.index.DirectoryReader.document(DirectoryReader.java:583) at org.apache.lucene.index.IndexReader.document(IndexReader.java:1115) at org.apache.lucene.search.IndexSearcher.doc(IndexSearcher.java:258) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneIndex$It.findNext(GridLuceneIndex.java:383) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneIndex$It.onNext(GridLuceneIndex.java:415) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneIndex$It.onNext(GridLuceneIndex.java:299) at org.apache.ignite.internal.util.GridCloseableIteratorAdapter.nextX(GridCloseableIteratorAdapter.java:41) at org.apache.ignite.internal.util.lang.GridIteratorAdapter.next(GridIteratorAdapter.java:35) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryManager.runQuery(GridCacheQueryManager.java:1512) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.processQueryRequest(GridCacheDistributedQueryManager.java:230) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$2.apply(GridCacheDistributedQueryManager.java:108) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$2.apply(GridCacheDistributedQueryManager.java:106) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.processMessage(GridCacheIoManager.java:827) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.onMessage0(GridCacheIoManager.java:369) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.handleMessage(GridCacheIoManager.java:293) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.access$000(GridCacheIoManager.java:95) at org.apache.ignite.internal.processors.cache.GridCacheIoManager$1.onMessage(GridCacheIoManager.java:238) at org.apache.ignite.internal.managers.communication.GridIoManager.invokeListener(GridIoManager.java:1082) at org.apache.ignite.internal.managers.communication.GridIoManager.processRegularMessage0(GridIoManager.java:710) at org.apache.ignite.internal.managers.communication.GridIoManager.access$1700(GridIoManager.java:102) at org.apache.ignite.internal.managers.communication.GridIoManager$5.run(GridIoManager.java:673) ... 3 more 17/03/01 04:14:10 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=c4f4f6bb-b71a-4a29-9575-afee2ddc1b2d, res=GridCacheQueryResponse [finished=false, reqId=478, err=null, fields=false, metadata=null]] 17/03/01 04:14:10 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=8be1bd05-d62c-4f1a-83f2-91dcb3f3b62a, res=GridCacheQueryResponse [finished=false, reqId=478, err=null, fields=false, metadata=null]] 17/03/01 04:14:10 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=57c09d88-a4dc-4179-98b4-1144fd97d8cc, res=GridCacheQueryResponse [finished=false, reqId=478, err=null, fields=false, metadata=null]] 17/03/01 04:14:10 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=3e101db5-8c5c-47b7-bbdb-a9a892c4bada, res=GridCacheQueryResponse [finished=false, reqId=478, err=null, fields=false, metadata=null]] 17/03/01 04:14:10 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=d8926a2c-2c00-4445-beb4-633c2d656c41, res=GridCacheQueryResponse [finished=false, reqId=478, err=null, fields=false, metadata=null]] 17/03/01 04:14:10 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=d4a9fe7f-de19-4df7-874c-a084da78562f, taskHash=0], locFut=null, sndId=d4a9fe7f-de19-4df7-874c-a084da78562f, reqId=382, incMeta=false, all=false], node=a6343860-6e84-4d9c-9b87-84ffd76280cd] java.lang.NullPointerException 17/03/01 04:14:10 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=058a99e8-3b65-4ec9-84b0-6f3502c2afce, taskHash=0], locFut=null, sndId=058a99e8-3b65-4ec9-84b0-6f3502c2afce, reqId=359, incMeta=false, all=false], node=a6343860-6e84-4d9c-9b87-84ffd76280cd] java.lang.NullPointerException 17/03/01 04:14:10 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 289 17/03/01 04:14:10 INFO executor.Executor: Running task 31.1 in stage 7.0 (TID 289) 17/03/01 04:14:10 INFO dao.CompanyDAO: testing[ipaddress:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509] 17/03/01 04:14:10 INFO dao.CompanyDAO: input company name inside Contains searchMIDWEST COMMUNITY BANCSHARES 17/03/01 04:14:11 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=d8926a2c-2c00-4445-beb4-633c2d656c41, taskHash=0], locFut=null, sndId=d8926a2c-2c00-4445-beb4-633c2d656c41, reqId=385, incMeta=false, all=false], node=a6343860-6e84-4d9c-9b87-84ffd76280cd] java.lang.NullPointerException 17/03/01 04:14:11 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=90532831-88fb-4eb8-adc9-db7a86744869, taskHash=0], locFut=null, sndId=90532831-88fb-4eb8-adc9-db7a86744869, reqId=385, incMeta=false, all=false], node=a6343860-6e84-4d9c-9b87-84ffd76280cd] java.lang.NullPointerException 17/03/01 04:14:11 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=fa09caab-f4dc-43b6-ac8b-4a4bae6e7da6, taskHash=0], locFut=null, sndId=fa09caab-f4dc-43b6-ac8b-4a4bae6e7da6, reqId=5786, incMeta=false, all=false], node=a6343860-6e84-4d9c-9b87-84ffd76280cd] java.lang.NullPointerException 17/03/01 04:14:11 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=8fd4eea2-2a45-4563-ae87-1848fd388a98, taskHash=0], locFut=null, sndId=8fd4eea2-2a45-4563-ae87-1848fd388a98, reqId=268, incMeta=false, all=false], node=a6343860-6e84-4d9c-9b87-84ffd76280cd] java.lang.NullPointerException 17/03/01 04:14:11 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=3e101db5-8c5c-47b7-bbdb-a9a892c4bada, taskHash=0], locFut=null, sndId=3e101db5-8c5c-47b7-bbdb-a9a892c4bada, reqId=581, incMeta=false, all=false], node=a6343860-6e84-4d9c-9b87-84ffd76280cd] java.lang.NullPointerException 17/03/01 04:14:11 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=daed0152-83fc-4828-ada6-64c74787b190, taskHash=0], locFut=null, sndId=daed0152-83fc-4828-ada6-64c74787b190, reqId=381, incMeta=false, all=false], node=a6343860-6e84-4d9c-9b87-84ffd76280cd] java.lang.NullPointerException 17/03/01 04:14:11 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=e87f12ce-5981-4418-8468-f6bfed0a0cd8, taskHash=0], locFut=null, sndId=e87f12ce-5981-4418-8468-f6bfed0a0cd8, reqId=369, incMeta=false, all=false], node=a6343860-6e84-4d9c-9b87-84ffd76280cd] java.lang.NullPointerException 17/03/01 04:14:11 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=9fb6e583-cea0-4f78-b403-b403a8bc9a0e, taskHash=0], locFut=null, sndId=9fb6e583-cea0-4f78-b403-b403a8bc9a0e, reqId=364, incMeta=false, all=false], node=a6343860-6e84-4d9c-9b87-84ffd76280cd] java.lang.NullPointerException 17/03/01 04:14:11 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=5bc51e21-1dcf-498a-b87e-6dd24f7e36ad, taskHash=0], locFut=null, sndId=5bc51e21-1dcf-498a-b87e-6dd24f7e36ad, reqId=420, incMeta=false, all=false], node=a6343860-6e84-4d9c-9b87-84ffd76280cd] java.lang.NullPointerException 17/03/01 04:14:11 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=133c388f-3399-4cc8-b2f1-7ae8ba971b03, taskHash=0], locFut=null, sndId=133c388f-3399-4cc8-b2f1-7ae8ba971b03, reqId=376, incMeta=false, all=false], node=a6343860-6e84-4d9c-9b87-84ffd76280cd] java.lang.NullPointerException 17/03/01 04:14:11 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=af5837f0-25ec-4f3d-a1c1-90c09dc424cb, taskHash=0], locFut=null, sndId=af5837f0-25ec-4f3d-a1c1-90c09dc424cb, reqId=393, incMeta=false, all=false], node=a6343860-6e84-4d9c-9b87-84ffd76280cd] java.lang.NullPointerException 17/03/01 04:14:11 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=694a80b8-02a3-44c9-a2dd-45bed7d20a50, taskHash=0], locFut=null, sndId=694a80b8-02a3-44c9-a2dd-45bed7d20a50, reqId=262, incMeta=false, all=false], node=a6343860-6e84-4d9c-9b87-84ffd76280cd] java.lang.NullPointerException 17/03/01 04:14:11 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=ffe19475-7849-4027-8648-ce56598ff50f, taskHash=0], locFut=null, sndId=ffe19475-7849-4027-8648-ce56598ff50f, reqId=417, incMeta=false, all=false], node=a6343860-6e84-4d9c-9b87-84ffd76280cd] java.lang.NullPointerException 17/03/01 04:14:11 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=d7b45a02-0411-4028-acdf-f004e592f294, taskHash=0], locFut=null, sndId=d7b45a02-0411-4028-acdf-f004e592f294, reqId=349, incMeta=false, all=false], node=a6343860-6e84-4d9c-9b87-84ffd76280cd] java.lang.NullPointerException 17/03/01 04:14:11 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=c4f4f6bb-b71a-4a29-9575-afee2ddc1b2d, taskHash=0], locFut=null, sndId=c4f4f6bb-b71a-4a29-9575-afee2ddc1b2d, reqId=289, incMeta=false, all=false], node=a6343860-6e84-4d9c-9b87-84ffd76280cd] java.lang.NullPointerException 17/03/01 04:14:11 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=40d089f0-7c80-4f1f-8659-350791f57a4c, taskHash=0], locFut=null, sndId=40d089f0-7c80-4f1f-8659-350791f57a4c, reqId=502, incMeta=false, all=false], node=a6343860-6e84-4d9c-9b87-84ffd76280cd] java.lang.NullPointerException 17/03/01 04:14:11 ERROR query.GridCacheDistributedQueryManager: Failed to run query [qry=GridCacheQueryInfo [loc=false, trans=null, rdc=null, qry=GridCacheQueryAdapter [type=null, clsName=null, clause=null, filter=null, transform=null, part=0, incMeta=false, metrics=null, pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=95f164b5-4b73-438f-804f-62854d615b5b, taskHash=0], locFut=null, sndId=95f164b5-4b73-438f-804f-62854d615b5b, reqId=413, incMeta=false, all=false], node=a6343860-6e84-4d9c-9b87-84ffd76280cd] java.lang.NullPointerException 17/03/01 04:14:20 INFO executor.Executor: Finished task 31.1 in stage 7.0 (TID 289). 969 bytes result sent to driver 17/03/01 04:14:47 INFO internal.IgniteKernal%WCA: Metrics for local node (to disable set 'metricsLogFrequency' to 0) ^-- Node [id=a6343860, name=WCA, uptime=00:02:00:019] ^-- H/N/C [hosts=41, nodes=41, CPUs=1664] ^-- CPU [cur=0.2%, avg=3.31%, GC=0%] ^-- Heap [used=2085MB, free=85.79%, comm=14669MB] ^-- Non heap [used=125MB, free=-1%, comm=127MB] ^-- Public thread pool [active=0, idle=0, qSize=0] ^-- System thread pool [active=0, idle=80, qSize=0] ^-- Outbound messages queue [size=0] 17/03/01 04:14:49 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 337 17/03/01 04:14:49 INFO executor.Executor: Running task 24.0 in stage 8.0 (TID 337) 17/03/01 04:14:49 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 132 17/03/01 04:14:49 INFO storage.MemoryStore: ensureFreeSpace(887) called with curMem=1160692, maxMem=8334920908 17/03/01 04:14:49 INFO storage.MemoryStore: Block broadcast_132_piece0 stored as bytes in memory (estimated size 887.0 B, free 7.8 GB) 17/03/01 04:14:49 INFO broadcast.TorrentBroadcast: Reading broadcast variable 132 took 15 ms 17/03/01 04:14:49 INFO storage.MemoryStore: ensureFreeSpace(1216) called with curMem=1161579, maxMem=8334920908 17/03/01 04:14:49 INFO storage.MemoryStore: Block broadcast_132 stored as values in memory (estimated size 1216.0 B, free 7.8 GB) 17/03/01 04:14:49 INFO tcp.GridTcpRestProtocol: Command protocol successfully stopped: TCP binary 17/03/01 04:14:51 INFO cache.GridCacheProcessor: Stopped cache: ignite-marshaller-sys-cache 17/03/01 04:14:51 INFO cache.GridCacheProcessor: Stopped cache: ignite-sys-cache 17/03/01 04:14:51 INFO cache.GridCacheProcessor: Stopped cache: ignite-atomics-sys-cache 17/03/01 04:14:51 INFO cache.GridCacheProcessor: Stopped cache: WCAIgniteCache 17/03/01 04:14:51 INFO internal.IgniteKernal%WCA: >>> +---------------------------------------------------------------------------------+ >>> Ignite ver. 1.8.0#20161205-sha1:9ca40dbeb7d559fcb299bdb6f5c90cdf8ce7e533 stopped OK >>> +---------------------------------------------------------------------------------+ >>> Grid name: WCA >>> Grid uptime: 00:02:04:200 17/03/01 04:14:51 INFO executor.Executor: Finished task 24.0 in stage 8.0 (TID 337). 931 bytes result sent to driver 17/03/01 04:14:53 INFO executor.CoarseGrainedExecutorBackend: Driver commanded a shutdown 17/03/01 04:14:53 INFO storage.MemoryStore: MemoryStore cleared 17/03/01 04:14:53 INFO storage.BlockManager: BlockManager stopped 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Shutting down remote daemon. 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remote daemon shut down; proceeding with flushing remote transports. 17/03/01 04:14:53 INFO Remoting: Remoting shut down 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remoting shut down. 17/03/01 04:14:53 INFO util.ShutdownHookManager: Shutdown hook called LogType:stdout Log Upload Time:Wed Mar 01 04:14:58 -0600 2017 LogLength:2437 Log Contents: rEnd of the programe - [04:12:38] __________ ________________ [04:12:38] / _/ ___/ |/ / _/_ __/ __/ [04:12:38] _/ // (7 7 // / / / / _/ [04:12:38] /___/\___/_/|_/___/ /_/ /___/ [04:12:38] [04:12:38] ver. 1.8.0#20161205-sha1:9ca40dbe [04:12:38] 2016 Copyright(C) Apache Software Foundation [04:12:38] [04:12:38] Ignite documentation: http://ignite.apache.org [04:12:38] [04:12:38] Quiet mode. [04:12:38] ^-- To see **FULL** console log here add -DIGNITE_QUIET=false or "-v" to ignite.{sh|bat} [04:12:38] [04:12:38] OS: Linux 2.6.32-431.5.1.el6.x86_64 amd64 [04:12:38] VM information: Java(TM) SE Runtime Environment 1.8.0_60-b27 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.60-b23 [04:12:38] Configured plugins: [04:12:38] ^-- None [04:12:38] [04:12:38] Security status [authentication=off, tls/ssl=off] [04:12:43] Topology snapshot [ver=27, servers=27, clients=0, CPUs=1104, heap=430.0GB] [04:12:43] Topology snapshot [ver=28, servers=28, clients=0, CPUs=1144, heap=440.0GB] [04:12:43] Topology snapshot [ver=29, servers=29, clients=0, CPUs=1192, heap=460.0GB] [04:12:43] Topology snapshot [ver=30, servers=30, clients=0, CPUs=1232, heap=470.0GB] [04:12:43] Topology snapshot [ver=31, servers=31, clients=0, CPUs=1280, heap=490.0GB] [04:12:43] Topology snapshot [ver=32, servers=32, clients=0, CPUs=1320, heap=500.0GB] [04:12:44] Topology snapshot [ver=33, servers=33, clients=0, CPUs=1360, heap=520.0GB] [04:12:44] Topology snapshot [ver=34, servers=34, clients=0, CPUs=1400, heap=530.0GB] [04:12:44] Topology snapshot [ver=35, servers=35, clients=0, CPUs=1432, heap=550.0GB] [04:12:44] Topology snapshot [ver=36, servers=36, clients=0, CPUs=1472, heap=560.0GB] [04:12:44] Topology snapshot [ver=37, servers=37, clients=0, CPUs=1512, heap=580.0GB] [04:12:44] Topology snapshot [ver=38, servers=38, clients=0, CPUs=1552, heap=590.0GB] [04:12:45] Topology snapshot [ver=39, servers=39, clients=0, CPUs=1584, heap=610.0GB] [04:12:45] Topology snapshot [ver=40, servers=40, clients=0, CPUs=1624, heap=620.0GB] [04:12:45] Topology snapshot [ver=41, servers=41, clients=0, CPUs=1664, heap=640.0GB] [04:12:47] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [04:12:47] [04:12:47] Ignite node started OK (id=a6343860, grid=WCA) [04:12:47] Topology snapshot [ver=26, servers=26, clients=0, CPUs=1056, heap=410.0GB] [04:14:51] Ignite node stopped OK [name=WCA, uptime=00:02:04:200] Container: container_e76_1487862040010_131981_01_000019 on hostName_8041 =========================================================================================== LogType:stderr Log Upload Time:Wed Mar 01 04:14:58 -0600 2017 LogLength:60854 Log Contents: 17/03/01 04:10:59 INFO executor.CoarseGrainedExecutorBackend: Registered signal handlers for [TERM, HUP, INT] 17/03/01 04:10:59 INFO spark.SecurityManager: Changing view acls to: userName 17/03/01 04:10:59 INFO spark.SecurityManager: Changing modify acls to: userName 17/03/01 04:10:59 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(userName); users with modify permissions: Set(userName) 17/03/01 04:11:00 INFO slf4j.Slf4jLogger: Slf4jLogger started 17/03/01 04:11:00 INFO Remoting: Starting remoting 17/03/01 04:11:00 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://driverPropsFetcher@hostName:48806] 17/03/01 04:11:00 INFO Remoting: Remoting now listens on addresses: [akka.tcp://driverPropsFetcher@hostName:48806] 17/03/01 04:11:00 INFO util.Utils: Successfully started service 'driverPropsFetcher' on port 48806. 17/03/01 04:11:00 INFO spark.SecurityManager: Changing view acls to: userName 17/03/01 04:11:00 INFO spark.SecurityManager: Changing modify acls to: userName 17/03/01 04:11:00 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(userName); users with modify permissions: Set(userName) 17/03/01 04:11:00 INFO remote.RemoteActorRefProvider$RemotingTerminator: Shutting down remote daemon. 17/03/01 04:11:00 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remote daemon shut down; proceeding with flushing remote transports. 17/03/01 04:11:00 INFO slf4j.Slf4jLogger: Slf4jLogger started 17/03/01 04:11:00 INFO Remoting: Remoting shut down 17/03/01 04:11:00 INFO Remoting: Starting remoting 17/03/01 04:11:00 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remoting shut down. 17/03/01 04:11:00 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://sparkExecutor@hostName:53843] 17/03/01 04:11:00 INFO Remoting: Remoting now listens on addresses: [akka.tcp://sparkExecutor@hostName:53843] 17/03/01 04:11:00 INFO util.Utils: Successfully started service 'sparkExecutor' on port 53843. 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/1/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-8081f5bf-f5e0-4250-ab98-fce35a34bc0b 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/2/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-a6911b9a-ed84-404c-b96d-f7f7e385e242 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/3/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-f3523687-5f8c-4434-8cf1-ab4daaa84f9d 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/4/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-5a000667-6241-41ea-92de-1c2c7331b684 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/5/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-785df797-0fb6-4bfd-a68b-b831e374221c 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/6/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-aff6154f-73be-4fff-8c0e-ff046f9c4ae3 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/7/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-adbe5cc8-1e65-4166-9380-2da9f310e88b 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/8/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-7199bd09-17ca-4827-8aa3-204867a26de4 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/9/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-a8dee90c-7dfb-4bee-95db-7b3568ed006c 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/10/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-20412ba9-3462-4a5f-9dc6-a40383b0617d 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/11/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-b549de9a-fc68-4af8-8eea-b93ada8e5962 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/12/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-05cfef61-b640-4524-98d1-e68c0264e2ea 17/03/01 04:11:00 INFO storage.MemoryStore: MemoryStore started with capacity 7.8 GB 17/03/01 04:11:00 INFO executor.CoarseGrainedExecutorBackend: Connecting to driver: akka.tcp://sparkDriver@ipaddress:38995/user/CoarseGrainedScheduler 17/03/01 04:11:01 INFO executor.CoarseGrainedExecutorBackend: Successfully registered with driver 17/03/01 04:11:01 INFO executor.Executor: Starting executor ID 16 on host hostName 17/03/01 04:11:01 INFO util.Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 50848. 17/03/01 04:11:01 INFO netty.NettyBlockTransferService: Server created on 50848 17/03/01 04:11:01 INFO storage.BlockManagerMaster: Trying to register BlockManager 17/03/01 04:11:01 INFO storage.BlockManagerMaster: Registered BlockManager 17/03/01 04:11:02 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 26 17/03/01 04:11:02 INFO executor.Executor: Running task 26.0 in stage 0.0 (TID 26) 17/03/01 04:11:02 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 0 17/03/01 04:11:02 INFO storage.MemoryStore: ensureFreeSpace(1310) called with curMem=0, maxMem=8334920908 17/03/01 04:11:02 INFO storage.MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 1310.0 B, free 7.8 GB) 17/03/01 04:11:02 INFO broadcast.TorrentBroadcast: Reading broadcast variable 0 took 234 ms 17/03/01 04:11:02 INFO storage.MemoryStore: ensureFreeSpace(2064) called with curMem=1310, maxMem=8334920908 17/03/01 04:11:02 INFO storage.MemoryStore: Block broadcast_0 stored as values in memory (estimated size 2.0 KB, free 7.8 GB) 17/03/01 04:11:02 INFO resolver.CompanyResolverSparkTest: Ranjit exec test 17/03/01 04:11:02 INFO executor.Executor: Finished task 26.0 in stage 0.0 (TID 26). 972 bytes result sent to driver 17/03/01 04:12:16 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 73 17/03/01 04:12:16 INFO executor.Executor: Running task 78.0 in stage 2.0 (TID 73) 17/03/01 04:12:16 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 84 17/03/01 04:12:16 INFO storage.MemoryStore: ensureFreeSpace(9240) called with curMem=3374, maxMem=8334920908 17/03/01 04:12:16 INFO storage.MemoryStore: Block broadcast_84_piece0 stored as bytes in memory (estimated size 9.0 KB, free 7.8 GB) 17/03/01 04:12:16 INFO broadcast.TorrentBroadcast: Reading broadcast variable 84 took 44 ms 17/03/01 04:12:16 INFO storage.MemoryStore: ensureFreeSpace(32704) called with curMem=12614, maxMem=8334920908 17/03/01 04:12:16 INFO storage.MemoryStore: Block broadcast_84 stored as values in memory (estimated size 31.9 KB, free 7.8 GB) 17/03/01 04:12:17 INFO codegen.GenerateMutableProjection: Code generated in 92.861234 ms 17/03/01 04:12:17 INFO codegen.GenerateUnsafeProjection: Code generated in 10.469091 ms 17/03/01 04:12:17 INFO codegen.GenerateMutableProjection: Code generated in 16.400806 ms 17/03/01 04:12:17 INFO codegen.GenerateUnsafeRowJoiner: Code generated in 8.710262 ms 17/03/01 04:12:17 INFO codegen.GenerateUnsafeProjection: Code generated in 7.859432 ms 17/03/01 04:12:17 INFO rdd.HadoopRDD: Input split: avro path/part-r-00017-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:0+37491126 17/03/01 04:12:17 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 83 17/03/01 04:12:17 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=45318, maxMem=8334920908 17/03/01 04:12:17 INFO storage.MemoryStore: Block broadcast_83_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:12:17 INFO broadcast.TorrentBroadcast: Reading broadcast variable 83 took 9 ms 17/03/01 04:12:17 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=69961, maxMem=8334920908 17/03/01 04:12:17 INFO storage.MemoryStore: Block broadcast_83 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:12:18 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 17/03/01 04:12:18 INFO Configuration.deprecation: mapred.tip.id is deprecated. Instead, use mapreduce.task.id 17/03/01 04:12:18 INFO Configuration.deprecation: mapred.task.id is deprecated. Instead, use mapreduce.task.attempt.id 17/03/01 04:12:18 INFO Configuration.deprecation: mapred.task.is.map is deprecated. Instead, use mapreduce.task.ismap 17/03/01 04:12:18 INFO Configuration.deprecation: mapred.task.partition is deprecated. Instead, use mapreduce.task.partition 17/03/01 04:12:18 INFO Configuration.deprecation: mapred.job.id is deprecated. Instead, use mapreduce.job.id 17/03/01 04:12:18 WARN security.UserGroupInformation: PriviledgedActionException as:userName (auth:SIMPLE) cause:org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:12:18 WARN ipc.Client: Exception encountered while connecting to the server : org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:12:18 WARN security.UserGroupInformation: PriviledgedActionException as:userName (auth:SIMPLE) cause:org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:12:20 INFO executor.Executor: Finished task 78.0 in stage 2.0 (TID 73). 2495 bytes result sent to driver 17/03/01 04:12:31 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 116 17/03/01 04:12:31 INFO executor.Executor: Running task 10.0 in stage 2.0 (TID 116) 17/03/01 04:12:31 INFO rdd.HadoopRDD: Input split: avro path/part-r-00005-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:0+42826875 17/03/01 04:12:31 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 49 17/03/01 04:12:31 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=417033, maxMem=8334920908 17/03/01 04:12:31 INFO storage.MemoryStore: Block broadcast_49_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:12:31 INFO broadcast.TorrentBroadcast: Reading broadcast variable 49 took 8 ms 17/03/01 04:12:31 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=441676, maxMem=8334920908 17/03/01 04:12:31 INFO storage.MemoryStore: Block broadcast_49 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:12:33 INFO executor.Executor: Finished task 10.0 in stage 2.0 (TID 116). 2495 bytes result sent to driver 17/03/01 04:12:38 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 131 17/03/01 04:12:38 INFO executor.Executor: Running task 9.0 in stage 4.0 (TID 131) 17/03/01 04:12:38 INFO spark.MapOutputTrackerWorker: Updating epoch to 1 and clearing cache 17/03/01 04:12:38 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 86 17/03/01 04:12:38 INFO storage.MemoryStore: ensureFreeSpace(2290) called with curMem=788748, maxMem=8334920908 17/03/01 04:12:38 INFO storage.MemoryStore: Block broadcast_86_piece0 stored as bytes in memory (estimated size 2.2 KB, free 7.8 GB) 17/03/01 04:12:38 INFO broadcast.TorrentBroadcast: Reading broadcast variable 86 took 7 ms 17/03/01 04:12:38 INFO storage.MemoryStore: ensureFreeSpace(6544) called with curMem=791038, maxMem=8334920908 17/03/01 04:12:38 INFO storage.MemoryStore: Block broadcast_86 stored as values in memory (estimated size 6.4 KB, free 7.8 GB) 17/03/01 04:12:38 INFO resolver.CompanyResolverSparkTest: testing worker[ipaddress:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509] 17/03/01 04:12:38 ERROR : Failed to resolve default logging config file: config/java.util.logging.properties Console logging handler is not configured. 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: >>> __________ ________________ >>> / _/ ___/ |/ / _/_ __/ __/ >>> _/ // (7 7 // / / / / _/ >>> /___/\___/_/|_/___/ /_/ /___/ >>> >>> ver. 1.8.0#20161205-sha1:9ca40dbe >>> 2016 Copyright(C) Apache Software Foundation >>> >>> Ignite documentation: http://ignite.apache.org 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Config URL: n/a 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Daemon mode: off 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: OS: Linux 2.6.32-431.5.1.el6.x86_64 amd64 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: OS user: userName 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: PID: 39548 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Language runtime: Java Platform API Specification ver. 1.8 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM information: Java(TM) SE Runtime Environment 1.8.0_60-b27 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.60-b23 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM total memory: 14.0GB 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Remote Management [restart: off, REST: on, JMX (remote: off)] 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: IGNITE_HOME=null 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM arguments: [-XX:OnOutOfMemoryError=kill %p, -Xms15360m, -Xmx15360m, -Djava.io.tmpdir=/data/1/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/container_e76_1487862040010_131981_01_000019/tmp, -Dspark.driver.port=38995, -Dspark.ui.port=0, -Dspark.yarn.app.container.log.dir=/data/2/yarn/log/container/application_1487862040010_131981/container_e76_1487862040010_131981_01_000019] 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Configured caches ['ignite-marshaller-sys-cache', 'ignite-sys-cache', 'ignite-atomics-sys-cache'] 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: Configured plugins: 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: ^-- None 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: IPC shared memory server endpoint started [port=48100, tokDir=/data/1/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/container_e76_1487862040010_131981_01_000019/tmp/ignite/work/ipc/shmem/29716cf1-ed55-4550-82bd-cf980a0aee2c-39548] 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: Successfully bound shared memory communication to TCP port [port=48100, locHost=0.0.0.0/0.0.0.0] 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: Successfully bound to TCP port [port=47100, locHost=0.0.0.0/0.0.0.0] 17/03/01 04:12:38 WARN noop.NoopCheckpointSpi: Checkpoints are disabled (to enable configure any GridCheckpointSpi implementation) 17/03/01 04:12:38 WARN collision.GridCollisionManager: Collision resolution is disabled (all jobs will be activated upon arrival). 17/03/01 04:12:38 WARN noop.NoopSwapSpaceSpi: Swap space is disabled. To enable use FileSwapSpaceSpi. 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Security status [authentication=off, tls/ssl=off] 17/03/01 04:12:39 INFO tcp.GridTcpRestProtocol: Command protocol successfully started [name=TCP binary, host=0.0.0.0/0.0.0.0, port=11211] 17/03/01 04:12:39 INFO internal.IgniteKernal%WCA: Non-loopback local IPs: 17/03/01 04:12:39 INFO internal.IgniteKernal%WCA: Enabled local MACs: 44A84210B0EA 17/03/01 04:12:39 INFO tcp.TcpDiscoverySpi: Successfully bound to TCP port [port=47501, localHost=0.0.0.0/0.0.0.0, locNodeId=29716cf1-ed55-4550-82bd-cf980a0aee2c] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=717de453-fc6b-4a46-91b2-b5c54ab8a4be, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=10, intOrder=10, lastExchangeTime=1488363160291, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=10, servers=10, clients=0, CPUs=432, heap=170.0GB] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=ffe19475-7849-4027-8648-ce56598ff50f, addrs=[7, 127.0.0.1], sockAddrs=[/127.0.0.1:47501, hostName/7:47501], discPort=47501, order=11, intOrder=11, lastExchangeTime=1488363160291, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=11, servers=11, clients=0, CPUs=472, heap=190.0GB] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=8be1bd05-d62c-4f1a-83f2-91dcb3f3b62a, addrs=[07, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/07:47500], discPort=47500, order=12, intOrder=12, lastExchangeTime=1488363160301, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=12, servers=12, clients=0, CPUs=504, heap=200.0GB] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=133c388f-3399-4cc8-b2f1-7ae8ba971b03, addrs=[7, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/7:47500], discPort=47500, order=13, intOrder=13, lastExchangeTime=1488363160311, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=13, servers=13, clients=0, CPUs=544, heap=220.0GB] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=23f61699-e2c9-4ff6-8731-2483934e84c4, addrs=[0, 127.0.0.1], sockAddrs=[hostName/0:47500, /127.0.0.1:47500], discPort=47500, order=14, intOrder=14, lastExchangeTime=1488363160321, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=14, servers=14, clients=0, CPUs=584, heap=230.0GB] 17/03/01 04:12:40 INFO cache.GridCacheProcessor: Started cache [name=ignite-sys-cache, mode=REPLICATED] 17/03/01 04:12:40 INFO cache.GridCacheProcessor: Started cache [name=ignite-atomics-sys-cache, mode=PARTITIONED] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=95f164b5-4b73-438f-804f-62854d615b5b, addrs=[9, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/9:47500], discPort=47500, order=15, intOrder=15, lastExchangeTime=1488363160321, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=15, servers=15, clients=0, CPUs=624, heap=250.0GB] 17/03/01 04:12:41 INFO cache.GridCacheProcessor: Started cache [name=WCAIgniteCache, mode=PARTITIONED] 17/03/01 04:12:41 INFO cache.GridCacheProcessor: Started cache [name=ignite-marshaller-sys-cache, mode=REPLICATED] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=c4f4f6bb-b71a-4a29-9575-afee2ddc1b2d, addrs=[6, 127.0.0.1], sockAddrs=[hostName/6:47500, /127.0.0.1:47500], discPort=47500, order=16, intOrder=16, lastExchangeTime=1488363160331, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=16, servers=16, clients=0, CPUs=664, heap=260.0GB] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=ddc47224-d030-4d1f-ba66-08f61368a395, addrs=[4, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/4:47500], discPort=47500, order=17, intOrder=17, lastExchangeTime=1488363160342, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=17, servers=17, clients=0, CPUs=704, heap=280.0GB] 17/03/01 04:12:41 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=9, minorTopVer=0], evt=NODE_JOINED, node=29716cf1-ed55-4550-82bd-cf980a0aee2c] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=47c1a0d8-9d4d-4d0d-9b27-388bd7f49278, addrs=[1, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/1:47500], discPort=47500, order=18, intOrder=18, lastExchangeTime=1488363160342, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=18, servers=18, clients=0, CPUs=744, heap=290.0GB] 17/03/01 04:12:41 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=10, minorTopVer=0], evt=NODE_JOINED, node=717de453-fc6b-4a46-91b2-b5c54ab8a4be] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=e87f12ce-5981-4418-8468-f6bfed0a0cd8, addrs=[6, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/6:47500], discPort=47500, order=19, intOrder=19, lastExchangeTime=1488363160352, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=19, servers=19, clients=0, CPUs=784, heap=310.0GB] 17/03/01 04:12:41 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=11, minorTopVer=0], evt=NODE_JOINED, node=ffe19475-7849-4027-8648-ce56598ff50f] 17/03/01 04:12:41 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=12, minorTopVer=0], evt=NODE_JOINED, node=8be1bd05-d62c-4f1a-83f2-91dcb3f3b62a] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=e2cba212-89dd-48dd-8d7e-821b5725fe03, addrs=[8, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/8:47500], discPort=47500, order=20, intOrder=20, lastExchangeTime=1488363160372, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=20, servers=20, clients=0, CPUs=816, heap=320.0GB] 17/03/01 04:12:41 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=13, minorTopVer=0], evt=NODE_JOINED, node=133c388f-3399-4cc8-b2f1-7ae8ba971b03] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=f9ce8dd7-2060-4c34-b597-d7bee86ebedb, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=21, intOrder=21, lastExchangeTime=1488363160382, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=21, servers=21, clients=0, CPUs=856, heap=340.0GB] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=14, minorTopVer=0], evt=NODE_JOINED, node=23f61699-e2c9-4ff6-8731-2483934e84c4] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=6b1889dd-9de5-4f1b-8ec9-c123c7df8ea2, addrs=[, 127.0.0.1], sockAddrs=[hostName/:47500, /127.0.0.1:47500], discPort=47500, order=22, intOrder=22, lastExchangeTime=1488363160392, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=22, servers=22, clients=0, CPUs=896, heap=350.0GB] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=15, minorTopVer=0], evt=NODE_JOINED, node=95f164b5-4b73-438f-804f-62854d615b5b] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=9fb6e583-cea0-4f78-b403-b403a8bc9a0e, addrs=[7, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/7:47500], discPort=47500, order=23, intOrder=23, lastExchangeTime=1488363160412, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=23, servers=23, clients=0, CPUs=936, heap=370.0GB] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=20860cae-2881-4311-a3f5-edaa160ef37f, addrs=[7, 127.0.0.1], sockAddrs=[hostName/7:47500, /127.0.0.1:47500], discPort=47500, order=24, intOrder=24, lastExchangeTime=1488363160412, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=24, servers=24, clients=0, CPUs=976, heap=380.0GB] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=16, minorTopVer=0], evt=NODE_JOINED, node=c4f4f6bb-b71a-4a29-9575-afee2ddc1b2d] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=0d675d57-b9b9-4cff-a994-77337d618bbe, addrs=[4, 127.0.0.1], sockAddrs=[hostName/4:47500, /127.0.0.1:47500], discPort=47500, order=25, intOrder=25, lastExchangeTime=1488363160422, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=25, servers=25, clients=0, CPUs=1016, heap=400.0GB] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=17, minorTopVer=0], evt=NODE_JOINED, node=ddc47224-d030-4d1f-ba66-08f61368a395] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=a6343860-6e84-4d9c-9b87-84ffd76280cd, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=26, intOrder=26, lastExchangeTime=1488363160422, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=26, servers=26, clients=0, CPUs=1056, heap=410.0GB] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=18, minorTopVer=0], evt=NODE_JOINED, node=47c1a0d8-9d4d-4d0d-9b27-388bd7f49278] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=19, minorTopVer=0], evt=NODE_JOINED, node=e87f12ce-5981-4418-8468-f6bfed0a0cd8] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=479b18e6-54af-4313-85f7-c7525f6229a4, addrs=[, 127.0.0.1], sockAddrs=[hostName/:47500, /127.0.0.1:47500], discPort=47500, order=27, intOrder=27, lastExchangeTime=1488363160442, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=27, servers=27, clients=0, CPUs=1104, heap=430.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=20, minorTopVer=0], evt=NODE_JOINED, node=e2cba212-89dd-48dd-8d7e-821b5725fe03] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=058a99e8-3b65-4ec9-84b0-6f3502c2afce, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=28, intOrder=28, lastExchangeTime=1488363160655, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=28, servers=28, clients=0, CPUs=1144, heap=440.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=21, minorTopVer=0], evt=NODE_JOINED, node=f9ce8dd7-2060-4c34-b597-d7bee86ebedb] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=57c09d88-a4dc-4179-98b4-1144fd97d8cc, addrs=[35, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/35:47500], discPort=47500, order=29, intOrder=29, lastExchangeTime=1488363160688, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=29, servers=29, clients=0, CPUs=1192, heap=460.0GB] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=58298821-7aa9-4b58-ba15-e7f1ef2830fb, addrs=[3, 127.0.0.1], sockAddrs=[hostName/3:47500, /127.0.0.1:47500], discPort=47500, order=30, intOrder=30, lastExchangeTime=1488363160698, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=30, servers=30, clients=0, CPUs=1232, heap=470.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=22, minorTopVer=0], evt=NODE_JOINED, node=6b1889dd-9de5-4f1b-8ec9-c123c7df8ea2] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4d5de2f3-d975-4b28-b593-0cc0481cdc74, addrs=[03, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/03:47500], discPort=47500, order=31, intOrder=31, lastExchangeTime=1488363160809, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=31, servers=31, clients=0, CPUs=1280, heap=490.0GB] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=fa09caab-f4dc-43b6-ac8b-4a4bae6e7da6, addrs=[01, 127.0.0.1], sockAddrs=[hostName/01:47500, /127.0.0.1:47500], discPort=47500, order=32, intOrder=32, lastExchangeTime=1488363161463, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=32, servers=32, clients=0, CPUs=1320, heap=500.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=23, minorTopVer=0], evt=NODE_JOINED, node=9fb6e583-cea0-4f78-b403-b403a8bc9a0e] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=24, minorTopVer=0], evt=NODE_JOINED, node=20860cae-2881-4311-a3f5-edaa160ef37f] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=af5837f0-25ec-4f3d-a1c1-90c09dc424cb, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=33, intOrder=33, lastExchangeTime=1488363161605, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=33, servers=33, clients=0, CPUs=1360, heap=520.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=25, minorTopVer=0], evt=NODE_JOINED, node=0d675d57-b9b9-4cff-a994-77337d618bbe] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=e9e49d2d-5eeb-474f-8757-e447efc8ca8f, addrs=[6, 127.0.0.1], sockAddrs=[hostName/6:47500, /127.0.0.1:47500], discPort=47500, order=34, intOrder=34, lastExchangeTime=1488363161605, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=34, servers=34, clients=0, CPUs=1400, heap=530.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=26, minorTopVer=0], evt=NODE_JOINED, node=a6343860-6e84-4d9c-9b87-84ffd76280cd] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4b90e5a3-253a-435b-84ca-6b592610cf0c, addrs=[4, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/4:47500], discPort=47500, order=35, intOrder=35, lastExchangeTime=1488363161616, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=35, servers=35, clients=0, CPUs=1432, heap=550.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=27, minorTopVer=0], evt=NODE_JOINED, node=479b18e6-54af-4313-85f7-c7525f6229a4] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=8fd4eea2-2a45-4563-ae87-1848fd388a98, addrs=[3, 127.0.0.1], sockAddrs=[hostName/3:47500, /127.0.0.1:47500], discPort=47500, order=36, intOrder=36, lastExchangeTime=1488363161616, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=36, servers=36, clients=0, CPUs=1472, heap=560.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=28, minorTopVer=0], evt=NODE_JOINED, node=058a99e8-3b65-4ec9-84b0-6f3502c2afce] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=d7b45a02-0411-4028-acdf-f004e592f294, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=37, intOrder=37, lastExchangeTime=1488363161908, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=37, servers=37, clients=0, CPUs=1512, heap=580.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=29, minorTopVer=0], evt=NODE_JOINED, node=57c09d88-a4dc-4179-98b4-1144fd97d8cc] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=cf4e6e83-207e-42da-a55c-5621bc20b891, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=38, intOrder=38, lastExchangeTime=1488363162664, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=38, servers=38, clients=0, CPUs=1552, heap=590.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=30, minorTopVer=0], evt=NODE_JOINED, node=58298821-7aa9-4b58-ba15-e7f1ef2830fb] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=d8926a2c-2c00-4445-beb4-633c2d656c41, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=39, intOrder=39, lastExchangeTime=1488363162674, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=39, servers=39, clients=0, CPUs=1584, heap=610.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=31, minorTopVer=0], evt=NODE_JOINED, node=4d5de2f3-d975-4b28-b593-0cc0481cdc74] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4136a0c9-14d5-42b3-9a60-81689c800438, addrs=[3, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/3:47500], discPort=47500, order=40, intOrder=40, lastExchangeTime=1488363162895, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=40, servers=40, clients=0, CPUs=1624, heap=620.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=32, minorTopVer=0], evt=NODE_JOINED, node=fa09caab-f4dc-43b6-ac8b-4a4bae6e7da6] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=694a80b8-02a3-44c9-a2dd-45bed7d20a50, addrs=[1, 127.0.0.1], sockAddrs=[hostName/1:47500, /127.0.0.1:47500], discPort=47500, order=41, intOrder=41, lastExchangeTime=1488363162915, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=41, servers=41, clients=0, CPUs=1664, heap=640.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=33, minorTopVer=0], evt=NODE_JOINED, node=af5837f0-25ec-4f3d-a1c1-90c09dc424cb] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=34, minorTopVer=0], evt=NODE_JOINED, node=e9e49d2d-5eeb-474f-8757-e447efc8ca8f] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=35, minorTopVer=0], evt=NODE_JOINED, node=4b90e5a3-253a-435b-84ca-6b592610cf0c] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=36, minorTopVer=0], evt=NODE_JOINED, node=8fd4eea2-2a45-4563-ae87-1848fd388a98] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=37, minorTopVer=0], evt=NODE_JOINED, node=d7b45a02-0411-4028-acdf-f004e592f294] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=38, minorTopVer=0], evt=NODE_JOINED, node=cf4e6e83-207e-42da-a55c-5621bc20b891] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=39, minorTopVer=0], evt=NODE_JOINED, node=d8926a2c-2c00-4445-beb4-633c2d656c41] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=40, minorTopVer=0], evt=NODE_JOINED, node=4136a0c9-14d5-42b3-9a60-81689c800438] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-sys-cache, waitList=[]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-marshaller-sys-cache, waitList=[]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-atomics-sys-cache, waitList=[ignite-sys-cache, ignite-marshaller-sys-cache]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=WCAIgniteCache, waitList=[ignite-sys-cache, ignite-marshaller-sys-cache, ignite-atomics-sys-cache]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Rebalancing required [top=AffinityTopologyVersion [topVer=41, minorTopVer=0], evt=NODE_JOINED, node=694a80b8-02a3-44c9-a2dd-45bed7d20a50] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-marshaller-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=20, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=33] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=100, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=33] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-marshaller-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=20 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=20 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-atomics-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=26, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=33] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-atomics-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=0 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=WCAIgniteCache, mode=ASYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=26, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=33] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=WCAIgniteCache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=0 ms] 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: >>> +----------------------------------------------------------------------+ >>> Ignite ver. 1.8.0#20161205-sha1:9ca40dbeb7d559fcb299bdb6f5c90cdf8ce7e533 >>> +----------------------------------------------------------------------+ >>> OS name: Linux 2.6.32-431.5.1.el6.x86_64 amd64 >>> CPU(s): 40 >>> Heap: 15.0GB >>> VM name: 39548@hostName >>> Grid name: WCA >>> Local node [ID=29716CF1-ED55-4550-82BD-CF980A0AEE2C, order=9, clientMode=false] >>> Local node addresses: [hostName/, /127.0.0.1] >>> Local ports: TCP:11211 TCP:47100 TCP:47501 TCP:48100 17/03/01 04:12:47 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=9, servers=9, clients=0, CPUs=392, heap=160.0GB] 17/03/01 04:12:47 INFO resolver.CompanyResolverSparkTest: Started ignite node on executor 17/03/01 04:12:47 INFO executor.Executor: Finished task 9.0 in stage 4.0 (TID 131). 931 bytes result sent to driver 17/03/01 04:12:49 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=41, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, node=6172ee3a-eb33-4bf5-9080-c255f52caed8] 17/03/01 04:12:52 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 181 17/03/01 04:12:52 INFO executor.Executor: Running task 13.0 in stage 5.0 (TID 181) 17/03/01 04:12:52 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 128 17/03/01 04:12:52 INFO storage.MemoryStore: ensureFreeSpace(7311) called with curMem=0, maxMem=8334920908 17/03/01 04:12:52 INFO storage.MemoryStore: Block broadcast_128_piece0 stored as bytes in memory (estimated size 7.1 KB, free 7.8 GB) 17/03/01 04:12:52 INFO broadcast.TorrentBroadcast: Reading broadcast variable 128 took 9 ms 17/03/01 04:12:52 INFO storage.MemoryStore: ensureFreeSpace(28168) called with curMem=7311, maxMem=8334920908 17/03/01 04:12:52 INFO storage.MemoryStore: Block broadcast_128 stored as values in memory (estimated size 27.5 KB, free 7.8 GB) 17/03/01 04:12:52 INFO rdd.HadoopRDD: Input split: avro path/part-r-00012-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:32203732+32203732 17/03/01 04:12:52 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 94 17/03/01 04:12:52 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=35479, maxMem=8334920908 17/03/01 04:12:52 INFO storage.MemoryStore: Block broadcast_94_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:12:52 INFO broadcast.TorrentBroadcast: Reading broadcast variable 94 took 10 ms 17/03/01 04:12:53 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=60122, maxMem=8334920908 17/03/01 04:12:53 INFO storage.MemoryStore: Block broadcast_94 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:12:58 INFO executor.Executor: Finished task 13.0 in stage 5.0 (TID 181). 2098 bytes result sent to driver 17/03/01 04:13:01 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 204 17/03/01 04:13:01 INFO executor.Executor: Running task 78.0 in stage 5.0 (TID 204) 17/03/01 04:13:01 INFO rdd.HadoopRDD: Input split: avro path/part-r-00017-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:0+37491126 17/03/01 04:13:01 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 127 17/03/01 04:13:01 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=407194, maxMem=8334920908 17/03/01 04:13:01 INFO storage.MemoryStore: Block broadcast_127_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:13:01 INFO broadcast.TorrentBroadcast: Reading broadcast variable 127 took 12 ms 17/03/01 04:13:01 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=431837, maxMem=8334920908 17/03/01 04:13:01 INFO storage.MemoryStore: Block broadcast_127 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:13:09 INFO executor.Executor: Finished task 78.0 in stage 5.0 (TID 204). 2098 bytes result sent to driver 17/03/01 04:13:47 INFO internal.IgniteKernal%WCA: Metrics for local node (to disable set 'metricsLogFrequency' to 0) ^-- Node [id=29716cf1, name=WCA, uptime=00:01:00:008] ^-- H/N/C [hosts=41, nodes=41, CPUs=1664] ^-- CPU [cur=4.77%, avg=3.28%, GC=0.13%] ^-- Heap [used=1128MB, free=92.27%, comm=14600MB] ^-- Non heap [used=120MB, free=-1%, comm=122MB] ^-- Public thread pool [active=0, idle=0, qSize=0] ^-- System thread pool [active=0, idle=80, qSize=0] ^-- Outbound messages queue [size=0] 17/03/01 04:13:50 INFO cluster.GridUpdateNotifier: Update status is not available. 17/03/01 04:14:00 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 255 17/03/01 04:14:00 INFO executor.Executor: Running task 11.0 in stage 7.0 (TID 255) 17/03/01 04:14:00 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 131 17/03/01 04:14:00 INFO storage.MemoryStore: ensureFreeSpace(2732) called with curMem=778909, maxMem=8334920908 17/03/01 04:14:00 INFO storage.MemoryStore: Block broadcast_131_piece0 stored as bytes in memory (estimated size 2.7 KB, free 7.8 GB) 17/03/01 04:14:00 INFO broadcast.TorrentBroadcast: Reading broadcast variable 131 took 20 ms 17/03/01 04:14:00 INFO storage.MemoryStore: ensureFreeSpace(7336) called with curMem=781641, maxMem=8334920908 17/03/01 04:14:00 INFO storage.MemoryStore: Block broadcast_131 stored as values in memory (estimated size 7.2 KB, free 7.8 GB) 17/03/01 04:14:00 INFO dao.CompanyDAO: testing[ipaddress:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509] 17/03/01 04:14:00 INFO dao.CompanyDAO: input company name inside Contains searchSTOCK AND OPTION SOLUTIONS 17/03/01 04:14:27 INFO executor.Executor: Finished task 11.0 in stage 7.0 (TID 255). 969 bytes result sent to driver 17/03/01 04:14:47 INFO internal.IgniteKernal%WCA: Metrics for local node (to disable set 'metricsLogFrequency' to 0) ^-- Node [id=29716cf1, name=WCA, uptime=00:02:00:035] ^-- H/N/C [hosts=41, nodes=41, CPUs=1664] ^-- CPU [cur=0.13%, avg=3.02%, GC=0%] ^-- Heap [used=1666MB, free=88.43%, comm=14409MB] ^-- Non heap [used=125MB, free=-1%, comm=127MB] ^-- Public thread pool [active=0, idle=0, qSize=0] ^-- System thread pool [active=0, idle=80, qSize=0] ^-- Outbound messages queue [size=0] 17/03/01 04:14:49 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 327 17/03/01 04:14:49 INFO executor.Executor: Running task 14.0 in stage 8.0 (TID 327) 17/03/01 04:14:49 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 132 17/03/01 04:14:49 INFO storage.MemoryStore: ensureFreeSpace(887) called with curMem=788977, maxMem=8334920908 17/03/01 04:14:49 INFO storage.MemoryStore: Block broadcast_132_piece0 stored as bytes in memory (estimated size 887.0 B, free 7.8 GB) 17/03/01 04:14:49 INFO broadcast.TorrentBroadcast: Reading broadcast variable 132 took 64 ms 17/03/01 04:14:49 INFO storage.MemoryStore: ensureFreeSpace(1216) called with curMem=789864, maxMem=8334920908 17/03/01 04:14:49 INFO storage.MemoryStore: Block broadcast_132 stored as values in memory (estimated size 1216.0 B, free 7.8 GB) 17/03/01 04:14:49 INFO tcp.GridTcpRestProtocol: Command protocol successfully stopped: TCP binary 17/03/01 04:14:51 INFO cache.GridCacheProcessor: Stopped cache: ignite-marshaller-sys-cache 17/03/01 04:14:51 INFO cache.GridCacheProcessor: Stopped cache: ignite-sys-cache 17/03/01 04:14:51 INFO cache.GridCacheProcessor: Stopped cache: ignite-atomics-sys-cache 17/03/01 04:14:51 INFO cache.GridCacheProcessor: Stopped cache: WCAIgniteCache 17/03/01 04:14:51 INFO internal.IgniteKernal%WCA: >>> +---------------------------------------------------------------------------------+ >>> Ignite ver. 1.8.0#20161205-sha1:9ca40dbeb7d559fcb299bdb6f5c90cdf8ce7e533 stopped OK >>> +---------------------------------------------------------------------------------+ >>> Grid name: WCA >>> Grid uptime: 00:02:04:156 17/03/01 04:14:51 INFO executor.Executor: Finished task 14.0 in stage 8.0 (TID 327). 931 bytes result sent to driver 17/03/01 04:14:53 INFO executor.CoarseGrainedExecutorBackend: Driver commanded a shutdown 17/03/01 04:14:53 INFO storage.MemoryStore: MemoryStore cleared 17/03/01 04:14:53 INFO storage.BlockManager: BlockManager stopped 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Shutting down remote daemon. 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remote daemon shut down; proceeding with flushing remote transports. 17/03/01 04:14:53 INFO Remoting: Remoting shut down 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remoting shut down. 17/03/01 04:14:53 INFO util.ShutdownHookManager: Shutdown hook called LogType:stdout Log Upload Time:Wed Mar 01 04:14:58 -0600 2017 LogLength:3881 Log Contents: rEnd of the programe - [04:12:38] __________ ________________ [04:12:38] / _/ ___/ |/ / _/_ __/ __/ [04:12:38] _/ // (7 7 // / / / / _/ [04:12:38] /___/\___/_/|_/___/ /_/ /___/ [04:12:38] [04:12:38] ver. 1.8.0#20161205-sha1:9ca40dbe [04:12:38] 2016 Copyright(C) Apache Software Foundation [04:12:38] [04:12:38] Ignite documentation: http://ignite.apache.org [04:12:38] [04:12:38] Quiet mode. [04:12:38] ^-- To see **FULL** console log here add -DIGNITE_QUIET=false or "-v" to ignite.{sh|bat} [04:12:38] [04:12:38] OS: Linux 2.6.32-431.5.1.el6.x86_64 amd64 [04:12:38] VM information: Java(TM) SE Runtime Environment 1.8.0_60-b27 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.60-b23 [04:12:38] Configured plugins: [04:12:38] ^-- None [04:12:38] [04:12:38] Security status [authentication=off, tls/ssl=off] [04:12:40] Topology snapshot [ver=10, servers=10, clients=0, CPUs=432, heap=170.0GB] [04:12:40] Topology snapshot [ver=11, servers=11, clients=0, CPUs=472, heap=190.0GB] [04:12:40] Topology snapshot [ver=12, servers=12, clients=0, CPUs=504, heap=200.0GB] [04:12:40] Topology snapshot [ver=13, servers=13, clients=0, CPUs=544, heap=220.0GB] [04:12:40] Topology snapshot [ver=14, servers=14, clients=0, CPUs=584, heap=230.0GB] [04:12:41] Topology snapshot [ver=15, servers=15, clients=0, CPUs=624, heap=250.0GB] [04:12:41] Topology snapshot [ver=16, servers=16, clients=0, CPUs=664, heap=260.0GB] [04:12:41] Topology snapshot [ver=17, servers=17, clients=0, CPUs=704, heap=280.0GB] [04:12:41] Topology snapshot [ver=18, servers=18, clients=0, CPUs=744, heap=290.0GB] [04:12:41] Topology snapshot [ver=19, servers=19, clients=0, CPUs=784, heap=310.0GB] [04:12:41] Topology snapshot [ver=20, servers=20, clients=0, CPUs=816, heap=320.0GB] [04:12:41] Topology snapshot [ver=21, servers=21, clients=0, CPUs=856, heap=340.0GB] [04:12:42] Topology snapshot [ver=22, servers=22, clients=0, CPUs=896, heap=350.0GB] [04:12:42] Topology snapshot [ver=23, servers=23, clients=0, CPUs=936, heap=370.0GB] [04:12:42] Topology snapshot [ver=24, servers=24, clients=0, CPUs=976, heap=380.0GB] [04:12:42] Topology snapshot [ver=25, servers=25, clients=0, CPUs=1016, heap=400.0GB] [04:12:42] Topology snapshot [ver=26, servers=26, clients=0, CPUs=1056, heap=410.0GB] [04:12:42] Topology snapshot [ver=27, servers=27, clients=0, CPUs=1104, heap=430.0GB] [04:12:43] Topology snapshot [ver=28, servers=28, clients=0, CPUs=1144, heap=440.0GB] [04:12:43] Topology snapshot [ver=29, servers=29, clients=0, CPUs=1192, heap=460.0GB] [04:12:43] Topology snapshot [ver=30, servers=30, clients=0, CPUs=1232, heap=470.0GB] [04:12:43] Topology snapshot [ver=31, servers=31, clients=0, CPUs=1280, heap=490.0GB] [04:12:43] Topology snapshot [ver=32, servers=32, clients=0, CPUs=1320, heap=500.0GB] [04:12:43] Topology snapshot [ver=33, servers=33, clients=0, CPUs=1360, heap=520.0GB] [04:12:44] Topology snapshot [ver=34, servers=34, clients=0, CPUs=1400, heap=530.0GB] [04:12:44] Topology snapshot [ver=35, servers=35, clients=0, CPUs=1432, heap=550.0GB] [04:12:44] Topology snapshot [ver=36, servers=36, clients=0, CPUs=1472, heap=560.0GB] [04:12:44] Topology snapshot [ver=37, servers=37, clients=0, CPUs=1512, heap=580.0GB] [04:12:44] Topology snapshot [ver=38, servers=38, clients=0, CPUs=1552, heap=590.0GB] [04:12:45] Topology snapshot [ver=39, servers=39, clients=0, CPUs=1584, heap=610.0GB] [04:12:45] Topology snapshot [ver=40, servers=40, clients=0, CPUs=1624, heap=620.0GB] [04:12:45] Topology snapshot [ver=41, servers=41, clients=0, CPUs=1664, heap=640.0GB] [04:12:47] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [04:12:47] [04:12:47] Ignite node started OK (id=29716cf1, grid=WCA) [04:12:47] Topology snapshot [ver=9, servers=9, clients=0, CPUs=392, heap=160.0GB] [04:14:51] Ignite node stopped OK [name=WCA, uptime=00:02:04:156] Container: container_e76_1487862040010_131981_01_000039 on hostName_8041 =========================================================================================== LogType:stderr Log Upload Time:Wed Mar 01 04:14:58 -0600 2017 LogLength:70872 Log Contents: 17/03/01 04:11:01 INFO executor.CoarseGrainedExecutorBackend: Registered signal handlers for [TERM, HUP, INT] 17/03/01 04:11:02 INFO spark.SecurityManager: Changing view acls to: userName 17/03/01 04:11:02 INFO spark.SecurityManager: Changing modify acls to: userName 17/03/01 04:11:02 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(userName); users with modify permissions: Set(userName) 17/03/01 04:11:02 INFO slf4j.Slf4jLogger: Slf4jLogger started 17/03/01 04:11:02 INFO Remoting: Starting remoting 17/03/01 04:11:02 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://driverPropsFetcher@hostName:53461] 17/03/01 04:11:02 INFO Remoting: Remoting now listens on addresses: [akka.tcp://driverPropsFetcher@hostName:53461] 17/03/01 04:11:02 INFO util.Utils: Successfully started service 'driverPropsFetcher' on port 53461. 17/03/01 04:11:02 INFO spark.SecurityManager: Changing view acls to: userName 17/03/01 04:11:02 INFO spark.SecurityManager: Changing modify acls to: userName 17/03/01 04:11:02 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(userName); users with modify permissions: Set(userName) 17/03/01 04:11:02 INFO remote.RemoteActorRefProvider$RemotingTerminator: Shutting down remote daemon. 17/03/01 04:11:02 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remote daemon shut down; proceeding with flushing remote transports. 17/03/01 04:11:02 INFO slf4j.Slf4jLogger: Slf4jLogger started 17/03/01 04:11:02 INFO Remoting: Starting remoting 17/03/01 04:11:02 INFO Remoting: Remoting shut down 17/03/01 04:11:02 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://sparkExecutor@hostName:42726] 17/03/01 04:11:02 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remoting shut down. 17/03/01 04:11:02 INFO Remoting: Remoting now listens on addresses: [akka.tcp://sparkExecutor@hostName:42726] 17/03/01 04:11:02 INFO util.Utils: Successfully started service 'sparkExecutor' on port 42726. 17/03/01 04:11:03 INFO storage.DiskBlockManager: Created local directory at /data/1/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-7c8255be-bc3d-4988-8cb6-73d6e66a27b5 17/03/01 04:11:03 INFO storage.DiskBlockManager: Created local directory at /data/2/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-a1cfc33a-f3dd-4ef1-8ef2-7d91437afbaf 17/03/01 04:11:03 INFO storage.DiskBlockManager: Created local directory at /data/3/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-77240a13-7cb7-4d3d-9a45-8312bbf2c149 17/03/01 04:11:03 INFO storage.DiskBlockManager: Created local directory at /data/4/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-75a725c0-4421-4169-9775-2496b4b08993 17/03/01 04:11:03 INFO storage.DiskBlockManager: Created local directory at /data/5/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-6f091ff3-4ea3-4e8d-99ab-b91507a4a01d 17/03/01 04:11:03 INFO storage.DiskBlockManager: Created local directory at /data/6/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-aaa7e2b9-85f2-44bb-8ca1-535e947aac50 17/03/01 04:11:03 INFO storage.DiskBlockManager: Created local directory at /data/7/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-7c1f4fbc-93e0-49af-a741-7244ffba9995 17/03/01 04:11:03 INFO storage.DiskBlockManager: Created local directory at /data/8/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-9ef8163f-8bba-434c-bb61-1d5e933665b7 17/03/01 04:11:03 INFO storage.DiskBlockManager: Created local directory at /data/9/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-a7b67eaf-6346-466b-9643-137d77bdc5ee 17/03/01 04:11:03 INFO storage.DiskBlockManager: Created local directory at /data/10/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-586e3df2-a93e-402a-abb6-d00db7ef8b8c 17/03/01 04:11:03 INFO storage.DiskBlockManager: Created local directory at /data/11/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-1034f99e-6cbf-4260-9a02-70e5c9997daa 17/03/01 04:11:03 INFO storage.DiskBlockManager: Created local directory at /data/12/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-a8512a9b-6693-425e-908d-5174a6c27bcc 17/03/01 04:11:03 INFO storage.MemoryStore: MemoryStore started with capacity 7.8 GB 17/03/01 04:11:03 INFO executor.CoarseGrainedExecutorBackend: Connecting to driver: akka.tcp://sparkDriver@ipaddress:38995/user/CoarseGrainedScheduler 17/03/01 04:11:03 INFO executor.CoarseGrainedExecutorBackend: Successfully registered with driver 17/03/01 04:11:03 INFO executor.Executor: Starting executor ID 36 on host hostName 17/03/01 04:11:03 INFO util.Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 51773. 17/03/01 04:11:03 INFO netty.NettyBlockTransferService: Server created on 51773 17/03/01 04:11:03 INFO storage.BlockManagerMaster: Trying to register BlockManager 17/03/01 04:11:03 INFO storage.BlockManagerMaster: Registered BlockManager 17/03/01 04:12:16 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 79 17/03/01 04:12:16 INFO executor.Executor: Running task 6.0 in stage 2.0 (TID 79) 17/03/01 04:12:17 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 84 17/03/01 04:12:17 INFO storage.MemoryStore: ensureFreeSpace(9240) called with curMem=0, maxMem=8334920908 17/03/01 04:12:17 INFO storage.MemoryStore: Block broadcast_84_piece0 stored as bytes in memory (estimated size 9.0 KB, free 7.8 GB) 17/03/01 04:12:17 INFO broadcast.TorrentBroadcast: Reading broadcast variable 84 took 149 ms 17/03/01 04:12:17 INFO storage.MemoryStore: ensureFreeSpace(32704) called with curMem=9240, maxMem=8334920908 17/03/01 04:12:17 INFO storage.MemoryStore: Block broadcast_84 stored as values in memory (estimated size 31.9 KB, free 7.8 GB) 17/03/01 04:12:18 INFO codegen.GenerateMutableProjection: Code generated in 97.853374 ms 17/03/01 04:12:18 INFO codegen.GenerateUnsafeProjection: Code generated in 9.27797 ms 17/03/01 04:12:18 INFO codegen.GenerateMutableProjection: Code generated in 15.510779 ms 17/03/01 04:12:18 INFO codegen.GenerateUnsafeRowJoiner: Code generated in 7.965851 ms 17/03/01 04:12:18 INFO codegen.GenerateUnsafeProjection: Code generated in 7.408248 ms 17/03/01 04:12:18 INFO rdd.HadoopRDD: Input split: avro path/part-r-00020-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:0+69626966 17/03/01 04:12:18 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 47 17/03/01 04:12:18 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=41944, maxMem=8334920908 17/03/01 04:12:18 INFO storage.MemoryStore: Block broadcast_47_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:12:18 INFO broadcast.TorrentBroadcast: Reading broadcast variable 47 took 12 ms 17/03/01 04:12:18 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=66587, maxMem=8334920908 17/03/01 04:12:18 INFO storage.MemoryStore: Block broadcast_47 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:12:18 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 17/03/01 04:12:18 INFO Configuration.deprecation: mapred.tip.id is deprecated. Instead, use mapreduce.task.id 17/03/01 04:12:18 INFO Configuration.deprecation: mapred.task.id is deprecated. Instead, use mapreduce.task.attempt.id 17/03/01 04:12:18 INFO Configuration.deprecation: mapred.task.is.map is deprecated. Instead, use mapreduce.task.ismap 17/03/01 04:12:18 INFO Configuration.deprecation: mapred.task.partition is deprecated. Instead, use mapreduce.task.partition 17/03/01 04:12:18 INFO Configuration.deprecation: mapred.job.id is deprecated. Instead, use mapreduce.job.id 17/03/01 04:12:18 WARN security.UserGroupInformation: PriviledgedActionException as:userName (auth:SIMPLE) cause:org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:12:18 WARN ipc.Client: Exception encountered while connecting to the server : org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:12:18 WARN security.UserGroupInformation: PriviledgedActionException as:userName (auth:SIMPLE) cause:org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:12:22 INFO executor.Executor: Finished task 6.0 in stage 2.0 (TID 79). 2495 bytes result sent to driver 17/03/01 04:12:22 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 103 17/03/01 04:12:22 INFO executor.Executor: Running task 70.0 in stage 2.0 (TID 103) 17/03/01 04:12:22 INFO rdd.HadoopRDD: Input split: avro path/part-r-00038-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:0+53647113 17/03/01 04:12:22 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 79 17/03/01 04:12:22 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=413659, maxMem=8334920908 17/03/01 04:12:22 INFO storage.MemoryStore: Block broadcast_79_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:12:22 INFO broadcast.TorrentBroadcast: Reading broadcast variable 79 took 9 ms 17/03/01 04:12:22 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=438302, maxMem=8334920908 17/03/01 04:12:22 INFO storage.MemoryStore: Block broadcast_79 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:12:24 INFO executor.Executor: Finished task 70.0 in stage 2.0 (TID 103). 2495 bytes result sent to driver 17/03/01 04:12:24 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 109 17/03/01 04:12:24 INFO executor.Executor: Running task 71.0 in stage 2.0 (TID 109) 17/03/01 04:12:24 INFO rdd.HadoopRDD: Input split: avro path/part-r-00038-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:53647113+53647113 17/03/01 04:12:26 INFO executor.Executor: Finished task 71.0 in stage 2.0 (TID 109). 2495 bytes result sent to driver 17/03/01 04:12:31 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 119 17/03/01 04:12:31 INFO executor.Executor: Running task 31.0 in stage 2.0 (TID 119) 17/03/01 04:12:31 INFO rdd.HadoopRDD: Input split: avro path/part-r-00027-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:58976207+58976208 17/03/01 04:12:31 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 59 17/03/01 04:12:31 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=785374, maxMem=8334920908 17/03/01 04:12:31 INFO storage.MemoryStore: Block broadcast_59_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:12:31 INFO broadcast.TorrentBroadcast: Reading broadcast variable 59 took 9 ms 17/03/01 04:12:31 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=810017, maxMem=8334920908 17/03/01 04:12:31 INFO storage.MemoryStore: Block broadcast_59 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:12:34 INFO executor.Executor: Finished task 31.0 in stage 2.0 (TID 119). 2495 bytes result sent to driver 17/03/01 04:12:38 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 156 17/03/01 04:12:38 INFO executor.Executor: Running task 34.0 in stage 4.0 (TID 156) 17/03/01 04:12:38 INFO spark.MapOutputTrackerWorker: Updating epoch to 1 and clearing cache 17/03/01 04:12:38 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 86 17/03/01 04:12:38 INFO storage.MemoryStore: ensureFreeSpace(2290) called with curMem=1157089, maxMem=8334920908 17/03/01 04:12:38 INFO storage.MemoryStore: Block broadcast_86_piece0 stored as bytes in memory (estimated size 2.2 KB, free 7.8 GB) 17/03/01 04:12:38 INFO broadcast.TorrentBroadcast: Reading broadcast variable 86 took 7 ms 17/03/01 04:12:38 INFO storage.MemoryStore: ensureFreeSpace(6544) called with curMem=1159379, maxMem=8334920908 17/03/01 04:12:38 INFO storage.MemoryStore: Block broadcast_86 stored as values in memory (estimated size 6.4 KB, free 7.8 GB) 17/03/01 04:12:38 INFO resolver.CompanyResolverSparkTest: testing worker[ipaddress:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509] 17/03/01 04:12:38 ERROR : Failed to resolve default logging config file: config/java.util.logging.properties Console logging handler is not configured. 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: >>> __________ ________________ >>> / _/ ___/ |/ / _/_ __/ __/ >>> _/ // (7 7 // / / / / _/ >>> /___/\___/_/|_/___/ /_/ /___/ >>> >>> ver. 1.8.0#20161205-sha1:9ca40dbe >>> 2016 Copyright(C) Apache Software Foundation >>> >>> Ignite documentation: http://ignite.apache.org 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Config URL: n/a 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Daemon mode: off 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: OS: Linux 2.6.32-431.5.1.el6.x86_64 amd64 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: OS user: userName 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: PID: 45974 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Language runtime: Java Platform API Specification ver. 1.8 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM information: Java(TM) SE Runtime Environment 1.8.0_60-b27 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.60-b23 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM total memory: 14.0GB 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Remote Management [restart: off, REST: on, JMX (remote: off)] 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: IGNITE_HOME=null 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM arguments: [-XX:OnOutOfMemoryError=kill %p, -Xms15360m, -Xmx15360m, -Djava.io.tmpdir=/data/9/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/container_e76_1487862040010_131981_01_000039/tmp, -Dspark.driver.port=38995, -Dspark.ui.port=0, -Dspark.yarn.app.container.log.dir=/data/3/yarn/log/container/application_1487862040010_131981/container_e76_1487862040010_131981_01_000039] 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Configured caches ['ignite-marshaller-sys-cache', 'ignite-sys-cache', 'ignite-atomics-sys-cache'] 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: Configured plugins: 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: ^-- None 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: IPC shared memory server endpoint started [port=48100, tokDir=/data/9/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/container_e76_1487862040010_131981_01_000039/tmp/ignite/work/ipc/shmem/8be1bd05-d62c-4f1a-83f2-91dcb3f3b62a-45974] 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: Successfully bound shared memory communication to TCP port [port=48100, locHost=0.0.0.0/0.0.0.0] 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: Successfully bound to TCP port [port=47100, locHost=0.0.0.0/0.0.0.0] 17/03/01 04:12:38 WARN noop.NoopCheckpointSpi: Checkpoints are disabled (to enable configure any GridCheckpointSpi implementation) 17/03/01 04:12:38 WARN collision.GridCollisionManager: Collision resolution is disabled (all jobs will be activated upon arrival). 17/03/01 04:12:38 WARN noop.NoopSwapSpaceSpi: Swap space is disabled. To enable use FileSwapSpaceSpi. 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Security status [authentication=off, tls/ssl=off] 17/03/01 04:12:39 INFO tcp.GridTcpRestProtocol: Command protocol successfully started [name=TCP binary, host=0.0.0.0/0.0.0.0, port=11211] 17/03/01 04:12:39 INFO internal.IgniteKernal%WCA: Non-loopback local IPs: 07 17/03/01 04:12:39 INFO internal.IgniteKernal%WCA: Enabled local MACs: C81F66E4A9A7 17/03/01 04:12:39 INFO tcp.TcpDiscoverySpi: Successfully bound to TCP port [port=47500, localHost=0.0.0.0/0.0.0.0, locNodeId=8be1bd05-d62c-4f1a-83f2-91dcb3f3b62a] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=133c388f-3399-4cc8-b2f1-7ae8ba971b03, addrs=[7, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/7:47500], discPort=47500, order=13, intOrder=13, lastExchangeTime=1488363160631, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=13, servers=13, clients=0, CPUs=544, heap=220.0GB] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=23f61699-e2c9-4ff6-8731-2483934e84c4, addrs=[0, 127.0.0.1], sockAddrs=[hostName/0:47500, /127.0.0.1:47500], discPort=47500, order=14, intOrder=14, lastExchangeTime=1488363160631, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=14, servers=14, clients=0, CPUs=584, heap=230.0GB] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=95f164b5-4b73-438f-804f-62854d615b5b, addrs=[9, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/9:47500], discPort=47500, order=15, intOrder=15, lastExchangeTime=1488363160641, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=15, servers=15, clients=0, CPUs=624, heap=250.0GB] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=c4f4f6bb-b71a-4a29-9575-afee2ddc1b2d, addrs=[6, 127.0.0.1], sockAddrs=[hostName/6:47500, /127.0.0.1:47500], discPort=47500, order=16, intOrder=16, lastExchangeTime=1488363160641, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=16, servers=16, clients=0, CPUs=664, heap=260.0GB] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=ddc47224-d030-4d1f-ba66-08f61368a395, addrs=[4, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/4:47500], discPort=47500, order=17, intOrder=17, lastExchangeTime=1488363160651, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=17, servers=17, clients=0, CPUs=704, heap=280.0GB] 17/03/01 04:12:41 INFO cache.GridCacheProcessor: Started cache [name=ignite-sys-cache, mode=REPLICATED] 17/03/01 04:12:41 INFO cache.GridCacheProcessor: Started cache [name=ignite-atomics-sys-cache, mode=PARTITIONED] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=47c1a0d8-9d4d-4d0d-9b27-388bd7f49278, addrs=[1, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/1:47500], discPort=47500, order=18, intOrder=18, lastExchangeTime=1488363160661, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=18, servers=18, clients=0, CPUs=744, heap=290.0GB] 17/03/01 04:12:41 INFO cache.GridCacheProcessor: Started cache [name=WCAIgniteCache, mode=PARTITIONED] 17/03/01 04:12:41 INFO cache.GridCacheProcessor: Started cache [name=ignite-marshaller-sys-cache, mode=REPLICATED] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=e87f12ce-5981-4418-8468-f6bfed0a0cd8, addrs=[6, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/6:47500], discPort=47500, order=19, intOrder=19, lastExchangeTime=1488363160661, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=19, servers=19, clients=0, CPUs=784, heap=310.0GB] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=e2cba212-89dd-48dd-8d7e-821b5725fe03, addrs=[8, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/8:47500], discPort=47500, order=20, intOrder=20, lastExchangeTime=1488363160681, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=20, servers=20, clients=0, CPUs=816, heap=320.0GB] 17/03/01 04:12:41 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=12, minorTopVer=0], evt=NODE_JOINED, node=8be1bd05-d62c-4f1a-83f2-91dcb3f3b62a] 17/03/01 04:12:41 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=13, minorTopVer=0], evt=NODE_JOINED, node=133c388f-3399-4cc8-b2f1-7ae8ba971b03] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=f9ce8dd7-2060-4c34-b597-d7bee86ebedb, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=21, intOrder=21, lastExchangeTime=1488363160691, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=21, servers=21, clients=0, CPUs=856, heap=340.0GB] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=14, minorTopVer=0], evt=NODE_JOINED, node=23f61699-e2c9-4ff6-8731-2483934e84c4] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=6b1889dd-9de5-4f1b-8ec9-c123c7df8ea2, addrs=[, 127.0.0.1], sockAddrs=[hostName/:47500, /127.0.0.1:47500], discPort=47500, order=22, intOrder=22, lastExchangeTime=1488363160701, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=22, servers=22, clients=0, CPUs=896, heap=350.0GB] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=15, minorTopVer=0], evt=NODE_JOINED, node=95f164b5-4b73-438f-804f-62854d615b5b] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=9fb6e583-cea0-4f78-b403-b403a8bc9a0e, addrs=[7, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/7:47500], discPort=47500, order=23, intOrder=23, lastExchangeTime=1488363160711, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=23, servers=23, clients=0, CPUs=936, heap=370.0GB] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=20860cae-2881-4311-a3f5-edaa160ef37f, addrs=[7, 127.0.0.1], sockAddrs=[hostName/7:47500, /127.0.0.1:47500], discPort=47500, order=24, intOrder=24, lastExchangeTime=1488363160711, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=24, servers=24, clients=0, CPUs=976, heap=380.0GB] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=16, minorTopVer=0], evt=NODE_JOINED, node=c4f4f6bb-b71a-4a29-9575-afee2ddc1b2d] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=0d675d57-b9b9-4cff-a994-77337d618bbe, addrs=[4, 127.0.0.1], sockAddrs=[hostName/4:47500, /127.0.0.1:47500], discPort=47500, order=25, intOrder=25, lastExchangeTime=1488363160721, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=25, servers=25, clients=0, CPUs=1016, heap=400.0GB] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=17, minorTopVer=0], evt=NODE_JOINED, node=ddc47224-d030-4d1f-ba66-08f61368a395] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=a6343860-6e84-4d9c-9b87-84ffd76280cd, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=26, intOrder=26, lastExchangeTime=1488363160721, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=26, servers=26, clients=0, CPUs=1056, heap=410.0GB] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=18, minorTopVer=0], evt=NODE_JOINED, node=47c1a0d8-9d4d-4d0d-9b27-388bd7f49278] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=19, minorTopVer=0], evt=NODE_JOINED, node=e87f12ce-5981-4418-8468-f6bfed0a0cd8] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=479b18e6-54af-4313-85f7-c7525f6229a4, addrs=[, 127.0.0.1], sockAddrs=[hostName/:47500, /127.0.0.1:47500], discPort=47500, order=27, intOrder=27, lastExchangeTime=1488363160741, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=27, servers=27, clients=0, CPUs=1104, heap=430.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=20, minorTopVer=0], evt=NODE_JOINED, node=e2cba212-89dd-48dd-8d7e-821b5725fe03] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=058a99e8-3b65-4ec9-84b0-6f3502c2afce, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=28, intOrder=28, lastExchangeTime=1488363160782, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=28, servers=28, clients=0, CPUs=1144, heap=440.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=21, minorTopVer=0], evt=NODE_JOINED, node=f9ce8dd7-2060-4c34-b597-d7bee86ebedb] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=57c09d88-a4dc-4179-98b4-1144fd97d8cc, addrs=[35, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/35:47500], discPort=47500, order=29, intOrder=29, lastExchangeTime=1488363160802, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=29, servers=29, clients=0, CPUs=1192, heap=460.0GB] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=58298821-7aa9-4b58-ba15-e7f1ef2830fb, addrs=[3, 127.0.0.1], sockAddrs=[hostName/3:47500, /127.0.0.1:47500], discPort=47500, order=30, intOrder=30, lastExchangeTime=1488363160802, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=30, servers=30, clients=0, CPUs=1232, heap=470.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=22, minorTopVer=0], evt=NODE_JOINED, node=6b1889dd-9de5-4f1b-8ec9-c123c7df8ea2] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4d5de2f3-d975-4b28-b593-0cc0481cdc74, addrs=[03, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/03:47500], discPort=47500, order=31, intOrder=31, lastExchangeTime=1488363160822, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=31, servers=31, clients=0, CPUs=1280, heap=490.0GB] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=fa09caab-f4dc-43b6-ac8b-4a4bae6e7da6, addrs=[01, 127.0.0.1], sockAddrs=[hostName/01:47500, /127.0.0.1:47500], discPort=47500, order=32, intOrder=32, lastExchangeTime=1488363161488, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=32, servers=32, clients=0, CPUs=1320, heap=500.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=23, minorTopVer=0], evt=NODE_JOINED, node=9fb6e583-cea0-4f78-b403-b403a8bc9a0e] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=24, minorTopVer=0], evt=NODE_JOINED, node=20860cae-2881-4311-a3f5-edaa160ef37f] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=af5837f0-25ec-4f3d-a1c1-90c09dc424cb, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=33, intOrder=33, lastExchangeTime=1488363161620, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=33, servers=33, clients=0, CPUs=1360, heap=520.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=25, minorTopVer=0], evt=NODE_JOINED, node=0d675d57-b9b9-4cff-a994-77337d618bbe] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=e9e49d2d-5eeb-474f-8757-e447efc8ca8f, addrs=[6, 127.0.0.1], sockAddrs=[hostName/6:47500, /127.0.0.1:47500], discPort=47500, order=34, intOrder=34, lastExchangeTime=1488363161630, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=34, servers=34, clients=0, CPUs=1400, heap=530.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=26, minorTopVer=0], evt=NODE_JOINED, node=a6343860-6e84-4d9c-9b87-84ffd76280cd] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4b90e5a3-253a-435b-84ca-6b592610cf0c, addrs=[4, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/4:47500], discPort=47500, order=35, intOrder=35, lastExchangeTime=1488363161630, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=35, servers=35, clients=0, CPUs=1432, heap=550.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=27, minorTopVer=0], evt=NODE_JOINED, node=479b18e6-54af-4313-85f7-c7525f6229a4] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=8fd4eea2-2a45-4563-ae87-1848fd388a98, addrs=[3, 127.0.0.1], sockAddrs=[hostName/3:47500, /127.0.0.1:47500], discPort=47500, order=36, intOrder=36, lastExchangeTime=1488363161643, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=36, servers=36, clients=0, CPUs=1472, heap=560.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=28, minorTopVer=0], evt=NODE_JOINED, node=058a99e8-3b65-4ec9-84b0-6f3502c2afce] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=d7b45a02-0411-4028-acdf-f004e592f294, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=37, intOrder=37, lastExchangeTime=1488363161925, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=37, servers=37, clients=0, CPUs=1512, heap=580.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=29, minorTopVer=0], evt=NODE_JOINED, node=57c09d88-a4dc-4179-98b4-1144fd97d8cc] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=cf4e6e83-207e-42da-a55c-5621bc20b891, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=38, intOrder=38, lastExchangeTime=1488363162680, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=38, servers=38, clients=0, CPUs=1552, heap=590.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=30, minorTopVer=0], evt=NODE_JOINED, node=58298821-7aa9-4b58-ba15-e7f1ef2830fb] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=d8926a2c-2c00-4445-beb4-633c2d656c41, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=39, intOrder=39, lastExchangeTime=1488363162690, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=39, servers=39, clients=0, CPUs=1584, heap=610.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=31, minorTopVer=0], evt=NODE_JOINED, node=4d5de2f3-d975-4b28-b593-0cc0481cdc74] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4136a0c9-14d5-42b3-9a60-81689c800438, addrs=[3, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/3:47500], discPort=47500, order=40, intOrder=40, lastExchangeTime=1488363162917, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=40, servers=40, clients=0, CPUs=1624, heap=620.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=32, minorTopVer=0], evt=NODE_JOINED, node=fa09caab-f4dc-43b6-ac8b-4a4bae6e7da6] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=694a80b8-02a3-44c9-a2dd-45bed7d20a50, addrs=[1, 127.0.0.1], sockAddrs=[hostName/1:47500, /127.0.0.1:47500], discPort=47500, order=41, intOrder=41, lastExchangeTime=1488363162927, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=41, servers=41, clients=0, CPUs=1664, heap=640.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=33, minorTopVer=0], evt=NODE_JOINED, node=af5837f0-25ec-4f3d-a1c1-90c09dc424cb] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=34, minorTopVer=0], evt=NODE_JOINED, node=e9e49d2d-5eeb-474f-8757-e447efc8ca8f] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=35, minorTopVer=0], evt=NODE_JOINED, node=4b90e5a3-253a-435b-84ca-6b592610cf0c] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=36, minorTopVer=0], evt=NODE_JOINED, node=8fd4eea2-2a45-4563-ae87-1848fd388a98] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=37, minorTopVer=0], evt=NODE_JOINED, node=d7b45a02-0411-4028-acdf-f004e592f294] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=38, minorTopVer=0], evt=NODE_JOINED, node=cf4e6e83-207e-42da-a55c-5621bc20b891] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=39, minorTopVer=0], evt=NODE_JOINED, node=d8926a2c-2c00-4445-beb4-633c2d656c41] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=40, minorTopVer=0], evt=NODE_JOINED, node=4136a0c9-14d5-42b3-9a60-81689c800438] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-sys-cache, waitList=[]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-marshaller-sys-cache, waitList=[]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-atomics-sys-cache, waitList=[ignite-sys-cache, ignite-marshaller-sys-cache]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=WCAIgniteCache, waitList=[ignite-sys-cache, ignite-marshaller-sys-cache, ignite-atomics-sys-cache]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Rebalancing required [top=AffinityTopologyVersion [topVer=41, minorTopVer=0], evt=NODE_JOINED, node=694a80b8-02a3-44c9-a2dd-45bed7d20a50] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-marshaller-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=20, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=30] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=100, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=30] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-marshaller-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=30 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=30 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-atomics-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=22, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=30] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-atomics-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=0 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=WCAIgniteCache, mode=ASYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=22, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=30] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=WCAIgniteCache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=0 ms] 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: >>> +----------------------------------------------------------------------+ >>> Ignite ver. 1.8.0#20161205-sha1:9ca40dbeb7d559fcb299bdb6f5c90cdf8ce7e533 >>> +----------------------------------------------------------------------+ >>> OS name: Linux 2.6.32-431.5.1.el6.x86_64 amd64 >>> CPU(s): 32 >>> Heap: 15.0GB >>> VM name: 45974@hostName >>> Grid name: WCA >>> Local node [ID=8BE1BD05-D62C-4F1A-83F2-91DCB3F3B62A, order=12, clientMode=false] >>> Local node addresses: [hostName/07, /127.0.0.1] >>> Local ports: TCP:11211 TCP:47100 TCP:47500 TCP:48100 17/03/01 04:12:47 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=12, servers=12, clients=0, CPUs=504, heap=200.0GB] 17/03/01 04:12:47 INFO resolver.CompanyResolverSparkTest: Started ignite node on executor 17/03/01 04:12:47 INFO executor.Executor: Finished task 34.0 in stage 4.0 (TID 156). 931 bytes result sent to driver 17/03/01 04:12:49 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=41, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, node=6172ee3a-eb33-4bf5-9080-c255f52caed8] 17/03/01 04:12:52 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 191 17/03/01 04:12:52 INFO executor.Executor: Running task 6.0 in stage 5.0 (TID 191) 17/03/01 04:12:52 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 128 17/03/01 04:12:52 INFO storage.MemoryStore: ensureFreeSpace(7311) called with curMem=0, maxMem=8334920908 17/03/01 04:12:52 INFO storage.MemoryStore: Block broadcast_128_piece0 stored as bytes in memory (estimated size 7.1 KB, free 7.8 GB) 17/03/01 04:12:52 INFO broadcast.TorrentBroadcast: Reading broadcast variable 128 took 9 ms 17/03/01 04:12:52 INFO storage.MemoryStore: ensureFreeSpace(28168) called with curMem=7311, maxMem=8334920908 17/03/01 04:12:52 INFO storage.MemoryStore: Block broadcast_128 stored as values in memory (estimated size 27.5 KB, free 7.8 GB) 17/03/01 04:12:52 INFO rdd.HadoopRDD: Input split: avro path/part-r-00020-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:0+69626966 17/03/01 04:12:52 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 91 17/03/01 04:12:52 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=35479, maxMem=8334920908 17/03/01 04:12:52 INFO storage.MemoryStore: Block broadcast_91_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:12:52 INFO broadcast.TorrentBroadcast: Reading broadcast variable 91 took 6 ms 17/03/01 04:12:52 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=60122, maxMem=8334920908 17/03/01 04:12:52 INFO storage.MemoryStore: Block broadcast_91 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:13:03 INFO executor.Executor: Finished task 6.0 in stage 5.0 (TID 191). 2098 bytes result sent to driver 17/03/01 04:13:03 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 209 17/03/01 04:13:03 INFO executor.Executor: Running task 7.0 in stage 5.0 (TID 209) 17/03/01 04:13:03 INFO rdd.HadoopRDD: Input split: avro path/part-r-00020-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:69626966+69626967 17/03/01 04:13:15 INFO executor.Executor: Finished task 7.0 in stage 5.0 (TID 209). 2098 bytes result sent to driver 17/03/01 04:13:15 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 219 17/03/01 04:13:15 INFO executor.Executor: Running task 70.0 in stage 5.0 (TID 219) 17/03/01 04:13:15 INFO rdd.HadoopRDD: Input split: avro path/part-r-00038-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:0+53647113 17/03/01 04:13:15 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 123 17/03/01 04:13:15 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=407194, maxMem=8334920908 17/03/01 04:13:15 INFO storage.MemoryStore: Block broadcast_123_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:13:15 INFO broadcast.TorrentBroadcast: Reading broadcast variable 123 took 14 ms 17/03/01 04:13:15 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=431837, maxMem=8334920908 17/03/01 04:13:15 INFO storage.MemoryStore: Block broadcast_123 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:13:23 INFO executor.Executor: Finished task 70.0 in stage 5.0 (TID 219). 2098 bytes result sent to driver 17/03/01 04:13:23 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 224 17/03/01 04:13:23 INFO executor.Executor: Running task 71.0 in stage 5.0 (TID 224) 17/03/01 04:13:23 INFO rdd.HadoopRDD: Input split: avro path/part-r-00038-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:53647113+53647113 17/03/01 04:13:32 INFO executor.Executor: Finished task 71.0 in stage 5.0 (TID 224). 2098 bytes result sent to driver 17/03/01 04:13:47 INFO internal.IgniteKernal%WCA: Metrics for local node (to disable set 'metricsLogFrequency' to 0) ^-- Node [id=8be1bd05, name=WCA, uptime=00:01:00:007] ^-- H/N/C [hosts=41, nodes=41, CPUs=1664] ^-- CPU [cur=2.37%, avg=5.87%, GC=0%] ^-- Heap [used=3465MB, free=75.81%, comm=14327MB] ^-- Non heap [used=120MB, free=-1%, comm=122MB] ^-- Public thread pool [active=0, idle=0, qSize=0] ^-- System thread pool [active=0, idle=64, qSize=0] ^-- Outbound messages queue [size=0] 17/03/01 04:13:51 INFO cluster.GridUpdateNotifier: Update status is not available. 17/03/01 04:14:00 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 254 17/03/01 04:14:00 INFO executor.Executor: Running task 10.0 in stage 7.0 (TID 254) 17/03/01 04:14:00 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 131 17/03/01 04:14:00 INFO storage.MemoryStore: ensureFreeSpace(2732) called with curMem=778909, maxMem=8334920908 17/03/01 04:14:00 INFO storage.MemoryStore: Block broadcast_131_piece0 stored as bytes in memory (estimated size 2.7 KB, free 7.8 GB) 17/03/01 04:14:00 INFO broadcast.TorrentBroadcast: Reading broadcast variable 131 took 34 ms 17/03/01 04:14:00 INFO storage.MemoryStore: ensureFreeSpace(7336) called with curMem=781641, maxMem=8334920908 17/03/01 04:14:00 INFO storage.MemoryStore: Block broadcast_131 stored as values in memory (estimated size 7.2 KB, free 7.8 GB) 17/03/01 04:14:00 INFO dao.CompanyDAO: testing[ipaddress:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509] 17/03/01 04:14:00 INFO dao.CompanyDAO: input company name inside Contains searchMIG AND CONSULTANTS 17/03/01 04:14:22 INFO executor.Executor: Finished task 10.0 in stage 7.0 (TID 254). 969 bytes result sent to driver 17/03/01 04:14:47 INFO internal.IgniteKernal%WCA: Metrics for local node (to disable set 'metricsLogFrequency' to 0) ^-- Node [id=8be1bd05, name=WCA, uptime=00:02:00:030] ^-- H/N/C [hosts=41, nodes=41, CPUs=1664] ^-- CPU [cur=0.3%, avg=4.58%, GC=0%] ^-- Heap [used=2388MB, free=83.49%, comm=14468MB] ^-- Non heap [used=125MB, free=-1%, comm=127MB] ^-- Public thread pool [active=0, idle=0, qSize=0] ^-- System thread pool [active=0, idle=64, qSize=0] ^-- Outbound messages queue [size=0] 17/03/01 04:14:49 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 335 17/03/01 04:14:49 INFO executor.Executor: Running task 22.0 in stage 8.0 (TID 335) 17/03/01 04:14:49 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 132 17/03/01 04:14:49 INFO storage.MemoryStore: ensureFreeSpace(887) called with curMem=788977, maxMem=8334920908 17/03/01 04:14:49 INFO storage.MemoryStore: Block broadcast_132_piece0 stored as bytes in memory (estimated size 887.0 B, free 7.8 GB) 17/03/01 04:14:49 INFO broadcast.TorrentBroadcast: Reading broadcast variable 132 took 68 ms 17/03/01 04:14:49 INFO storage.MemoryStore: ensureFreeSpace(1216) called with curMem=789864, maxMem=8334920908 17/03/01 04:14:49 INFO storage.MemoryStore: Block broadcast_132 stored as values in memory (estimated size 1216.0 B, free 7.8 GB) 17/03/01 04:14:49 INFO tcp.GridTcpRestProtocol: Command protocol successfully stopped: TCP binary 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=4136a0c9-14d5-42b3-9a60-81689c800438, addrs=[3, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/3:47500], discPort=47500, order=40, intOrder=40, lastExchangeTime=1488363162917, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=42, servers=40, clients=0, CPUs=1624, heap=620.0GB] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=cf4e6e83-207e-42da-a55c-5621bc20b891, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=38, intOrder=38, lastExchangeTime=1488363162680, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=43, servers=39, clients=0, CPUs=1584, heap=610.0GB] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=d8926a2c-2c00-4445-beb4-633c2d656c41, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=39, intOrder=39, lastExchangeTime=1488363162690, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=44, servers=38, clients=0, CPUs=1552, heap=590.0GB] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=e9e49d2d-5eeb-474f-8757-e447efc8ca8f, addrs=[6, 127.0.0.1], sockAddrs=[hostName/6:47500, /127.0.0.1:47500], discPort=47500, order=34, intOrder=34, lastExchangeTime=1488363161630, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=45, servers=37, clients=0, CPUs=1512, heap=580.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=57c09d88-a4dc-4179-98b4-1144fd97d8cc, addrs=[35, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/35:47500], discPort=47500, order=29, intOrder=29, lastExchangeTime=1488363160802, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=46, servers=36, clients=0, CPUs=1464, heap=560.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=0d675d57-b9b9-4cff-a994-77337d618bbe, addrs=[4, 127.0.0.1], sockAddrs=[hostName/4:47500, /127.0.0.1:47500], discPort=47500, order=25, intOrder=25, lastExchangeTime=1488363160721, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=47, servers=35, clients=0, CPUs=1424, heap=550.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=a6343860-6e84-4d9c-9b87-84ffd76280cd, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=26, intOrder=26, lastExchangeTime=1488363160721, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=48, servers=34, clients=0, CPUs=1384, heap=530.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=9fb6e583-cea0-4f78-b403-b403a8bc9a0e, addrs=[7, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/7:47500], discPort=47500, order=23, intOrder=23, lastExchangeTime=1488363160711, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=49, servers=33, clients=0, CPUs=1344, heap=520.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=23f61699-e2c9-4ff6-8731-2483934e84c4, addrs=[0, 127.0.0.1], sockAddrs=[hostName/0:47500, /127.0.0.1:47500], discPort=47500, order=14, intOrder=14, lastExchangeTime=1488363160631, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=50, servers=32, clients=0, CPUs=1304, heap=500.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=ddc47224-d030-4d1f-ba66-08f61368a395, addrs=[4, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/4:47500], discPort=47500, order=17, intOrder=17, lastExchangeTime=1488363160651, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=51, servers=31, clients=0, CPUs=1264, heap=490.0GB] 17/03/01 04:14:51 WARN tcp.TcpDiscoverySpi: Failed to ping node (status check will be initiated): 8fd4eea2-2a45-4563-ae87-1848fd388a98 17/03/01 04:14:52 INFO cache.GridCacheProcessor: Stopped cache: ignite-marshaller-sys-cache 17/03/01 04:14:52 INFO cache.GridCacheProcessor: Stopped cache: ignite-sys-cache 17/03/01 04:14:52 INFO cache.GridCacheProcessor: Stopped cache: ignite-atomics-sys-cache 17/03/01 04:14:52 INFO cache.GridCacheProcessor: Stopped cache: WCAIgniteCache 17/03/01 04:14:52 INFO internal.IgniteKernal%WCA: >>> +---------------------------------------------------------------------------------+ >>> Ignite ver. 1.8.0#20161205-sha1:9ca40dbeb7d559fcb299bdb6f5c90cdf8ce7e533 stopped OK >>> +---------------------------------------------------------------------------------+ >>> Grid name: WCA >>> Grid uptime: 00:02:05:500 17/03/01 04:14:52 INFO executor.Executor: Finished task 22.0 in stage 8.0 (TID 335). 931 bytes result sent to driver 17/03/01 04:14:53 INFO executor.CoarseGrainedExecutorBackend: Driver commanded a shutdown 17/03/01 04:14:53 INFO storage.MemoryStore: MemoryStore cleared 17/03/01 04:14:53 INFO storage.BlockManager: BlockManager stopped 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Shutting down remote daemon. 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remote daemon shut down; proceeding with flushing remote transports. 17/03/01 04:14:53 INFO Remoting: Remoting shut down 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remoting shut down. 17/03/01 04:14:53 INFO util.ShutdownHookManager: Shutdown hook called LogType:stdout Log Upload Time:Wed Mar 01 04:14:58 -0600 2017 LogLength:4488 Log Contents: rEnd of the programe - [04:12:38] __________ ________________ [04:12:38] / _/ ___/ |/ / _/_ __/ __/ [04:12:38] _/ // (7 7 // / / / / _/ [04:12:38] /___/\___/_/|_/___/ /_/ /___/ [04:12:38] [04:12:38] ver. 1.8.0#20161205-sha1:9ca40dbe [04:12:38] 2016 Copyright(C) Apache Software Foundation [04:12:38] [04:12:38] Ignite documentation: http://ignite.apache.org [04:12:38] [04:12:38] Quiet mode. [04:12:38] ^-- To see **FULL** console log here add -DIGNITE_QUIET=false or "-v" to ignite.{sh|bat} [04:12:38] [04:12:38] OS: Linux 2.6.32-431.5.1.el6.x86_64 amd64 [04:12:38] VM information: Java(TM) SE Runtime Environment 1.8.0_60-b27 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.60-b23 [04:12:38] Configured plugins: [04:12:38] ^-- None [04:12:38] [04:12:38] Security status [authentication=off, tls/ssl=off] [04:12:40] Topology snapshot [ver=13, servers=13, clients=0, CPUs=544, heap=220.0GB] [04:12:40] Topology snapshot [ver=14, servers=14, clients=0, CPUs=584, heap=230.0GB] [04:12:41] Topology snapshot [ver=15, servers=15, clients=0, CPUs=624, heap=250.0GB] [04:12:41] Topology snapshot [ver=16, servers=16, clients=0, CPUs=664, heap=260.0GB] [04:12:41] Topology snapshot [ver=17, servers=17, clients=0, CPUs=704, heap=280.0GB] [04:12:41] Topology snapshot [ver=18, servers=18, clients=0, CPUs=744, heap=290.0GB] [04:12:41] Topology snapshot [ver=19, servers=19, clients=0, CPUs=784, heap=310.0GB] [04:12:41] Topology snapshot [ver=20, servers=20, clients=0, CPUs=816, heap=320.0GB] [04:12:41] Topology snapshot [ver=21, servers=21, clients=0, CPUs=856, heap=340.0GB] [04:12:42] Topology snapshot [ver=22, servers=22, clients=0, CPUs=896, heap=350.0GB] [04:12:42] Topology snapshot [ver=23, servers=23, clients=0, CPUs=936, heap=370.0GB] [04:12:42] Topology snapshot [ver=24, servers=24, clients=0, CPUs=976, heap=380.0GB] [04:12:42] Topology snapshot [ver=25, servers=25, clients=0, CPUs=1016, heap=400.0GB] [04:12:42] Topology snapshot [ver=26, servers=26, clients=0, CPUs=1056, heap=410.0GB] [04:12:42] Topology snapshot [ver=27, servers=27, clients=0, CPUs=1104, heap=430.0GB] [04:12:43] Topology snapshot [ver=28, servers=28, clients=0, CPUs=1144, heap=440.0GB] [04:12:43] Topology snapshot [ver=29, servers=29, clients=0, CPUs=1192, heap=460.0GB] [04:12:43] Topology snapshot [ver=30, servers=30, clients=0, CPUs=1232, heap=470.0GB] [04:12:43] Topology snapshot [ver=31, servers=31, clients=0, CPUs=1280, heap=490.0GB] [04:12:43] Topology snapshot [ver=32, servers=32, clients=0, CPUs=1320, heap=500.0GB] [04:12:43] Topology snapshot [ver=33, servers=33, clients=0, CPUs=1360, heap=520.0GB] [04:12:44] Topology snapshot [ver=34, servers=34, clients=0, CPUs=1400, heap=530.0GB] [04:12:44] Topology snapshot [ver=35, servers=35, clients=0, CPUs=1432, heap=550.0GB] [04:12:44] Topology snapshot [ver=36, servers=36, clients=0, CPUs=1472, heap=560.0GB] [04:12:44] Topology snapshot [ver=37, servers=37, clients=0, CPUs=1512, heap=580.0GB] [04:12:44] Topology snapshot [ver=38, servers=38, clients=0, CPUs=1552, heap=590.0GB] [04:12:45] Topology snapshot [ver=39, servers=39, clients=0, CPUs=1584, heap=610.0GB] [04:12:45] Topology snapshot [ver=40, servers=40, clients=0, CPUs=1624, heap=620.0GB] [04:12:45] Topology snapshot [ver=41, servers=41, clients=0, CPUs=1664, heap=640.0GB] [04:12:47] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [04:12:47] [04:12:47] Ignite node started OK (id=8be1bd05, grid=WCA) [04:12:47] Topology snapshot [ver=12, servers=12, clients=0, CPUs=504, heap=200.0GB] [04:14:49] Topology snapshot [ver=42, servers=40, clients=0, CPUs=1624, heap=620.0GB] [04:14:49] Topology snapshot [ver=43, servers=39, clients=0, CPUs=1584, heap=610.0GB] [04:14:49] Topology snapshot [ver=44, servers=38, clients=0, CPUs=1552, heap=590.0GB] [04:14:49] Topology snapshot [ver=45, servers=37, clients=0, CPUs=1512, heap=580.0GB] [04:14:51] Topology snapshot [ver=46, servers=36, clients=0, CPUs=1464, heap=560.0GB] [04:14:51] Topology snapshot [ver=47, servers=35, clients=0, CPUs=1424, heap=550.0GB] [04:14:51] Topology snapshot [ver=48, servers=34, clients=0, CPUs=1384, heap=530.0GB] [04:14:51] Topology snapshot [ver=49, servers=33, clients=0, CPUs=1344, heap=520.0GB] [04:14:51] Topology snapshot [ver=50, servers=32, clients=0, CPUs=1304, heap=500.0GB] [04:14:51] Topology snapshot [ver=51, servers=31, clients=0, CPUs=1264, heap=490.0GB] [04:14:52] Ignite node stopped OK [name=WCA, uptime=00:02:05:489] Container: container_e76_1487862040010_131981_01_000002 on hostName_8041 =========================================================================================== LogType:stderr Log Upload Time:Wed Mar 01 04:14:58 -0600 2017 LogLength:2999469 Log Contents: 17/03/01 04:10:47 INFO ApplicationMaster: Registered signal handlers for [TERM, HUP, INT] 17/03/01 04:10:48 INFO ApplicationMaster: ApplicationAttemptId: appattempt_1487862040010_131981_000001 17/03/01 04:10:48 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 17/03/01 04:10:48 INFO SecurityManager: Changing view acls to: userName 17/03/01 04:10:48 INFO SecurityManager: Changing modify acls to: userName 17/03/01 04:10:48 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(userName); users with modify permissions: Set(userName) 17/03/01 04:10:49 INFO ApplicationMaster: Starting the user application in a separate Thread 17/03/01 04:10:49 INFO ApplicationMaster: Waiting for spark context initialization 17/03/01 04:10:49 INFO ApplicationMaster: Waiting for spark context initialization ... 17/03/01 04:10:49 INFO SparkContext: Running Spark version 1.5.0-cdh5.5.2 17/03/01 04:10:49 WARN SparkConf: In Spark 1.0 and later spark.local.dir will be overridden by the value set by the cluster manager (via SPARK_LOCAL_DIRS in mesos/standalone and LOCAL_DIRS in YARN). 17/03/01 04:10:49 INFO SecurityManager: Changing view acls to: userName 17/03/01 04:10:49 INFO SecurityManager: Changing modify acls to: userName 17/03/01 04:10:49 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(userName); users with modify permissions: Set(userName) 17/03/01 04:10:49 INFO Slf4jLogger: Slf4jLogger started 17/03/01 04:10:49 INFO Remoting: Starting remoting 17/03/01 04:10:49 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://sparkDriver@ipaddress:38995] 17/03/01 04:10:49 INFO Remoting: Remoting now listens on addresses: [akka.tcp://sparkDriver@ipaddress:38995] 17/03/01 04:10:49 INFO Utils: Successfully started service 'sparkDriver' on port 38995. 17/03/01 04:10:49 INFO SparkEnv: Registering MapOutputTracker 17/03/01 04:10:49 INFO SparkEnv: Registering BlockManagerMaster 17/03/01 04:10:49 INFO DiskBlockManager: Created local directory at /data/1/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-b494500d-d04a-4afe-8afa-b375452273de 17/03/01 04:10:49 INFO DiskBlockManager: Created local directory at /data/2/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-87b9a4ce-b828-4e9d-820e-1eab3937dc6d 17/03/01 04:10:49 INFO DiskBlockManager: Created local directory at /data/3/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-be23d526-2cc5-44bd-9650-1ba48126abd1 17/03/01 04:10:49 INFO DiskBlockManager: Created local directory at /data/4/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-9a17fcaa-dfd7-4546-b07b-79bbb7c0a51e 17/03/01 04:10:49 INFO DiskBlockManager: Created local directory at /data/5/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-afbe4b00-ecc3-40ec-856d-712557a43ea6 17/03/01 04:10:49 INFO DiskBlockManager: Created local directory at /data/6/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-43c24c42-3c1d-49a7-96f0-73baa1e63adf 17/03/01 04:10:49 INFO DiskBlockManager: Created local directory at /data/7/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-b04e3353-e118-4022-bacd-e3e3a4949e5a 17/03/01 04:10:49 INFO DiskBlockManager: Created local directory at /data/8/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-47268f9e-0075-4b74-a4ea-402e6b445895 17/03/01 04:10:49 INFO DiskBlockManager: Created local directory at /data/9/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-c7bd6a94-7396-432d-92c9-168f1585e5c5 17/03/01 04:10:49 INFO DiskBlockManager: Created local directory at /data/10/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-e0b14665-af82-47e0-8359-bc38d984c93b 17/03/01 04:10:49 INFO DiskBlockManager: Created local directory at /data/11/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-b80e9041-0a84-403f-891e-3f44278d6d8c 17/03/01 04:10:49 INFO DiskBlockManager: Created local directory at /data/12/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-754ed44e-3ec6-42b7-87dd-27e1fe2985e4 17/03/01 04:10:49 INFO MemoryStore: MemoryStore started with capacity 19.2 GB 17/03/01 04:10:49 INFO HttpFileServer: HTTP File server directory is /data/1/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/spark-cd64fe1d-3c10-47a1-887b-6b0be8854b62/httpd-36ccb4e4-ad0f-487e-bc5f-9dbd8484da22 17/03/01 04:10:49 INFO HttpServer: Starting HTTP Server 17/03/01 04:10:49 INFO Utils: Successfully started service 'HTTP file server' on port 35232. 17/03/01 04:10:49 INFO SparkEnv: Registering OutputCommitCoordinator 17/03/01 04:10:49 INFO JettyUtils: Adding filter: org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter 17/03/01 04:10:49 INFO Utils: Successfully started service 'SparkUI' on port 52424. 17/03/01 04:10:49 INFO SparkUI: Started SparkUI at http://ipaddress:52424 17/03/01 04:10:49 INFO YarnClusterScheduler: Created YarnClusterScheduler 17/03/01 04:10:49 WARN MetricsSystem: Using default name DAGScheduler for source because spark.app.id is not set. 17/03/01 04:10:50 INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 43498. 17/03/01 04:10:50 INFO NettyBlockTransferService: Server created on 43498 17/03/01 04:10:50 INFO BlockManagerMaster: Trying to register BlockManager 17/03/01 04:10:50 INFO BlockManagerMasterEndpoint: Registering block manager ipaddress:43498 with 19.2 GB RAM, BlockManagerId(driver, ipaddress, 43498) 17/03/01 04:10:50 INFO BlockManagerMaster: Registered BlockManager 17/03/01 04:10:50 INFO YarnSchedulerBackend$YarnSchedulerEndpoint: ApplicationMaster registered as AkkaRpcEndpointRef(Actor[akka://sparkDriver/user/YarnAM#-472514220]) 17/03/01 04:10:50 INFO YarnRMClient: Registering the ApplicationMaster 17/03/01 04:10:50 INFO ConfiguredRMFailoverProxyProvider: Failing over to rm281 17/03/01 04:10:50 INFO YarnAllocator: Will request 40 executor containers, each with 1 cores and 16896 MB memory including 1536 MB overhead 17/03/01 04:10:50 INFO YarnAllocator: Container request (host: Any, capability: ) 17/03/01 04:10:50 INFO YarnAllocator: Container request (host: Any, capability: ) 17/03/01 04:10:50 INFO YarnAllocator: Container request (host: Any, capability: ) 17/03/01 04:10:50 INFO YarnAllocator: Container request (host: Any, capability: ) 17/03/01 04:10:50 INFO YarnAllocator: Container request (host: Any, capability: ) 17/03/01 04:10:50 INFO YarnAllocator: Container request (host: Any, capability: ) 17/03/01 04:10:50 INFO YarnAllocator: Container request (host: Any, capability: ) 17/03/01 04:10:50 INFO YarnAllocator: Container request (host: Any, capability: ) 17/03/01 04:10:50 INFO YarnAllocator: Container request (host: Any, capability: ) 17/03/01 04:10:50 INFO YarnAllocator: Container request (host: Any, capability: ) 17/03/01 04:10:50 INFO YarnAllocator: Container request (host: Any, capability: ) 17/03/01 04:10:50 INFO YarnAllocator: Container request (host: Any, capability: ) 17/03/01 04:10:50 INFO YarnAllocator: Container request (host: Any, capability: ) 17/03/01 04:10:50 INFO YarnAllocator: Container request (host: Any, capability: ) 17/03/01 04:10:50 INFO YarnAllocator: Container request (host: Any, capability: ) 17/03/01 04:10:50 INFO YarnAllocator: Container request (host: Any, capability: ) 17/03/01 04:10:50 INFO YarnAllocator: Container request (host: Any, capability: ) 17/03/01 04:10:50 INFO YarnAllocator: Container request (host: Any, capability: ) 17/03/01 04:10:50 INFO YarnAllocator: Container request (host: Any, capability: ) 17/03/01 04:10:50 INFO YarnAllocator: Container request (host: Any, capability: ) 17/03/01 04:10:50 INFO YarnAllocator: Container request (host: Any, capability: ) 17/03/01 04:10:50 INFO YarnAllocator: Container request (host: Any, capability: ) 17/03/01 04:10:50 INFO YarnAllocator: Container request (host: Any, capability: ) 17/03/01 04:10:50 INFO YarnAllocator: Container request (host: Any, capability: ) 17/03/01 04:10:50 INFO YarnAllocator: Container request (host: Any, capability: ) 17/03/01 04:10:50 INFO YarnAllocator: Container request (host: Any, capability: ) 17/03/01 04:10:50 INFO YarnAllocator: Container request (host: Any, capability: ) 17/03/01 04:10:50 INFO YarnAllocator: Container request (host: Any, capability: ) 17/03/01 04:10:50 INFO YarnAllocator: Container request (host: Any, capability: ) 17/03/01 04:10:50 INFO YarnAllocator: Container request (host: Any, capability: ) 17/03/01 04:10:50 INFO YarnAllocator: Container request (host: Any, capability: ) 17/03/01 04:10:50 INFO YarnAllocator: Container request (host: Any, capability: ) 17/03/01 04:10:50 INFO YarnAllocator: Container request (host: Any, capability: ) 17/03/01 04:10:50 INFO YarnAllocator: Container request (host: Any, capability: ) 17/03/01 04:10:50 INFO YarnAllocator: Container request (host: Any, capability: ) 17/03/01 04:10:50 INFO YarnAllocator: Container request (host: Any, capability: ) 17/03/01 04:10:50 INFO YarnAllocator: Container request (host: Any, capability: ) 17/03/01 04:10:50 INFO YarnAllocator: Container request (host: Any, capability: ) 17/03/01 04:10:50 INFO YarnAllocator: Container request (host: Any, capability: ) 17/03/01 04:10:50 INFO YarnAllocator: Container request (host: Any, capability: ) 17/03/01 04:10:50 INFO ApplicationMaster: Started progress reporter thread with (heartbeat : 3000, initial allocation : 200) intervals 17/03/01 04:10:50 INFO AMRMClientImpl: Received new token for : hostName:8041 17/03/01 04:10:50 INFO AMRMClientImpl: Received new token for : hostName:8041 17/03/01 04:10:50 INFO AMRMClientImpl: Received new token for : hostName:8041 17/03/01 04:10:50 INFO AMRMClientImpl: Received new token for : hostName:8041 17/03/01 04:10:50 INFO AMRMClientImpl: Received new token for : hostName:8041 17/03/01 04:10:50 INFO AMRMClientImpl: Received new token for : hostName:8041 17/03/01 04:10:50 INFO AMRMClientImpl: Received new token for : hostName:8041 17/03/01 04:10:50 INFO AMRMClientImpl: Received new token for : hostName:8041 17/03/01 04:10:50 INFO AMRMClientImpl: Received new token for : hostName:8041 17/03/01 04:10:50 INFO AMRMClientImpl: Received new token for : hostName:8041 17/03/01 04:10:50 INFO AMRMClientImpl: Received new token for : hostName:8041 17/03/01 04:10:50 INFO AMRMClientImpl: Received new token for : hostName:8041 17/03/01 04:10:50 INFO AMRMClientImpl: Received new token for : hostName:8041 17/03/01 04:10:50 INFO AMRMClientImpl: Received new token for : hostName:8041 17/03/01 04:10:50 INFO AMRMClientImpl: Received new token for : hostName:8041 17/03/01 04:10:50 INFO AMRMClientImpl: Received new token for : hostName:8041 17/03/01 04:10:50 INFO AMRMClientImpl: Received new token for : hostName:8041 17/03/01 04:10:50 INFO AMRMClientImpl: Received new token for : hostName:8041 17/03/01 04:10:50 INFO AMRMClientImpl: Received new token for : hostName:8041 17/03/01 04:10:50 INFO AMRMClientImpl: Received new token for : hostName:8041 17/03/01 04:10:50 INFO AMRMClientImpl: Received new token for : hostName:8041 17/03/01 04:10:50 INFO AMRMClientImpl: Received new token for : hostName:8041 17/03/01 04:10:50 INFO AMRMClientImpl: Received new token for : hostName:8041 17/03/01 04:10:50 INFO AMRMClientImpl: Received new token for : hostName:8041 17/03/01 04:10:50 INFO AMRMClientImpl: Received new token for : hostName:8041 17/03/01 04:10:50 INFO AMRMClientImpl: Received new token for : hostName:8041 17/03/01 04:10:50 INFO AMRMClientImpl: Received new token for : hostName:8041 17/03/01 04:10:50 INFO AMRMClientImpl: Received new token for : hostName:8041 17/03/01 04:10:50 INFO AMRMClientImpl: Received new token for : hostName:8041 17/03/01 04:10:50 INFO AMRMClientImpl: Received new token for : hostName:8041 17/03/01 04:10:50 INFO AMRMClientImpl: Received new token for : hostName:8041 17/03/01 04:10:50 INFO AMRMClientImpl: Received new token for : hostName:8041 17/03/01 04:10:51 INFO YarnAllocator: Launching container container_e76_1487862040010_131981_01_000003 for on host hostName 17/03/01 04:10:51 INFO YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@ipaddress:38995/user/CoarseGrainedScheduler, executorHostname: hostName 17/03/01 04:10:51 INFO YarnAllocator: Launching container container_e76_1487862040010_131981_01_000004 for on host hostName 17/03/01 04:10:51 INFO ExecutorRunnable: Starting Executor Container 17/03/01 04:10:51 INFO YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@ipaddress:38995/user/CoarseGrainedScheduler, executorHostname: hostName 17/03/01 04:10:51 INFO YarnAllocator: Launching container container_e76_1487862040010_131981_01_000005 for on host hostName 17/03/01 04:10:51 INFO ExecutorRunnable: Starting Executor Container 17/03/01 04:10:51 INFO YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@ipaddress:38995/user/CoarseGrainedScheduler, executorHostname: hostName 17/03/01 04:10:51 INFO YarnAllocator: Launching container container_e76_1487862040010_131981_01_000007 for on host hostName 17/03/01 04:10:51 INFO ExecutorRunnable: Starting Executor Container 17/03/01 04:10:51 INFO YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@ipaddress:38995/user/CoarseGrainedScheduler, executorHostname: hostName 17/03/01 04:10:51 INFO YarnAllocator: Launching container container_e76_1487862040010_131981_01_000008 for on host hostName 17/03/01 04:10:51 INFO ExecutorRunnable: Starting Executor Container 17/03/01 04:10:51 INFO ContainerManagementProtocolProxy: yarn.client.max-cached-nodemanagers-proxies : 0 17/03/01 04:10:51 INFO ContainerManagementProtocolProxy: yarn.client.max-cached-nodemanagers-proxies : 0 17/03/01 04:10:51 INFO YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@ipaddress:38995/user/CoarseGrainedScheduler, executorHostname: hostName 17/03/01 04:10:51 INFO ContainerManagementProtocolProxy: yarn.client.max-cached-nodemanagers-proxies : 0 17/03/01 04:10:51 INFO ContainerManagementProtocolProxy: yarn.client.max-cached-nodemanagers-proxies : 0 17/03/01 04:10:51 INFO ExecutorRunnable: Setting up ContainerLaunchContext 17/03/01 04:10:51 INFO ExecutorRunnable: Setting up ContainerLaunchContext 17/03/01 04:10:51 INFO ExecutorRunnable: Setting up ContainerLaunchContext 17/03/01 04:10:51 INFO YarnAllocator: Launching container container_e76_1487862040010_131981_01_000009 for on host hostName 17/03/01 04:10:51 INFO ExecutorRunnable: Setting up ContainerLaunchContext 17/03/01 04:10:51 INFO ExecutorRunnable: Starting Executor Container 17/03/01 04:10:51 INFO ContainerManagementProtocolProxy: yarn.client.max-cached-nodemanagers-proxies : 0 17/03/01 04:10:51 INFO ExecutorRunnable: Setting up ContainerLaunchContext 17/03/01 04:10:51 INFO YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@ipaddress:38995/user/CoarseGrainedScheduler, executorHostname: hostName 17/03/01 04:10:51 INFO ExecutorRunnable: Starting Executor Container 17/03/01 04:10:51 INFO YarnAllocator: Launching container container_e76_1487862040010_131981_01_000010 for on host hostName 17/03/01 04:10:51 INFO ContainerManagementProtocolProxy: yarn.client.max-cached-nodemanagers-proxies : 0 17/03/01 04:10:51 INFO ExecutorRunnable: Setting up ContainerLaunchContext 17/03/01 04:10:51 INFO YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@ipaddress:38995/user/CoarseGrainedScheduler, executorHostname: hostName 17/03/01 04:10:51 INFO YarnAllocator: Launching container container_e76_1487862040010_131981_01_000011 for on host hostName 17/03/01 04:10:51 INFO ExecutorRunnable: Starting Executor Container 17/03/01 04:10:51 INFO ContainerManagementProtocolProxy: yarn.client.max-cached-nodemanagers-proxies : 0 17/03/01 04:10:51 INFO ExecutorRunnable: Setting up ContainerLaunchContext 17/03/01 04:10:51 INFO YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@ipaddress:38995/user/CoarseGrainedScheduler, executorHostname: hostName 17/03/01 04:10:51 INFO ExecutorRunnable: Starting Executor Container 17/03/01 04:10:51 INFO YarnAllocator: Launching container container_e76_1487862040010_131981_01_000012 for on host hostName 17/03/01 04:10:51 INFO ContainerManagementProtocolProxy: yarn.client.max-cached-nodemanagers-proxies : 0 17/03/01 04:10:51 INFO ExecutorRunnable: Setting up ContainerLaunchContext 17/03/01 04:10:51 INFO YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@ipaddress:38995/user/CoarseGrainedScheduler, executorHostname: hostName 17/03/01 04:10:51 INFO YarnAllocator: Launching container container_e76_1487862040010_131981_01_000013 for on host hostName 17/03/01 04:10:51 INFO ExecutorRunnable: Starting Executor Container 17/03/01 04:10:51 INFO ContainerManagementProtocolProxy: yarn.client.max-cached-nodemanagers-proxies : 0 17/03/01 04:10:51 INFO ExecutorRunnable: Setting up ContainerLaunchContext 17/03/01 04:10:51 INFO YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@ipaddress:38995/user/CoarseGrainedScheduler, executorHostname: hostName 17/03/01 04:10:51 INFO YarnAllocator: Launching container container_e76_1487862040010_131981_01_000014 for on host hostName 17/03/01 04:10:51 INFO ExecutorRunnable: Starting Executor Container 17/03/01 04:10:51 INFO ContainerManagementProtocolProxy: yarn.client.max-cached-nodemanagers-proxies : 0 17/03/01 04:10:51 INFO ExecutorRunnable: Setting up ContainerLaunchContext 17/03/01 04:10:51 INFO YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@ipaddress:38995/user/CoarseGrainedScheduler, executorHostname: hostName 17/03/01 04:10:51 INFO YarnAllocator: Launching container container_e76_1487862040010_131981_01_000015 for on host hostName 17/03/01 04:10:51 INFO ExecutorRunnable: Starting Executor Container 17/03/01 04:10:51 INFO ContainerManagementProtocolProxy: yarn.client.max-cached-nodemanagers-proxies : 0 17/03/01 04:10:51 INFO ExecutorRunnable: Setting up ContainerLaunchContext 17/03/01 04:10:51 INFO YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@ipaddress:38995/user/CoarseGrainedScheduler, executorHostname: hostName 17/03/01 04:10:51 INFO YarnAllocator: Launching container container_e76_1487862040010_131981_01_000016 for on host hostName 17/03/01 04:10:51 INFO ExecutorRunnable: Starting Executor Container 17/03/01 04:10:51 INFO ContainerManagementProtocolProxy: yarn.client.max-cached-nodemanagers-proxies : 0 17/03/01 04:10:51 INFO ExecutorRunnable: Setting up ContainerLaunchContext 17/03/01 04:10:51 INFO YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@ipaddress:38995/user/CoarseGrainedScheduler, executorHostname: hostName 17/03/01 04:10:51 INFO YarnAllocator: Launching container container_e76_1487862040010_131981_01_000017 for on host hostName 17/03/01 04:10:51 INFO ExecutorRunnable: Starting Executor Container 17/03/01 04:10:51 INFO ContainerManagementProtocolProxy: yarn.client.max-cached-nodemanagers-proxies : 0 17/03/01 04:10:51 INFO ExecutorRunnable: Preparing Local resources 17/03/01 04:10:51 INFO ExecutorRunnable: Preparing Local resources 17/03/01 04:10:51 INFO ExecutorRunnable: Preparing Local resources 17/03/01 04:10:51 INFO ExecutorRunnable: Preparing Local resources 17/03/01 04:10:51 INFO ExecutorRunnable: Preparing Local resources 17/03/01 04:10:51 INFO ExecutorRunnable: Setting up ContainerLaunchContext 17/03/01 04:10:51 INFO ExecutorRunnable: Preparing Local resources 17/03/01 04:10:51 INFO ExecutorRunnable: Preparing Local resources 17/03/01 04:10:51 INFO ExecutorRunnable: Preparing Local resources 17/03/01 04:10:51 INFO ExecutorRunnable: Preparing Local resources 17/03/01 04:10:51 INFO ExecutorRunnable: Preparing Local resources 17/03/01 04:10:51 INFO ExecutorRunnable: Preparing Local resources 17/03/01 04:10:51 INFO ExecutorRunnable: Preparing Local resources 17/03/01 04:10:51 INFO YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@ipaddress:38995/user/CoarseGrainedScheduler, executorHostname: hostName 17/03/01 04:10:51 INFO ExecutorRunnable: Preparing Local resources 17/03/01 04:10:51 INFO YarnAllocator: Launching container container_e76_1487862040010_131981_01_000018 for on host hostName 17/03/01 04:10:51 INFO ExecutorRunnable: Starting Executor Container 17/03/01 04:10:51 INFO YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@ipaddress:38995/user/CoarseGrainedScheduler, executorHostname: hostName 17/03/01 04:10:51 INFO YarnAllocator: Launching container container_e76_1487862040010_131981_01_000019 for on host hostName 17/03/01 04:10:51 INFO ContainerManagementProtocolProxy: yarn.client.max-cached-nodemanagers-proxies : 0 17/03/01 04:10:51 INFO ExecutorRunnable: Starting Executor Container 17/03/01 04:10:51 INFO ExecutorRunnable: Setting up ContainerLaunchContext 17/03/01 04:10:51 INFO ContainerManagementProtocolProxy: yarn.client.max-cached-nodemanagers-proxies : 0 17/03/01 04:10:51 INFO ExecutorRunnable: Preparing Local resources 17/03/01 04:10:51 INFO ExecutorRunnable: Setting up ContainerLaunchContext 17/03/01 04:10:51 INFO ExecutorRunnable: Preparing Local resources 17/03/01 04:10:51 INFO YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@ipaddress:38995/user/CoarseGrainedScheduler, executorHostname: hostName 17/03/01 04:10:51 INFO YarnAllocator: Launching container container_e76_1487862040010_131981_01_000020 for on host hostName 17/03/01 04:10:51 INFO ExecutorRunnable: Starting Executor Container 17/03/01 04:10:51 INFO ContainerManagementProtocolProxy: yarn.client.max-cached-nodemanagers-proxies : 0 17/03/01 04:10:51 INFO ExecutorRunnable: Setting up ContainerLaunchContext 17/03/01 04:10:51 INFO ExecutorRunnable: Preparing Local resources 17/03/01 04:10:51 INFO YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@ipaddress:38995/user/CoarseGrainedScheduler, executorHostname: hostName 17/03/01 04:10:51 INFO YarnAllocator: Launching container container_e76_1487862040010_131981_01_000021 for on host hostName 17/03/01 04:10:51 INFO ExecutorRunnable: Starting Executor Container 17/03/01 04:10:51 INFO ContainerManagementProtocolProxy: yarn.client.max-cached-nodemanagers-proxies : 0 17/03/01 04:10:51 INFO ExecutorRunnable: Setting up ContainerLaunchContext 17/03/01 04:10:51 INFO ExecutorRunnable: Preparing Local resources 17/03/01 04:10:51 INFO YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@ipaddress:38995/user/CoarseGrainedScheduler, executorHostname: hostName 17/03/01 04:10:51 INFO YarnAllocator: Launching container container_e76_1487862040010_131981_01_000022 for on host hostName 17/03/01 04:10:51 INFO ExecutorRunnable: Starting Executor Container 17/03/01 04:10:51 INFO ContainerManagementProtocolProxy: yarn.client.max-cached-nodemanagers-proxies : 0 17/03/01 04:10:51 INFO ExecutorRunnable: Setting up ContainerLaunchContext 17/03/01 04:10:51 INFO ExecutorRunnable: Preparing Local resources 17/03/01 04:10:51 INFO YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@ipaddress:38995/user/CoarseGrainedScheduler, executorHostname: hostName 17/03/01 04:10:51 INFO YarnAllocator: Launching container container_e76_1487862040010_131981_01_000023 for on host hostName 17/03/01 04:10:51 INFO ExecutorRunnable: Starting Executor Container 17/03/01 04:10:51 INFO ContainerManagementProtocolProxy: yarn.client.max-cached-nodemanagers-proxies : 0 17/03/01 04:10:51 INFO ExecutorRunnable: Setting up ContainerLaunchContext 17/03/01 04:10:51 INFO ExecutorRunnable: Preparing Local resources 17/03/01 04:10:51 INFO YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@ipaddress:38995/user/CoarseGrainedScheduler, executorHostname: hostName 17/03/01 04:10:51 INFO YarnAllocator: Launching container container_e76_1487862040010_131981_01_000024 for on host hostName 17/03/01 04:10:51 INFO ExecutorRunnable: Starting Executor Container 17/03/01 04:10:51 INFO ContainerManagementProtocolProxy: yarn.client.max-cached-nodemanagers-proxies : 0 17/03/01 04:10:51 INFO ExecutorRunnable: Setting up ContainerLaunchContext 17/03/01 04:10:51 INFO ExecutorRunnable: Preparing Local resources 17/03/01 04:10:51 INFO YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@ipaddress:38995/user/CoarseGrainedScheduler, executorHostname: hostName 17/03/01 04:10:51 INFO YarnAllocator: Launching container container_e76_1487862040010_131981_01_000025 for on host hostName 17/03/01 04:10:51 INFO ExecutorRunnable: Starting Executor Container 17/03/01 04:10:51 INFO ContainerManagementProtocolProxy: yarn.client.max-cached-nodemanagers-proxies : 0 17/03/01 04:10:51 INFO ExecutorRunnable: Setting up ContainerLaunchContext 17/03/01 04:10:51 INFO ExecutorRunnable: Preparing Local resources 17/03/01 04:10:51 INFO YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@ipaddress:38995/user/CoarseGrainedScheduler, executorHostname: hostName 17/03/01 04:10:51 INFO YarnAllocator: Launching container container_e76_1487862040010_131981_01_000026 for on host hostName 17/03/01 04:10:51 INFO ExecutorRunnable: Starting Executor Container 17/03/01 04:10:51 INFO ContainerManagementProtocolProxy: yarn.client.max-cached-nodemanagers-proxies : 0 17/03/01 04:10:51 INFO ExecutorRunnable: Setting up ContainerLaunchContext 17/03/01 04:10:51 INFO YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@ipaddress:38995/user/CoarseGrainedScheduler, executorHostname: hostName 17/03/01 04:10:51 INFO ExecutorRunnable: Preparing Local resources 17/03/01 04:10:51 INFO ExecutorRunnable: Starting Executor Container 17/03/01 04:10:51 INFO YarnAllocator: Launching container container_e76_1487862040010_131981_01_000027 for on host hostName 17/03/01 04:10:51 INFO ContainerManagementProtocolProxy: yarn.client.max-cached-nodemanagers-proxies : 0 17/03/01 04:10:51 INFO ExecutorRunnable: Setting up ContainerLaunchContext 17/03/01 04:10:51 INFO ExecutorRunnable: Preparing Local resources 17/03/01 04:10:51 INFO YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@ipaddress:38995/user/CoarseGrainedScheduler, executorHostname: hostName 17/03/01 04:10:51 INFO ExecutorRunnable: Starting Executor Container 17/03/01 04:10:51 INFO YarnAllocator: Launching container container_e76_1487862040010_131981_01_000028 for on host hostName 17/03/01 04:10:51 INFO ContainerManagementProtocolProxy: yarn.client.max-cached-nodemanagers-proxies : 0 17/03/01 04:10:51 INFO ExecutorRunnable: Setting up ContainerLaunchContext 17/03/01 04:10:51 INFO ExecutorRunnable: Preparing Local resources 17/03/01 04:10:51 INFO YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@ipaddress:38995/user/CoarseGrainedScheduler, executorHostname: hostName 17/03/01 04:10:51 INFO YarnAllocator: Launching container container_e76_1487862040010_131981_01_000029 for on host hostName 17/03/01 04:10:51 INFO ExecutorRunnable: Starting Executor Container 17/03/01 04:10:51 INFO ContainerManagementProtocolProxy: yarn.client.max-cached-nodemanagers-proxies : 0 17/03/01 04:10:51 INFO ExecutorRunnable: Setting up ContainerLaunchContext 17/03/01 04:10:51 INFO ExecutorRunnable: Preparing Local resources 17/03/01 04:10:51 INFO YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@ipaddress:38995/user/CoarseGrainedScheduler, executorHostname: hostName 17/03/01 04:10:51 INFO YarnAllocator: Launching container container_e76_1487862040010_131981_01_000030 for on host hostName 17/03/01 04:10:51 INFO YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@ipaddress:38995/user/CoarseGrainedScheduler, executorHostname: hostName 17/03/01 04:10:51 INFO YarnAllocator: Launching container container_e76_1487862040010_131981_01_000031 for on host hostName 17/03/01 04:10:51 INFO YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@ipaddress:38995/user/CoarseGrainedScheduler, executorHostname: hostName 17/03/01 04:10:51 INFO YarnAllocator: Launching container container_e76_1487862040010_131981_01_000032 for on host hostName 17/03/01 04:10:51 INFO YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@ipaddress:38995/user/CoarseGrainedScheduler, executorHostname: hostName 17/03/01 04:10:51 INFO YarnAllocator: Launching container container_e76_1487862040010_131981_01_000033 for on host hostName 17/03/01 04:10:51 INFO YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@ipaddress:38995/user/CoarseGrainedScheduler, executorHostname: hostName 17/03/01 04:10:51 INFO YarnAllocator: Launching container container_e76_1487862040010_131981_01_000034 for on host hostName 17/03/01 04:10:51 INFO YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@ipaddress:38995/user/CoarseGrainedScheduler, executorHostname: hostName 17/03/01 04:10:51 INFO YarnAllocator: Launching container container_e76_1487862040010_131981_01_000035 for on host hostName 17/03/01 04:10:51 INFO YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@ipaddress:38995/user/CoarseGrainedScheduler, executorHostname: hostName 17/03/01 04:10:51 INFO YarnAllocator: Received 32 containers from YARN, launching executors on 32 of them. 17/03/01 04:10:51 INFO ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "Venus" port: -1 file: "/user/userName/.sparkStaging/application_1487862040010_131981/MYAPP.jar" } size: 212472201 timestamp: 1488363040180 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "Venus" port: -1 file: "/user/userName/.sparkStaging/application_1487862040010_131981/spark-assembly-1.5.0-cdh5.5.2-hadoop2.6.0-cdh5.5.2.jar" } size: 103969580 timestamp: 1488363029627 type: FILE visibility: PRIVATE) 17/03/01 04:10:51 INFO ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "Venus" port: -1 file: "/user/userName/.sparkStaging/application_1487862040010_131981/MYAPP.jar" } size: 212472201 timestamp: 1488363040180 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "Venus" port: -1 file: "/user/userName/.sparkStaging/application_1487862040010_131981/spark-assembly-1.5.0-cdh5.5.2-hadoop2.6.0-cdh5.5.2.jar" } size: 103969580 timestamp: 1488363029627 type: FILE visibility: PRIVATE) 17/03/01 04:10:51 INFO ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "Venus" port: -1 file: "/user/userName/.sparkStaging/application_1487862040010_131981/MYAPP.jar" } size: 212472201 timestamp: 1488363040180 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "Venus" port: -1 file: "/user/userName/.sparkStaging/application_1487862040010_131981/spark-assembly-1.5.0-cdh5.5.2-hadoop2.6.0-cdh5.5.2.jar" } size: 103969580 timestamp: 1488363029627 type: FILE visibility: PRIVATE) 17/03/01 04:10:51 INFO ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "Venus" port: -1 file: "/user/userName/.sparkStaging/application_1487862040010_131981/MYAPP.jar" } size: 212472201 timestamp: 1488363040180 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "Venus" port: -1 file: "/user/userName/.sparkStaging/application_1487862040010_131981/spark-assembly-1.5.0-cdh5.5.2-hadoop2.6.0-cdh5.5.2.jar" } size: 103969580 timestamp: 1488363029627 type: FILE visibility: PRIVATE) 17/03/01 04:10:51 INFO ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "Venus" port: -1 file: "/user/userName/.sparkStaging/application_1487862040010_131981/MYAPP.jar" } size: 212472201 timestamp: 1488363040180 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "Venus" port: -1 file: "/user/userName/.sparkStaging/application_1487862040010_131981/spark-assembly-1.5.0-cdh5.5.2-hadoop2.6.0-cdh5.5.2.jar" } size: 103969580 timestamp: 1488363029627 type: FILE visibility: PRIVATE) 17/03/01 04:10:51 INFO ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "Venus" port: -1 file: "/user/userName/.sparkStaging/application_1487862040010_131981/MYAPP.jar" } size: 212472201 timestamp: 1488363040180 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "Venus" port: -1 file: "/user/userName/.sparkStaging/application_1487862040010_131981/spark-assembly-1.5.0-cdh5.5.2-hadoop2.6.0-cdh5.5.2.jar" } size: 103969580 timestamp: 1488363029627 type: FILE visibility: PRIVATE) 17/03/01 04:10:51 INFO ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "Venus" port: -1 file: "/user/userName/.sparkStaging/application_1487862040010_131981/MYAPP.jar" } size: 212472201 timestamp: 1488363040180 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "Venus" port: -1 file: "/user/userName/.sparkStaging/application_1487862040010_131981/spark-assembly-1.5.0-cdh5.5.2-hadoop2.6.0-cdh5.5.2.jar" } size: 103969580 timestamp: 1488363029627 type: FILE visibility: PRIVATE) 17/03/01 04:10:51 INFO ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "Venus" port: -1 file: "/user/userName/.sparkStaging/application_1487862040010_131981/MYAPP.jar" } size: 212472201 timestamp: 1488363040180 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "Venus" port: -1 file: "/user/userName/.sparkStaging/application_1487862040010_131981/spark-assembly-1.5.0-cdh5.5.2-hadoop2.6.0-cdh5.5.2.jar" } size: 103969580 timestamp: 1488363029627 type: FILE visibility: PRIVATE) 17/03/01 04:10:51 INFO ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "Venus" port: -1 file: "/user/userName/.sparkStaging/application_1487862040010_131981/MYAPP.jar" } size: 212472201 timestamp: 1488363040180 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "Venus" port: -1 file: "/user/userName/.sparkStaging/application_1487862040010_131981/spark-assembly-1.5.0-cdh5.5.2-hadoop2.6.0-cdh5.5.2.jar" } size: 103969580 timestamp: 1488363029627 type: FILE visibility: PRIVATE) 17/03/01 04:10:51 INFO ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "Venus" port: -1 file: "/user/userName/.sparkStaging/application_1487862040010_131981/MYAPP.jar" } size: 212472201 timestamp: 1488363040180 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "Venus" port: -1 file: "/user/userName/.sparkStaging/application_1487862040010_131981/spark-assembly-1.5.0-cdh5.5.2-hadoop2.6.0-cdh5.5.2.jar" } size: 103969580 timestamp: 1488363029627 type: FILE visibility: PRIVATE) 17/03/01 04:10:51 INFO ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "Venus" port: -1 file: "/user/userName/.sparkStaging/application_1487862040010_131981/MYAPP.jar" } size: 212472201 timestamp: 1488363040180 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "Venus" port: -1 file: "/user/userName/.sparkStaging/application_1487862040010_131981/spark-assembly-1.5.0-cdh5.5.2-hadoop2.6.0-cdh5.5.2.jar" } size: 103969580 timestamp: 1488363029627 type: FILE visibility: PRIVATE) 17/03/01 04:10:51 INFO ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "Venus" port: -1 file: "/user/userName/.sparkStaging/application_1487862040010_131981/MYAPP.jar" } size: 212472201 timestamp: 1488363040180 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "Venus" port: -1 file: "/user/userName/.sparkStaging/application_1487862040010_131981/spark-assembly-1.5.0-cdh5.5.2-hadoop2.6.0-cdh5.5.2.jar" } size: 103969580 timestamp: 1488363029627 type: FILE visibility: PRIVATE) 17/03/01 04:10:51 INFO ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "Venus" port: -1 file: "/user/userName/.sparkStaging/application_1487862040010_131981/MYAPP.jar" } size: 212472201 timestamp: 1488363040180 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "Venus" port: -1 file: "/user/userName/.sparkStaging/application_1487862040010_131981/spark-assembly-1.5.0-cdh5.5.2-hadoop2.6.0-cdh5.5.2.jar" } size: 103969580 timestamp: 1488363029627 type: FILE visibility: PRIVATE) 17/03/01 04:10:51 INFO ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "Venus" port: -1 file: "/user/userName/.sparkStaging/application_1487862040010_131981/MYAPP.jar" } size: 212472201 timestamp: 1488363040180 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "Venus" port: -1 file: "/user/userName/.sparkStaging/application_1487862040010_131981/spark-assembly-1.5.0-cdh5.5.2-hadoop2.6.0-cdh5.5.2.jar" } size: 103969580 timestamp: 1488363029627 type: FILE visibility: PRIVATE) 17/03/01 04:10:51 INFO ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "Venus" port: -1 file: "/user/userName/.sparkStaging/application_1487862040010_131981/MYAPP.jar" } size: 212472201 timestamp: 1488363040180 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "Venus" port: -1 file: "/user/userName/.sparkStaging/application_1487862040010_131981/spark-assembly-1.5.0-cdh5.5.2-hadoop2.6.0-cdh5.5.2.jar" } size: 103969580 timestamp: 1488363029627 type: FILE visibility: PRIVATE) 17/03/01 04:10:51 INFO ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "Venus" port: -1 file: "/user/userName/.sparkStaging/application_1487862040010_131981/MYAPP.jar" } size: 212472201 timestamp: 1488363040180 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "Venus" port: -1 file: "/user/userName/.sparkStaging/application_1487862040010_131981/spark-assembly-1.5.0-cdh5.5.2-hadoop2.6.0-cdh5.5.2.jar" } size: 103969580 timestamp: 1488363029627 type: FILE visibility: PRIVATE) 17/03/01 04:10:51 INFO ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "Venus" port: -1 file: "/user/userName/.sparkStaging/application_1487862040010_131981/MYAPP.jar" } size: 212472201 timestamp: 1488363040180 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "Venus" port: -1 file: "/user/userName/.sparkStaging/application_1487862040010_131981/spark-assembly-1.5.0-cdh5.5.2-hadoop2.6.0-cdh5.5.2.jar" } size: 103969580 timestamp: 1488363029627 type: FILE visibility: PRIVATE) 17/03/01 04:10:51 INFO ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "Venus" port: -1 file: "/user/userName/.sparkStaging/application_1487862040010_131981/MYAPP.jar" } size: 212472201 timestamp: 1488363040180 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "Venus" port: -1 file: "/user/userName/.sparkStaging/application_1487862040010_131981/spark-assembly-1.5.0-cdh5.5.2-hadoop2.6.0-cdh5.5.2.jar" } size: 103969580 timestamp: 1488363029627 type: FILE visibility: PRIVATE) 17/03/01 04:10:51 INFO ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "Venus" port: -1 file: "/user/userName/.sparkStaging/application_1487862040010_131981/MYAPP.jar" } size: 212472201 timestamp: 1488363040180 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "Venus" port: -1 file: "/user/userName/.sparkStaging/application_1487862040010_131981/spark-assembly-1.5.0-cdh5.5.2-hadoop2.6.0-cdh5.5.2.jar" } size: 103969580 timestamp: 1488363029627 type: FILE visibility: PRIVATE) 17/03/01 04:10:51 INFO ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "Venus" port: -1 file: "/user/userName/.sparkStaging/application_1487862040010_131981/MYAPP.jar" } size: 212472201 timestamp: 1488363040180 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "Venus" port: -1 file: "/user/userName/.sparkStaging/application_1487862040010_131981/spark-assembly-1.5.0-cdh5.5.2-hadoop2.6.0-cdh5.5.2.jar" } size: 103969580 timestamp: 1488363029627 type: FILE visibility: PRIVATE) 17/03/01 04:10:51 INFO ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "Venus" port: -1 file: "/user/userName/.sparkStaging/application_1487862040010_131981/MYAPP.jar" } size: 212472201 timestamp: 1488363040180 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "Venus" port: -1 file: "/user/userName/.sparkStaging/application_1487862040010_131981/spark-assembly-1.5.0-cdh5.5.2-hadoop2.6.0-cdh5.5.2.jar" } size: 103969580 timestamp: 1488363029627 type: FILE visibility: PRIVATE) 17/03/01 04:10:51 INFO ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "Venus" port: -1 file: "/user/userName/.sparkStaging/application_1487862040010_131981/MYAPP.jar" } size: 212472201 timestamp: 1488363040180 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "Venus" port: -1 file: "/user/userName/.sparkStaging/application_1487862040010_131981/spark-assembly-1.5.0-cdh5.5.2-hadoop2.6.0-cdh5.5.2.jar" } size: 103969580 timestamp: 1488363029627 type: FILE visibility: PRIVATE) 17/03/01 04:10:51 INFO ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "Venus" port: -1 file: "/user/userName/.sparkStaging/application_1487862040010_131981/MYAPP.jar" } size: 212472201 timestamp: 1488363040180 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "Venus" port: -1 file: "/user/userName/.sparkStaging/application_1487862040010_131981/spark-assembly-1.5.0-cdh5.5.2-hadoop2.6.0-cdh5.5.2.jar" } size: 103969580 timestamp: 1488363029627 type: FILE visibility: PRIVATE) 17/03/01 04:10:51 INFO ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "Venus" port: -1 file: "/user/userName/.sparkStaging/application_1487862040010_131981/MYAPP.jar" } size: 212472201 timestamp: 1488363040180 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "Venus" port: -1 file: "/user/userName/.sparkStaging/application_1487862040010_131981/spark-assembly-1.5.0-cdh5.5.2-hadoop2.6.0-cdh5.5.2.jar" } size: 103969580 timestamp: 1488363029627 type: FILE visibility: PRIVATE) 17/03/01 04:10:51 INFO ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "Venus" port: -1 file: "/user/userName/.sparkStaging/application_1487862040010_131981/MYAPP.jar" } size: 212472201 timestamp: 1488363040180 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "Venus" port: -1 file: "/user/userName/.sparkStaging/application_1487862040010_131981/spark-assembly-1.5.0-cdh5.5.2-hadoop2.6.0-cdh5.5.2.jar" } size: 103969580 timestamp: 1488363029627 type: FILE visibility: PRIVATE) 17/03/01 04:10:51 INFO AMRMClientImpl: Received new token for : hostName:8041 17/03/01 04:10:51 INFO AMRMClientImpl: Received new token for : hostName:8041 17/03/01 04:10:51 INFO AMRMClientImpl: Received new token for : hostName:8041 17/03/01 04:10:51 INFO AMRMClientImpl: Received new token for : hostName:8041 17/03/01 04:10:51 INFO AMRMClientImpl: Received new token for : hostName:8041 17/03/01 04:10:51 INFO AMRMClientImpl: Received new token for : hostName:8041 17/03/01 04:10:51 INFO AMRMClientImpl: Received new token for : hostName:8041 17/03/01 04:10:51 INFO AMRMClientImpl: Received new token for : hostName:8041 17/03/01 04:10:51 INFO ExecutorRunnable: =============================================================================== YARN executor launch context: =============================================================================== 17/03/01 04:10:51 INFO ContainerManagementProtocolProxy: Opening proxy : hostName:8041 17/03/01 04:10:51 INFO ExecutorRunnable: =============================================================================== YARN executor launch context: env: CLASSPATH -> MYAPP.jar{{PWD}}{{PWD}}/__spark__.jar$HADOOP_CLIENT_CONF_DIR$HADOOP_CONF_DIR$HADOOP_COMMON_HOME/*$HADOOP_COMMON_HOME/lib/*$HADOOP_HDFS_HOME/*$HADOOP_HDFS_HOME/lib/*$HADOOP_YARN_HOME/*$HADOOP_YARN_HOME/lib/*/hadoop/cloudera/parcels/DISTCP_AWS_S3$HADOOP_MAPRED_HOME/*$HADOOP_MAPRED_HOME/lib/*$MR2_CLASSPATH/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/ST4-4.0.4.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/accumulo-core-1.6.0.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/accumulo-fate-1.6.0.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/accumulo-start-1.6.0.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/accumulo-trace-1.6.0.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/activation-1.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/ant-1.9.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/ant-launcher-1.9.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/antlr-2.7.7.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/antlr-runtime-3.4.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/aopalliance-1.0.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/apache-log4j-extras-1.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/apache-log4j-extras-1.2.17.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/apacheds-i18n-2.0.0-M15.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/apacheds-kerberos-codec-2.0.0-M15.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/api-asn1-api-1.0.0-M20.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/api-util-1.0.0-M20.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/asm-3.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/asm-commons-3.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/asm-tree-3.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/async-1.4.0.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/asynchbase-1.5.0.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/avro-1.7.6-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/avro-compiler-1.7.6-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/avro-ipc-1.7.6-cdh5.5.2-tests.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/avro-ipc-1.7.6-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/avro-mapred-1.7.6-cdh5.5.2-hadoop2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/avro-maven-plugin-1.7.6-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/avro-protobuf-1.7.6-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/avro-service-archetype-1.7.6-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/avro-thrift-1.7.6-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/aws-java-sdk-core-1.10.6.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/aws-java-sdk-kms-1.10.6.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/aws-java-sdk-s3-1.10.6.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/bonecp-0.8.0.RELEASE.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/calcite-avatica-1.0.0-incubating.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/calcite-core-1.0.0-incubating.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/calcite-linq4j-1.0.0-incubating.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/commons-beanutils-1.7.0.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/commons-beanutils-core-1.8.0.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/commons-cli-1.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/commons-codec-1.4.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/commons-codec-1.8.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/commons-collections-3.2.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/commons-compiler-2.7.6.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/commons-compress-1.4.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/commons-configuration-1.6.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/commons-daemon-1.0.13.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/commons-dbcp-1.4.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/commons-digester-1.8.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/commons-el-1.0.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/commons-httpclient-3.0.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/commons-httpclient-3.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/commons-io-2.4.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/commons-jexl-2.1.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/commons-lang-2.6.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/commons-logging-1.1.3.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/commons-math-2.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/commons-math3-3.1.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/commons-net-3.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/commons-pool-1.5.4.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/commons-vfs2-2.0.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/curator-client-2.6.0.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/curator-client-2.7.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/curator-framework-2.6.0.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/curator-framework-2.7.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/curator-recipes-2.6.0.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/curator-recipes-2.7.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/datanucleus-api-jdo-3.2.6.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/datanucleus-core-3.2.10.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/datanucleus-rdbms-3.2.9.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/derby-10.11.1.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/eigenbase-properties-1.1.4.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/fastutil-6.3.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/flume-avro-source-1.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/flume-dataset-sink-1.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/flume-file-channel-1.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/flume-hdfs-sink-1.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/flume-hive-sink-1.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/flume-irc-sink-1.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/flume-jdbc-channel-1.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/flume-jms-source-1.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/flume-kafka-channel-1.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/flume-kafka-source-1.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/flume-ng-auth-1.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/flume-ng-elasticsearch-sink-1.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/flume-ng-embedded-agent-1.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/flume-ng-hbase-sink-1.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/flume-ng-kafka-sink-1.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/flume-ng-log4jappender-1.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/flume-ng-morphline-solr-sink-1.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/flume-ng-node-1.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/flume-scribe-source-1.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/flume-spillable-memory-channel-1.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/flume-taildir-source-1.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/flume-thrift-source-1.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/flume-tools-1.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/flume-twitter-source-1.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/geronimo-annotation_1.0_spec-1.1.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/geronimo-jaspic_1.0_spec-1.0.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/geronimo-jta_1.1_spec-1.1.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/groovy-all-2.4.4.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/gson-2.2.4.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/guava-11.0.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/guava-11.0.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/guava-14.0.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/guice-3.0.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/guice-servlet-3.0.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-annotations-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-ant-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-archive-logs-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-archives-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-auth-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-aws-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-azure-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-common-2.6.0-cdh5.5.2-tests.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-common-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-datajoin-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-distcp-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-extras-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-gridmix-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-hdfs-2.6.0-cdh5.5.2-tests.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-hdfs-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-hdfs-nfs-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-mapreduce-client-app-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-mapreduce-client-common-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-mapreduce-client-core-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-mapreduce-client-hs-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-mapreduce-client-hs-plugins-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-mapreduce-client-jobclient-2.6.0-cdh5.5.2-tests.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-mapreduce-client-jobclient-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-mapreduce-client-nativetask-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-mapreduce-client-shuffle-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-mapreduce-examples-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-nfs-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-openstack-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-rumen-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-sls-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-streaming-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-yarn-api-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-yarn-applications-distributedshell-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-yarn-applications-unmanaged-am-launcher-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-yarn-client-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-yarn-common-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-yarn-registry-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-yarn-server-applicationhistoryservice-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-yarn-server-common-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-yarn-server-nodemanager-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-yarn-server-resourcemanager-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-yarn-server-tests-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-yarn-server-web-proxy-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hamcrest-core-1.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hamcrest-core-1.3.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hbase-client-1.0.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hbase-common-1.0.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hbase-hadoop-compat-1.0.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hbase-hadoop2-compat-1.0.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hbase-protocol-1.0.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hbase-server-1.0.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/high-scale-lib-1.1.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hive-accumulo-handler-1.1.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hive-ant-1.1.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hive-beeline-1.1.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hive-cli-1.1.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hive-common-1.1.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hive-contrib-1.1.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hive-exec-1.1.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hive-hbase-handler-1.1.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hive-hwi-1.1.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hive-jdbc-1.1.0-cdh5.5.2-standalone.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hive-jdbc-1.1.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hive-metastore-1.1.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hive-serde-1.1.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hive-service-1.1.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hive-shims-0.23-1.1.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hive-shims-1.1.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hive-shims-common-1.1.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hive-shims-scheduler-1.1.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hive-testutils-1.1.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/htrace-core-3.2.0-incubating.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/htrace-core4-4.0.1-incubating.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/httpclient-4.2.5.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/httpcore-4.2.5.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hue-plugins-3.9.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/irclib-1.10.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jackson-annotations-2.2.3.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jackson-core-2.2.3.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jackson-core-asl-1.8.8.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jackson-databind-2.2.3.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jackson-jaxrs-1.8.8.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jackson-mapper-asl-1.8.8.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jackson-xc-1.8.8.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/janino-2.7.6.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jasper-compiler-5.5.23.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jasper-runtime-5.5.23.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/java-xmlbuilder-0.4.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/javax.inject-1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jaxb-api-2.2.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jaxb-impl-2.2.3-1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jcommander-1.32.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jdo-api-3.0.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jersey-client-1.9.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jersey-core-1.9.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jersey-guice-1.9.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jersey-json-1.9.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jersey-server-1.9.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jets3t-0.9.0.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jettison-1.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jetty-6.1.26.cloudera.4.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jetty-all-7.6.0.v20120127.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jetty-all-server-7.6.0.v20120127.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jetty-util-6.1.26.cloudera.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jetty-util-6.1.26.cloudera.4.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jline-2.11.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jline-2.12.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/joda-time-2.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jopt-simple-3.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jpam-1.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jsch-0.1.42.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jsp-api-2.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jsr305-1.3.9.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jsr305-3.0.0.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jta-1.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/junit-4.11.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/kafka_2.10-0.8.1.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/kite-data-core-1.0.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/kite-data-hbase-1.0.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/kite-data-hive-1.0.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/kite-hadoop-compatibility-1.0.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/leveldbjni-all-1.8.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/libfb303-0.9.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/libthrift-0.9.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/log4j-1.2.16.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/log4j-1.2.17.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/logredactor-1.0.3.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/mail-1.4.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/mapdb-0.9.9.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/maven-scm-api-1.4.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/maven-scm-provider-svn-commons-1.4.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/maven-scm-provider-svnexe-1.4.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/metrics-core-2.2.0.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/metrics-core-3.0.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/metrics-json-3.0.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/metrics-jvm-3.0.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/microsoft-windowsazure-storage-sdk-0.6.0.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/mina-core-2.0.4.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/mockito-all-1.8.5.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/netty-3.6.2.Final.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/netty-all-4.0.23.Final.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/opencsv-2.3.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/oro-2.0.8.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/paranamer-2.3.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/parquet-avro-1.5.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/parquet-cascading-1.5.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/parquet-column-1.5.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/parquet-common-1.5.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/parquet-encoding-1.5.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/parquet-format-2.1.0-cdh5.5.2-javadoc.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/parquet-format-2.1.0-cdh5.5.2-sources.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/parquet-format-2.1.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/parquet-generator-1.5.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/parquet-hadoop-1.5.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/parquet-hadoop-bundle-1.5.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/parquet-jackson-1.5.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/parquet-pig-1.5.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/parquet-pig-bundle-1.5.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/parquet-protobuf-1.5.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/parquet-scala_2.10-1.5.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/parquet-scrooge_2.10-1.5.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/parquet-test-hadoop2-1.5.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/parquet-thrift-1.5.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/parquet-tools-1.5.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/pentaho-aggdesigner-algorithm-5.1.5-jhyde.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/plexus-utils-1.5.6.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/protobuf-java-2.5.0.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/regexp-1.3.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/scala-library-2.10.4.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/serializer-2.7.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/servlet-api-2.5-20110124.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/servlet-api-2.5.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/slf4j-api-1.7.5.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/slf4j-log4j12-1.7.5.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/snappy-java-1.0.4.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/spark-1.5.0-cdh5.5.2-yarn-shuffle.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/stax-api-1.0-2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/stax-api-1.0.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/stringtemplate-3.2.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/super-csv-2.2.0.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/tempus-fugit-1.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/trevni-avro-1.7.6-cdh5.5.2-hadoop2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/trevni-avro-1.7.6-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/trevni-core-1.7.6-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/twitter4j-core-3.0.3.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/twitter4j-media-support-3.0.3.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/twitter4j-stream-3.0.3.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/unused-1.0.0.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/velocity-1.5.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/velocity-1.7.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/xalan-2.7.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/xercesImpl-2.9.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/xml-apis-1.3.04.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/xmlenc-0.52.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/xz-1.0.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/zkclient-0.3.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/zookeeper-3.4.5-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/lib/flume-ng/lib/flume-ng-configuration-1.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/lib/flume-ng/lib/flume-ng-core-1.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/lib/flume-ng/lib/flume-ng-sdk-1.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/lib/flume-ng/lib/spark-streaming-flume-sink_2.10-1.5.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/lib/hadoop/LICENSE.txt:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/lib/hadoop/NOTICE.txt:/hadoop/cloudera/parcels/GPLEXTRAS-5.5.2-1.cdh5.5.2.p0.4/lib/hadoop/lib/COPYING.hadoop-lzo:/hadoop/cloudera/parcels/GPLEXTRAS-5.5.2-1.cdh5.5.2.p0.4/lib/hadoop/lib/hadoop-lzo-0.4.15-cdh5.5.2.jar:/hadoop/cloudera/parcels/GPLEXTRAS-5.5.2-1.cdh5.5.2.p0.4/lib/spark-netlib/lib/jniloader-1.1.jar:/hadoop/cloudera/parcels/GPLEXTRAS-5.5.2-1.cdh5.5.2.p0.4/lib/spark-netlib/lib/native_ref-java-1.1.jar:/hadoop/cloudera/parcels/GPLEXTRAS-5.5.2-1.cdh5.5.2.p0.4/lib/spark-netlib/lib/native_system-java-1.1.jar:/hadoop/cloudera/parcels/GPLEXTRAS-5.5.2-1.cdh5.5.2.p0.4/lib/spark-netlib/lib/netlib-native_ref-linux-x86_64-1.1-natives.jar:/hadoop/cloudera/parcels/GPLEXTRAS-5.5.2-1.cdh5.5.2.p0.4/lib/spark-netlib/lib/netlib-native_system-linux-x86_64-1.1-natives.jar SPARK_LOG_URL_STDERR -> http://hostName:8042/node/containerlogs/container_e76_1487862040010_131981_01_000043/userName/stderr?start=-4096 SPARK_DIST_CLASSPATH -> /hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/ST4-4.0.4.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/accumulo-core-1.6.0.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/accumulo-fate-1.6.0.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/accumulo-start-1.6.0.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/accumulo-trace-1.6.0.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/activation-1.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/ant-1.9.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/ant-launcher-1.9.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/antlr-2.7.7.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/antlr-runtime-3.4.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/aopalliance-1.0.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/apache-log4j-extras-1.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/apache-log4j-extras-1.2.17.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/apacheds-i18n-2.0.0-M15.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/apacheds-kerberos-codec-2.0.0-M15.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/api-asn1-api-1.0.0-M20.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/api-util-1.0.0-M20.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/asm-3.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/asm-commons-3.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/asm-tree-3.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/async-1.4.0.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/asynchbase-1.5.0.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/avro-1.7.6-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/avro-compiler-1.7.6-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/avro-ipc-1.7.6-cdh5.5.2-tests.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/avro-ipc-1.7.6-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/avro-mapred-1.7.6-cdh5.5.2-hadoop2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/avro-maven-plugin-1.7.6-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/avro-protobuf-1.7.6-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/avro-service-archetype-1.7.6-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/avro-thrift-1.7.6-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/aws-java-sdk-core-1.10.6.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/aws-java-sdk-kms-1.10.6.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/aws-java-sdk-s3-1.10.6.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/bonecp-0.8.0.RELEASE.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/calcite-avatica-1.0.0-incubating.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/calcite-core-1.0.0-incubating.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/calcite-linq4j-1.0.0-incubating.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/commons-beanutils-1.7.0.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/commons-beanutils-core-1.8.0.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/commons-cli-1.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/commons-codec-1.4.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/commons-codec-1.8.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/commons-collections-3.2.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/commons-compiler-2.7.6.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/commons-compress-1.4.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/commons-configuration-1.6.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/commons-daemon-1.0.13.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/commons-dbcp-1.4.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/commons-digester-1.8.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/commons-el-1.0.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/commons-httpclient-3.0.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/commons-httpclient-3.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/commons-io-2.4.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/commons-jexl-2.1.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/commons-lang-2.6.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/commons-logging-1.1.3.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/commons-math-2.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/commons-math3-3.1.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/commons-net-3.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/commons-pool-1.5.4.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/commons-vfs2-2.0.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/curator-client-2.6.0.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/curator-client-2.7.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/curator-framework-2.6.0.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/curator-framework-2.7.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/curator-recipes-2.6.0.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/curator-recipes-2.7.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/datanucleus-api-jdo-3.2.6.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/datanucleus-core-3.2.10.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/datanucleus-rdbms-3.2.9.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/derby-10.11.1.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/eigenbase-properties-1.1.4.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/fastutil-6.3.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/flume-avro-source-1.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/flume-dataset-sink-1.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/flume-file-channel-1.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/flume-hdfs-sink-1.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/flume-hive-sink-1.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/flume-irc-sink-1.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/flume-jdbc-channel-1.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/flume-jms-source-1.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/flume-kafka-channel-1.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/flume-kafka-source-1.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/flume-ng-auth-1.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/flume-ng-elasticsearch-sink-1.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/flume-ng-embedded-agent-1.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/flume-ng-hbase-sink-1.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/flume-ng-kafka-sink-1.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/flume-ng-log4jappender-1.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/flume-ng-morphline-solr-sink-1.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/flume-ng-node-1.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/flume-scribe-source-1.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/flume-spillable-memory-channel-1.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/flume-taildir-source-1.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/flume-thrift-source-1.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/flume-tools-1.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/flume-twitter-source-1.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/geronimo-annotation_1.0_spec-1.1.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/geronimo-jaspic_1.0_spec-1.0.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/geronimo-jta_1.1_spec-1.1.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/groovy-all-2.4.4.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/gson-2.2.4.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/guava-11.0.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/guava-11.0.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/guava-14.0.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/guice-3.0.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/guice-servlet-3.0.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-annotations-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-ant-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-archive-logs-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-archives-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-auth-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-aws-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-azure-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-common-2.6.0-cdh5.5.2-tests.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-common-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-datajoin-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-distcp-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-extras-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-gridmix-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-hdfs-2.6.0-cdh5.5.2-tests.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-hdfs-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-hdfs-nfs-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-mapreduce-client-app-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-mapreduce-client-common-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-mapreduce-client-core-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-mapreduce-client-hs-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-mapreduce-client-hs-plugins-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-mapreduce-client-jobclient-2.6.0-cdh5.5.2-tests.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-mapreduce-client-jobclient-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-mapreduce-client-nativetask-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-mapreduce-client-shuffle-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-mapreduce-examples-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-nfs-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-openstack-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-rumen-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-sls-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-streaming-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-yarn-api-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-yarn-applications-distributedshell-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-yarn-applications-unmanaged-am-launcher-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-yarn-client-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-yarn-common-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-yarn-registry-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-yarn-server-applicationhistoryservice-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-yarn-server-common-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-yarn-server-nodemanager-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-yarn-server-resourcemanager-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-yarn-server-tests-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hadoop-yarn-server-web-proxy-2.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hamcrest-core-1.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hamcrest-core-1.3.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hbase-client-1.0.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hbase-common-1.0.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hbase-hadoop-compat-1.0.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hbase-hadoop2-compat-1.0.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hbase-protocol-1.0.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hbase-server-1.0.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/high-scale-lib-1.1.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hive-accumulo-handler-1.1.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hive-ant-1.1.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hive-beeline-1.1.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hive-cli-1.1.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hive-common-1.1.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hive-contrib-1.1.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hive-exec-1.1.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hive-hbase-handler-1.1.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hive-hwi-1.1.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hive-jdbc-1.1.0-cdh5.5.2-standalone.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hive-jdbc-1.1.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hive-metastore-1.1.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hive-serde-1.1.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hive-service-1.1.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hive-shims-0.23-1.1.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hive-shims-1.1.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hive-shims-common-1.1.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hive-shims-scheduler-1.1.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hive-testutils-1.1.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/htrace-core-3.2.0-incubating.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/htrace-core4-4.0.1-incubating.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/httpclient-4.2.5.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/httpcore-4.2.5.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/hue-plugins-3.9.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/irclib-1.10.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jackson-annotations-2.2.3.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jackson-core-2.2.3.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jackson-core-asl-1.8.8.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jackson-databind-2.2.3.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jackson-jaxrs-1.8.8.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jackson-mapper-asl-1.8.8.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jackson-xc-1.8.8.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/janino-2.7.6.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jasper-compiler-5.5.23.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jasper-runtime-5.5.23.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/java-xmlbuilder-0.4.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/javax.inject-1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jaxb-api-2.2.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jaxb-impl-2.2.3-1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jcommander-1.32.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jdo-api-3.0.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jersey-client-1.9.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jersey-core-1.9.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jersey-guice-1.9.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jersey-json-1.9.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jersey-server-1.9.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jets3t-0.9.0.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jettison-1.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jetty-6.1.26.cloudera.4.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jetty-all-7.6.0.v20120127.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jetty-all-server-7.6.0.v20120127.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jetty-util-6.1.26.cloudera.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jetty-util-6.1.26.cloudera.4.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jline-2.11.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jline-2.12.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/joda-time-2.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jopt-simple-3.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jpam-1.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jsch-0.1.42.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jsp-api-2.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jsr305-1.3.9.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jsr305-3.0.0.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/jta-1.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/junit-4.11.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/kafka_2.10-0.8.1.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/kite-data-core-1.0.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/kite-data-hbase-1.0.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/kite-data-hive-1.0.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/kite-hadoop-compatibility-1.0.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/leveldbjni-all-1.8.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/libfb303-0.9.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/libthrift-0.9.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/log4j-1.2.16.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/log4j-1.2.17.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/logredactor-1.0.3.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/mail-1.4.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/mapdb-0.9.9.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/maven-scm-api-1.4.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/maven-scm-provider-svn-commons-1.4.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/maven-scm-provider-svnexe-1.4.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/metrics-core-2.2.0.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/metrics-core-3.0.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/metrics-json-3.0.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/metrics-jvm-3.0.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/microsoft-windowsazure-storage-sdk-0.6.0.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/mina-core-2.0.4.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/mockito-all-1.8.5.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/netty-3.6.2.Final.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/netty-all-4.0.23.Final.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/opencsv-2.3.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/oro-2.0.8.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/paranamer-2.3.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/parquet-avro-1.5.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/parquet-cascading-1.5.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/parquet-column-1.5.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/parquet-common-1.5.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/parquet-encoding-1.5.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/parquet-format-2.1.0-cdh5.5.2-javadoc.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/parquet-format-2.1.0-cdh5.5.2-sources.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/parquet-format-2.1.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/parquet-generator-1.5.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/parquet-hadoop-1.5.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/parquet-hadoop-bundle-1.5.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/parquet-jackson-1.5.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/parquet-pig-1.5.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/parquet-pig-bundle-1.5.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/parquet-protobuf-1.5.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/parquet-scala_2.10-1.5.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/parquet-scrooge_2.10-1.5.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/parquet-test-hadoop2-1.5.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/parquet-thrift-1.5.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/parquet-tools-1.5.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/pentaho-aggdesigner-algorithm-5.1.5-jhyde.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/plexus-utils-1.5.6.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/protobuf-java-2.5.0.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/regexp-1.3.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/scala-library-2.10.4.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/serializer-2.7.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/servlet-api-2.5-20110124.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/servlet-api-2.5.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/slf4j-api-1.7.5.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/slf4j-log4j12-1.7.5.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/snappy-java-1.0.4.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/spark-1.5.0-cdh5.5.2-yarn-shuffle.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/stax-api-1.0-2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/stax-api-1.0.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/stringtemplate-3.2.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/super-csv-2.2.0.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/tempus-fugit-1.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/trevni-avro-1.7.6-cdh5.5.2-hadoop2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/trevni-avro-1.7.6-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/trevni-core-1.7.6-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/twitter4j-core-3.0.3.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/twitter4j-media-support-3.0.3.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/twitter4j-stream-3.0.3.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/unused-1.0.0.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/velocity-1.5.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/velocity-1.7.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/xalan-2.7.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/xercesImpl-2.9.1.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/xml-apis-1.3.04.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/xmlenc-0.52.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/xz-1.0.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/zkclient-0.3.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/jars/zookeeper-3.4.5-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/lib/flume-ng/lib/flume-ng-configuration-1.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/lib/flume-ng/lib/flume-ng-core-1.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/lib/flume-ng/lib/flume-ng-sdk-1.6.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/lib/flume-ng/lib/spark-streaming-flume-sink_2.10-1.5.0-cdh5.5.2.jar:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/lib/hadoop/LICENSE.txt:/hadoop/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p1699.1674/lib/hadoop/NOTICE.txt:/hadoop/cloudera/parcels/GPLEXTRAS-5.5.2-1.cdh5.5.2.p0.4/lib/hadoop/lib/COPYING.hadoop-lzo:/hadoop/cloudera/parcels/GPLEXTRAS-5.5.2-1.cdh5.5.2.p0.4/lib/hadoop/lib/hadoop-lzo-0.4.15-cdh5.5.2.jar:/hadoop/cloudera/parcels/GPLEXTRAS-5.5.2-1.cdh5.5.2.p0.4/lib/spark-netlib/lib/jniloader-1.1.jar:/hadoop/cloudera/parcels/GPLEXTRAS-5.5.2-1.cdh5.5.2.p0.4/lib/spark-netlib/lib/native_ref-java-1.1.jar:/hadoop/cloudera/parcels/GPLEXTRAS-5.5.2-1.cdh5.5.2.p0.4/lib/spark-netlib/lib/native_system-java-1.1.jar:/hadoop/cloudera/parcels/GPLEXTRAS-5.5.2-1.cdh5.5.2.p0.4/lib/spark-netlib/lib/netlib-native_ref-linux-x86_64-1.1-natives.jar:/hadoop/cloudera/parcels/GPLEXTRAS-5.5.2-1.cdh5.5.2.p0.4/lib/spark-netlib/lib/netlib-native_system-linux-x86_64-1.1-natives.jar SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1487862040010_131981 SPARK_YARN_CACHE_FILES_FILE_SIZES -> 103969580,212472201 SPARK_USER -> userName SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE SPARK_YARN_MODE -> true SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1488363029627,1488363040180 SPARK_LOG_URL_STDOUT -> http://hostName:8042/node/containerlogs/container_e76_1487862040010_131981_01_000043/userName/stdout?start=-4096 SPARK_LIBRARY_PATH -> /hadoop/cloudera/parcels/GPLEXTRAS-5.5.2-1.cdh5.5.2.p0.4/lib/hadoop/lib/native SPARK_YARN_CACHE_FILES -> hdfs://Venus/user/userName/.sparkStaging/application_1487862040010_131981/spark-assembly-1.5.0-cdh5.5.2-hadoop2.6.0-cdh5.5.2.jar#__spark__.jar,hdfs://Venus/user/userName/.sparkStaging/application_1487862040010_131981/MYAPP.jar#__app__.jar command: {{JAVA_HOME}}/bin/java -server -XX:OnOutOfMemoryError='kill %p' -Xms15360m -Xmx15360m -Djava.io.tmpdir={{PWD}}/tmp '-Dspark.driver.port=38995' '-Dspark.ui.port=0' -Dspark.yarn.app.container.log.dir= org.apache.spark.executor.CoarseGrainedExecutorBackend --driver-url akka.tcp://sparkDriver@ipaddress:38995/user/CoarseGrainedScheduler --executor-id 40 --hostname hostName --cores 1 --app-id application_1487862040010_131981 --user-class-path file:$PWD/__app__.jar 1> /stdout 2> /stderr =============================================================================== 17/03/01 04:10:51 INFO ContainerManagementProtocolProxy: Opening proxy : hostName:8041 17/03/01 04:10:54 INFO AMRMClientImpl: Received new token for : hostName:8041 17/03/01 04:10:54 INFO AMRMClientImpl: Received new token for : hostName:8041 17/03/01 04:10:54 INFO AMRMClientImpl: Received new token for : hostName:8041 17/03/01 04:10:54 INFO AMRMClientImpl: Received new token for : hostName:8041 17/03/01 04:10:54 INFO AMRMClientImpl: Received new token for : hostName:8041 17/03/01 04:10:54 INFO AMRMClientImpl: Received new token for : hostName:8041 17/03/01 04:10:54 INFO AMRMClientImpl: Received new token for : hostName:8041 17/03/01 04:10:55 INFO YarnAllocator: Received 8 containers from YARN, launching executors on 0 of them. 17/03/01 04:11:00 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:34149 17/03/01 04:11:00 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:51389 17/03/01 04:11:00 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:35694 17/03/01 04:11:00 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:59005 17/03/01 04:11:00 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:54081 17/03/01 04:11:00 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:36713 17/03/01 04:11:00 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:50503 17/03/01 04:11:00 INFO YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hostName:49975/user/Executor#511700448]) with ID 11 17/03/01 04:11:00 INFO YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hostName:51641/user/Executor#-1257108121]) with ID 21 17/03/01 04:11:00 INFO YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hostName:48294/user/Executor#416995961]) with ID 34 17/03/01 04:11:00 INFO YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hostName:48531/user/Executor#1087017712]) with ID 15 17/03/01 04:11:00 INFO YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hostName:39907/user/Executor#-50749525]) with ID 1 17/03/01 04:11:00 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:48806 17/03/01 04:11:00 INFO YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hostName:58154/user/Executor#-875178250]) with ID 6 17/03/01 04:11:00 INFO BlockManagerMasterEndpoint: Registering block manager hostName:60209 with 7.8 GB RAM, BlockManagerId(11, hostName, 60209) 17/03/01 04:11:00 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:35755 17/03/01 04:11:00 INFO BlockManagerMasterEndpoint: Registering block manager hostName:46180 with 7.8 GB RAM, BlockManagerId(21, hostName, 46180) 17/03/01 04:11:00 INFO BlockManagerMasterEndpoint: Registering block manager hostName:57052 with 7.8 GB RAM, BlockManagerId(34, hostName, 57052) 17/03/01 04:11:00 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:57751 17/03/01 04:11:00 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:45212 17/03/01 04:11:00 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:37919 17/03/01 04:11:00 INFO BlockManagerMasterEndpoint: Registering block manager hostName:38204 with 7.8 GB RAM, BlockManagerId(15, hostName, 38204) 17/03/01 04:11:00 INFO BlockManagerMasterEndpoint: Registering block manager hostName:51137 with 7.8 GB RAM, BlockManagerId(1, hostName, 51137) 17/03/01 04:11:00 INFO BlockManagerMasterEndpoint: Registering block manager hostName:45520 with 7.8 GB RAM, BlockManagerId(6, hostName, 45520) 17/03/01 04:11:00 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:34686 17/03/01 04:11:00 INFO YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hostName:52829/user/Executor#-1793848884]) with ID 5 17/03/01 04:11:00 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:59968 17/03/01 04:11:00 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:54034 17/03/01 04:11:00 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:57905 17/03/01 04:11:00 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:33288 17/03/01 04:11:00 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:39368 17/03/01 04:11:00 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:56036 17/03/01 04:11:00 INFO BlockManagerMasterEndpoint: Registering block manager hostName:49289 with 7.8 GB RAM, BlockManagerId(5, hostName, 49289) 17/03/01 04:11:01 INFO YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hostName:59017/user/Executor#1837930112]) with ID 19 17/03/01 04:11:01 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:37524 17/03/01 04:11:01 INFO YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hostName:53843/user/Executor#-519775890]) with ID 16 17/03/01 04:11:01 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:38073 17/03/01 04:11:01 INFO YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hostName:47300/user/Executor#-2031454265]) with ID 39 17/03/01 04:11:01 INFO YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hostName:42437/user/Executor#1694545976]) with ID 13 17/03/01 04:11:01 INFO YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hostName:38383/user/Executor#245135338]) with ID 26 17/03/01 04:11:01 INFO YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hostName:58923/user/Executor#-2129542902]) with ID 20 17/03/01 04:11:01 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:40052 17/03/01 04:11:01 INFO BlockManagerMasterEndpoint: Registering block manager hostName:49788 with 7.8 GB RAM, BlockManagerId(19, hostName, 49788) 17/03/01 04:11:01 INFO BlockManagerMasterEndpoint: Registering block manager hostName:50848 with 7.8 GB RAM, BlockManagerId(16, hostName, 50848) 17/03/01 04:11:01 INFO BlockManagerMasterEndpoint: Registering block manager hostName:50154 with 7.8 GB RAM, BlockManagerId(39, hostName, 50154) 17/03/01 04:11:01 INFO BlockManagerMasterEndpoint: Registering block manager hostName:34517 with 7.8 GB RAM, BlockManagerId(13, hostName, 34517) 17/03/01 04:11:01 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:60582 17/03/01 04:11:01 INFO BlockManagerMasterEndpoint: Registering block manager hostName:46376 with 7.8 GB RAM, BlockManagerId(26, hostName, 46376) 17/03/01 04:11:01 INFO BlockManagerMasterEndpoint: Registering block manager hostName:51382 with 7.8 GB RAM, BlockManagerId(20, hostName, 51382) 17/03/01 04:11:01 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:45764 17/03/01 04:11:01 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:35618 17/03/01 04:11:01 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:32867 17/03/01 04:11:01 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:60563 17/03/01 04:11:01 INFO YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hostName:51249/user/Executor#831132224]) with ID 12 17/03/01 04:11:01 INFO YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hostName:44482/user/Executor#-171675270]) with ID 14 17/03/01 04:11:01 INFO YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hostName:43841/user/Executor#-151406379]) with ID 38 17/03/01 04:11:01 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:45714 17/03/01 04:11:01 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:55909 17/03/01 04:11:01 INFO YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hostName:59799/user/Executor#1714366249]) with ID 31 17/03/01 04:11:01 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:46561 17/03/01 04:11:01 INFO YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hostName:42353/user/Executor#-1935237054]) with ID 28 17/03/01 04:11:01 INFO YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hostName:49066/user/Executor#948860929]) with ID 29 17/03/01 04:11:01 INFO YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hostName:52031/user/Executor#1059410154]) with ID 17 17/03/01 04:11:01 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:39942 17/03/01 04:11:01 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:47341 17/03/01 04:11:01 INFO BlockManagerMasterEndpoint: Registering block manager hostName:46027 with 7.8 GB RAM, BlockManagerId(12, hostName, 46027) 17/03/01 04:11:01 INFO BlockManagerMasterEndpoint: Registering block manager hostName:41952 with 7.8 GB RAM, BlockManagerId(14, hostName, 41952) 17/03/01 04:11:01 INFO YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hostName:40325/user/Executor#-6671927]) with ID 9 17/03/01 04:11:01 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:37612 17/03/01 04:11:01 INFO BlockManagerMasterEndpoint: Registering block manager hostName:43142 with 7.8 GB RAM, BlockManagerId(38, hostName, 43142) 17/03/01 04:11:01 INFO BlockManagerMasterEndpoint: Registering block manager hostName:44583 with 7.8 GB RAM, BlockManagerId(31, hostName, 44583) 17/03/01 04:11:01 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:35284 17/03/01 04:11:01 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:45390 17/03/01 04:11:01 INFO BlockManagerMasterEndpoint: Registering block manager hostName:56727 with 7.8 GB RAM, BlockManagerId(28, hostName, 56727) 17/03/01 04:11:01 INFO YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hostName:39522/user/Executor#1508753770]) with ID 30 17/03/01 04:11:01 INFO BlockManagerMasterEndpoint: Registering block manager hostName:37357 with 7.8 GB RAM, BlockManagerId(29, hostName, 37357) 17/03/01 04:11:01 INFO BlockManagerMasterEndpoint: Registering block manager hostName:35569 with 7.8 GB RAM, BlockManagerId(17, hostName, 35569) 17/03/01 04:11:01 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:34993 17/03/01 04:11:01 INFO BlockManagerMasterEndpoint: Registering block manager hostName:43477 with 7.8 GB RAM, BlockManagerId(9, hostName, 43477) 17/03/01 04:11:01 INFO YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hostName:50529/user/Executor#1662281892]) with ID 32 17/03/01 04:11:01 INFO YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hostName:51613/user/Executor#899078653]) with ID 35 17/03/01 04:11:01 INFO YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hostName:43543/user/Executor#1595640898]) with ID 23 17/03/01 04:11:01 INFO BlockManagerMasterEndpoint: Registering block manager hostName:41443 with 7.8 GB RAM, BlockManagerId(30, hostName, 41443) 17/03/01 04:11:01 INFO YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hostName:51177/user/Executor#-554166296]) with ID 40 17/03/01 04:11:01 INFO YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hostName:46551/user/Executor#-1311876985]) with ID 4 17/03/01 04:11:01 INFO YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hostName:43658/user/Executor#1599083655]) with ID 24 17/03/01 04:11:01 INFO BlockManagerMasterEndpoint: Registering block manager hostName:55987 with 7.8 GB RAM, BlockManagerId(32, hostName, 55987) 17/03/01 04:11:01 INFO YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hostName:38731/user/Executor#882683907]) with ID 2 17/03/01 04:11:01 INFO YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hostName:57567/user/Executor#-1591052224]) with ID 8 17/03/01 04:11:01 INFO BlockManagerMasterEndpoint: Registering block manager hostName:56606 with 7.8 GB RAM, BlockManagerId(35, hostName, 56606) 17/03/01 04:11:01 INFO BlockManagerMasterEndpoint: Registering block manager hostName:44721 with 7.8 GB RAM, BlockManagerId(23, hostName, 44721) 17/03/01 04:11:01 INFO YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hostName:50995/user/Executor#175222654]) with ID 3 17/03/01 04:11:01 INFO BlockManagerMasterEndpoint: Registering block manager hostName:52284 with 7.8 GB RAM, BlockManagerId(40, hostName, 52284) 17/03/01 04:11:01 INFO YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hostName:56752/user/Executor#371224794]) with ID 27 17/03/01 04:11:01 INFO BlockManagerMasterEndpoint: Registering block manager hostName:48862 with 7.8 GB RAM, BlockManagerId(4, hostName, 48862) 17/03/01 04:11:01 INFO BlockManagerMasterEndpoint: Registering block manager hostName:45617 with 7.8 GB RAM, BlockManagerId(24, hostName, 45617) 17/03/01 04:11:01 INFO YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hostName:55967/user/Executor#1541153045]) with ID 18 17/03/01 04:11:01 INFO BlockManagerMasterEndpoint: Registering block manager hostName:36400 with 7.8 GB RAM, BlockManagerId(2, hostName, 36400) 17/03/01 04:11:01 INFO YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hostName:51348/user/Executor#1030780432]) with ID 22 17/03/01 04:11:01 INFO BlockManagerMasterEndpoint: Registering block manager hostName:35888 with 7.8 GB RAM, BlockManagerId(8, hostName, 35888) 17/03/01 04:11:01 INFO YarnClusterSchedulerBackend: SchedulerBackend is ready for scheduling beginning after reached minRegisteredResourcesRatio: 0.8 17/03/01 04:11:01 INFO YarnClusterScheduler: YarnClusterScheduler.postStartHook done 17/03/01 04:11:01 INFO BlockManagerMasterEndpoint: Registering block manager hostName:56293 with 7.8 GB RAM, BlockManagerId(3, hostName, 56293) 17/03/01 04:11:01 INFO BlockManagerMasterEndpoint: Registering block manager hostName:42418 with 7.8 GB RAM, BlockManagerId(27, hostName, 42418) 17/03/01 04:11:01 INFO YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hostName:55692/user/Executor#-483401910]) with ID 25 17/03/01 04:11:01 INFO YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hostName:43109/user/Executor#1203836330]) with ID 7 17/03/01 04:11:01 INFO BlockManagerMasterEndpoint: Registering block manager hostName:32912 with 7.8 GB RAM, BlockManagerId(18, hostName, 32912) 17/03/01 04:11:01 INFO BlockManagerMasterEndpoint: Registering block manager hostName:48144 with 7.8 GB RAM, BlockManagerId(22, hostName, 48144) 17/03/01 04:11:01 INFO BlockManagerMasterEndpoint: Registering block manager hostName:41809 with 7.8 GB RAM, BlockManagerId(25, hostName, 41809) 17/03/01 04:11:01 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:49042 17/03/01 04:11:01 INFO BlockManagerMasterEndpoint: Registering block manager hostName:58857 with 7.8 GB RAM, BlockManagerId(7, hostName, 58857) 17/03/01 04:11:02 INFO SparkContext: Starting job: collect at CompanyResolverSparkTest.scala:92 17/03/01 04:11:02 INFO DAGScheduler: Got job 0 (collect at CompanyResolverSparkTest.scala:92) with 40 output partitions 17/03/01 04:11:02 INFO DAGScheduler: Final stage: ResultStage 0(collect at CompanyResolverSparkTest.scala:92) 17/03/01 04:11:02 INFO DAGScheduler: Parents of final stage: List() 17/03/01 04:11:02 INFO DAGScheduler: Missing parents: List() 17/03/01 04:11:02 INFO DAGScheduler: Submitting ResultStage 0 (MapPartitionsRDD[1] at mapPartitions at CompanyResolverSparkTest.scala:87), which has no missing parents 17/03/01 04:11:02 INFO MemoryStore: ensureFreeSpace(2080) called with curMem=0, maxMem=20615905935 17/03/01 04:11:02 INFO MemoryStore: Block broadcast_0 stored as values in memory (estimated size 2.0 KB, free 19.2 GB) 17/03/01 04:11:02 INFO YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hostName:44729/user/Executor#1299471952]) with ID 33 17/03/01 04:11:02 INFO MemoryStore: ensureFreeSpace(1310) called with curMem=2080, maxMem=20615905935 17/03/01 04:11:02 INFO MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 1310.0 B, free 19.2 GB) 17/03/01 04:11:02 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on ipaddress:43498 (size: 1310.0 B, free: 19.2 GB) 17/03/01 04:11:02 INFO SparkContext: Created broadcast 0 from broadcast at DAGScheduler.scala:861 17/03/01 04:11:02 INFO DAGScheduler: Submitting 40 missing tasks from ResultStage 0 (MapPartitionsRDD[1] at mapPartitions at CompanyResolverSparkTest.scala:87) 17/03/01 04:11:02 INFO YarnClusterScheduler: Adding task set 0.0 with 40 tasks 17/03/01 04:11:02 INFO TaskSetManager: Starting task 0.0 in stage 0.0 (TID 0, hostName, partition 0,PROCESS_LOCAL, 2025 bytes) 17/03/01 04:11:02 INFO TaskSetManager: Starting task 1.0 in stage 0.0 (TID 1, hostName, partition 1,PROCESS_LOCAL, 2025 bytes) 17/03/01 04:11:02 INFO TaskSetManager: Starting task 2.0 in stage 0.0 (TID 2, hostName, partition 2,PROCESS_LOCAL, 2025 bytes) 17/03/01 04:11:02 INFO TaskSetManager: Starting task 3.0 in stage 0.0 (TID 3, hostName, partition 3,PROCESS_LOCAL, 2025 bytes) 17/03/01 04:11:02 INFO TaskSetManager: Starting task 4.0 in stage 0.0 (TID 4, hostName, partition 4,PROCESS_LOCAL, 2025 bytes) 17/03/01 04:11:02 INFO TaskSetManager: Starting task 5.0 in stage 0.0 (TID 5, hostName, partition 5,PROCESS_LOCAL, 2025 bytes) 17/03/01 04:11:02 INFO TaskSetManager: Starting task 6.0 in stage 0.0 (TID 6, hostName, partition 6,PROCESS_LOCAL, 2025 bytes) 17/03/01 04:11:02 INFO TaskSetManager: Starting task 7.0 in stage 0.0 (TID 7, hostName, partition 7,PROCESS_LOCAL, 2025 bytes) 17/03/01 04:11:02 INFO TaskSetManager: Starting task 8.0 in stage 0.0 (TID 8, hostName, partition 8,PROCESS_LOCAL, 2025 bytes) 17/03/01 04:11:02 INFO TaskSetManager: Starting task 9.0 in stage 0.0 (TID 9, hostName, partition 9,PROCESS_LOCAL, 2025 bytes) 17/03/01 04:11:02 INFO TaskSetManager: Starting task 10.0 in stage 0.0 (TID 10, hostName, partition 10,PROCESS_LOCAL, 2025 bytes) 17/03/01 04:11:02 INFO TaskSetManager: Starting task 11.0 in stage 0.0 (TID 11, hostName, partition 11,PROCESS_LOCAL, 2025 bytes) 17/03/01 04:11:02 INFO TaskSetManager: Starting task 12.0 in stage 0.0 (TID 12, hostName, partition 12,PROCESS_LOCAL, 2025 bytes) 17/03/01 04:11:02 INFO TaskSetManager: Starting task 13.0 in stage 0.0 (TID 13, hostName, partition 13,PROCESS_LOCAL, 2025 bytes) 17/03/01 04:11:02 INFO TaskSetManager: Starting task 14.0 in stage 0.0 (TID 14, hostName, partition 14,PROCESS_LOCAL, 2025 bytes) 17/03/01 04:11:02 INFO TaskSetManager: Starting task 15.0 in stage 0.0 (TID 15, hostName, partition 15,PROCESS_LOCAL, 2025 bytes) 17/03/01 04:11:02 INFO TaskSetManager: Starting task 16.0 in stage 0.0 (TID 16, hostName, partition 16,PROCESS_LOCAL, 2025 bytes) 17/03/01 04:11:02 INFO TaskSetManager: Starting task 17.0 in stage 0.0 (TID 17, hostName, partition 17,PROCESS_LOCAL, 2025 bytes) 17/03/01 04:11:02 INFO TaskSetManager: Starting task 18.0 in stage 0.0 (TID 18, hostName, partition 18,PROCESS_LOCAL, 2025 bytes) 17/03/01 04:11:02 INFO TaskSetManager: Starting task 19.0 in stage 0.0 (TID 19, hostName, partition 19,PROCESS_LOCAL, 2025 bytes) 17/03/01 04:11:02 INFO TaskSetManager: Starting task 20.0 in stage 0.0 (TID 20, hostName, partition 20,PROCESS_LOCAL, 2025 bytes) 17/03/01 04:11:02 INFO TaskSetManager: Starting task 21.0 in stage 0.0 (TID 21, hostName, partition 21,PROCESS_LOCAL, 2025 bytes) 17/03/01 04:11:02 INFO TaskSetManager: Starting task 22.0 in stage 0.0 (TID 22, hostName, partition 22,PROCESS_LOCAL, 2025 bytes) 17/03/01 04:11:02 INFO TaskSetManager: Starting task 23.0 in stage 0.0 (TID 23, hostName, partition 23,PROCESS_LOCAL, 2025 bytes) 17/03/01 04:11:02 INFO TaskSetManager: Starting task 24.0 in stage 0.0 (TID 24, hostName, partition 24,PROCESS_LOCAL, 2025 bytes) 17/03/01 04:11:02 INFO TaskSetManager: Starting task 25.0 in stage 0.0 (TID 25, hostName, partition 25,PROCESS_LOCAL, 2025 bytes) 17/03/01 04:11:02 INFO TaskSetManager: Starting task 26.0 in stage 0.0 (TID 26, hostName, partition 26,PROCESS_LOCAL, 2025 bytes) 17/03/01 04:11:02 INFO TaskSetManager: Starting task 27.0 in stage 0.0 (TID 27, hostName, partition 27,PROCESS_LOCAL, 2025 bytes) 17/03/01 04:11:02 INFO TaskSetManager: Starting task 28.0 in stage 0.0 (TID 28, hostName, partition 28,PROCESS_LOCAL, 2025 bytes) 17/03/01 04:11:02 INFO TaskSetManager: Starting task 29.0 in stage 0.0 (TID 29, hostName, partition 29,PROCESS_LOCAL, 2025 bytes) 17/03/01 04:11:02 INFO TaskSetManager: Starting task 30.0 in stage 0.0 (TID 30, hostName, partition 30,PROCESS_LOCAL, 2025 bytes) 17/03/01 04:11:02 INFO TaskSetManager: Starting task 31.0 in stage 0.0 (TID 31, hostName, partition 31,PROCESS_LOCAL, 2025 bytes) 17/03/01 04:11:02 INFO TaskSetManager: Starting task 32.0 in stage 0.0 (TID 32, hostName, partition 32,PROCESS_LOCAL, 2025 bytes) 17/03/01 04:11:02 INFO TaskSetManager: Starting task 33.0 in stage 0.0 (TID 33, hostName, partition 33,PROCESS_LOCAL, 2025 bytes) 17/03/01 04:11:02 INFO TaskSetManager: Starting task 34.0 in stage 0.0 (TID 34, hostName, partition 34,PROCESS_LOCAL, 2025 bytes) 17/03/01 04:11:02 INFO TaskSetManager: Starting task 35.0 in stage 0.0 (TID 35, hostName, partition 35,PROCESS_LOCAL, 2025 bytes) 17/03/01 04:11:02 INFO TaskSetManager: Starting task 36.0 in stage 0.0 (TID 36, hostName, partition 36,PROCESS_LOCAL, 2025 bytes) 17/03/01 04:11:02 INFO BlockManagerMasterEndpoint: Registering block manager hostName:33016 with 7.8 GB RAM, BlockManagerId(33, hostName, 33016) 17/03/01 04:11:02 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on hostName:41443 (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:11:02 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on hostName:51382 (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:11:02 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on hostName:41952 (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:11:02 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on hostName:49788 (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:11:02 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on hostName:50848 (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:11:02 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on hostName:56727 (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:11:02 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on hostName:45520 (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:11:02 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on hostName:60209 (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:11:02 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on hostName:50154 (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:11:02 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on hostName:44583 (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:11:02 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on hostName:51137 (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:11:02 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on hostName:38204 (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:11:02 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on hostName:57052 (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:11:02 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on hostName:44721 (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:11:02 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on hostName:34517 (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:11:02 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on hostName:49289 (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:11:02 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on hostName:48144 (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:11:02 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on hostName:52284 (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:11:02 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on hostName:48862 (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:11:02 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on hostName:37357 (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:11:02 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on hostName:46180 (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:11:02 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on hostName:56606 (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:11:02 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on hostName:35888 (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:11:02 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on hostName:46027 (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:11:02 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on hostName:56293 (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:11:02 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on hostName:43477 (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:11:02 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on hostName:42418 (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:11:02 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on hostName:41809 (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:11:02 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on hostName:32912 (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:11:02 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on hostName:58857 (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:11:02 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on hostName:43142 (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:11:02 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on hostName:36400 (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:11:02 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on hostName:35569 (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:11:02 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on hostName:55987 (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:11:02 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on hostName:46376 (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:11:02 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on hostName:45617 (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:11:02 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on hostName:33016 (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:11:02 INFO TaskSetManager: Starting task 37.0 in stage 0.0 (TID 37, hostName, partition 37,PROCESS_LOCAL, 2025 bytes) 17/03/01 04:11:02 INFO TaskSetManager: Starting task 38.0 in stage 0.0 (TID 38, hostName, partition 38,PROCESS_LOCAL, 2025 bytes) 17/03/01 04:11:02 INFO TaskSetManager: Starting task 39.0 in stage 0.0 (TID 39, hostName, partition 39,PROCESS_LOCAL, 2025 bytes) 17/03/01 04:11:02 INFO TaskSetManager: Finished task 25.0 in stage 0.0 (TID 25) in 488 ms on hostName (1/40) 17/03/01 04:11:02 INFO TaskSetManager: Finished task 28.0 in stage 0.0 (TID 28) in 488 ms on hostName (2/40) 17/03/01 04:11:02 INFO TaskSetManager: Finished task 21.0 in stage 0.0 (TID 21) in 490 ms on hostName (3/40) 17/03/01 04:11:02 INFO TaskSetManager: Finished task 26.0 in stage 0.0 (TID 26) in 489 ms on hostName (4/40) 17/03/01 04:11:02 INFO TaskSetManager: Finished task 31.0 in stage 0.0 (TID 31) in 489 ms on hostName (5/40) 17/03/01 04:11:02 INFO TaskSetManager: Finished task 13.0 in stage 0.0 (TID 13) in 493 ms on hostName (6/40) 17/03/01 04:11:02 INFO TaskSetManager: Finished task 18.0 in stage 0.0 (TID 18) in 491 ms on hostName (7/40) 17/03/01 04:11:02 INFO TaskSetManager: Finished task 16.0 in stage 0.0 (TID 16) in 492 ms on hostName (8/40) 17/03/01 04:11:02 INFO TaskSetManager: Finished task 36.0 in stage 0.0 (TID 36) in 489 ms on hostName (9/40) 17/03/01 04:11:02 INFO TaskSetManager: Finished task 35.0 in stage 0.0 (TID 35) in 489 ms on hostName (10/40) 17/03/01 04:11:02 INFO TaskSetManager: Finished task 37.0 in stage 0.0 (TID 37) in 12 ms on hostName (11/40) 17/03/01 04:11:02 INFO TaskSetManager: Finished task 6.0 in stage 0.0 (TID 6) in 497 ms on hostName (12/40) 17/03/01 04:11:02 INFO TaskSetManager: Finished task 38.0 in stage 0.0 (TID 38) in 11 ms on hostName (13/40) 17/03/01 04:11:02 INFO TaskSetManager: Finished task 8.0 in stage 0.0 (TID 8) in 498 ms on hostName (14/40) 17/03/01 04:11:02 INFO TaskSetManager: Finished task 4.0 in stage 0.0 (TID 4) in 498 ms on hostName (15/40) 17/03/01 04:11:02 INFO TaskSetManager: Finished task 2.0 in stage 0.0 (TID 2) in 500 ms on hostName (16/40) 17/03/01 04:11:02 INFO TaskSetManager: Finished task 39.0 in stage 0.0 (TID 39) in 11 ms on hostName (17/40) 17/03/01 04:11:02 INFO TaskSetManager: Finished task 7.0 in stage 0.0 (TID 7) in 499 ms on hostName (18/40) 17/03/01 04:11:02 INFO TaskSetManager: Finished task 32.0 in stage 0.0 (TID 32) in 494 ms on hostName (19/40) 17/03/01 04:11:02 INFO TaskSetManager: Finished task 23.0 in stage 0.0 (TID 23) in 496 ms on hostName (20/40) 17/03/01 04:11:02 INFO TaskSetManager: Finished task 0.0 in stage 0.0 (TID 0) in 515 ms on hostName (21/40) 17/03/01 04:11:02 INFO TaskSetManager: Finished task 11.0 in stage 0.0 (TID 11) in 501 ms on hostName (22/40) 17/03/01 04:11:02 INFO TaskSetManager: Finished task 30.0 in stage 0.0 (TID 30) in 498 ms on hostName (23/40) 17/03/01 04:11:02 INFO TaskSetManager: Finished task 14.0 in stage 0.0 (TID 14) in 502 ms on hostName (24/40) 17/03/01 04:11:02 INFO TaskSetManager: Finished task 17.0 in stage 0.0 (TID 17) in 501 ms on hostName (25/40) 17/03/01 04:11:02 INFO TaskSetManager: Finished task 24.0 in stage 0.0 (TID 24) in 500 ms on hostName (26/40) 17/03/01 04:11:02 INFO TaskSetManager: Finished task 29.0 in stage 0.0 (TID 29) in 499 ms on hostName (27/40) 17/03/01 04:11:02 INFO TaskSetManager: Finished task 5.0 in stage 0.0 (TID 5) in 506 ms on hostName (28/40) 17/03/01 04:11:02 INFO TaskSetManager: Finished task 34.0 in stage 0.0 (TID 34) in 499 ms on hostName (29/40) 17/03/01 04:11:02 INFO TaskSetManager: Finished task 19.0 in stage 0.0 (TID 19) in 503 ms on hostName (30/40) 17/03/01 04:11:02 INFO TaskSetManager: Finished task 22.0 in stage 0.0 (TID 22) in 505 ms on hostName (31/40) 17/03/01 04:11:02 INFO TaskSetManager: Finished task 3.0 in stage 0.0 (TID 3) in 513 ms on hostName (32/40) 17/03/01 04:11:02 INFO TaskSetManager: Finished task 33.0 in stage 0.0 (TID 33) in 511 ms on hostName (33/40) 17/03/01 04:11:02 INFO TaskSetManager: Finished task 12.0 in stage 0.0 (TID 12) in 517 ms on hostName (34/40) 17/03/01 04:11:02 INFO TaskSetManager: Finished task 20.0 in stage 0.0 (TID 20) in 514 ms on hostName (35/40) 17/03/01 04:11:02 INFO TaskSetManager: Finished task 9.0 in stage 0.0 (TID 9) in 518 ms on hostName (36/40) 17/03/01 04:11:02 INFO TaskSetManager: Finished task 1.0 in stage 0.0 (TID 1) in 526 ms on hostName (37/40) 17/03/01 04:11:02 INFO TaskSetManager: Finished task 27.0 in stage 0.0 (TID 27) in 520 ms on hostName (38/40) 17/03/01 04:11:02 INFO TaskSetManager: Finished task 15.0 in stage 0.0 (TID 15) in 527 ms on hostName (39/40) 17/03/01 04:11:02 INFO TaskSetManager: Finished task 10.0 in stage 0.0 (TID 10) in 547 ms on hostName (40/40) 17/03/01 04:11:02 INFO DAGScheduler: ResultStage 0 (collect at CompanyResolverSparkTest.scala:92) finished in 0.564 s 17/03/01 04:11:02 INFO YarnClusterScheduler: Removed TaskSet 0.0, whose tasks have all completed, from pool 17/03/01 04:11:02 INFO DAGScheduler: Job 0 finished: collect at CompanyResolverSparkTest.scala:92, took 0.715627 s 17/03/01 04:11:02 INFO CompanyResolverSparkTest: Will start Ignite nodes on driver ipaddress:47500..47509 17/03/01 04:11:02 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:53461 17/03/01 04:11:02 INFO CompanyResolverSparkTest: testing[ipaddress:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509] 17/03/01 04:11:02 ERROR : Failed to resolve default logging config file: config/java.util.logging.properties Console logging handler is not configured. 17/03/01 04:11:03 INFO IgniteKernal%WCA: >>> __________ ________________ >>> / _/ ___/ |/ / _/_ __/ __/ >>> _/ // (7 7 // / / / / _/ >>> /___/\___/_/|_/___/ /_/ /___/ >>> >>> ver. 1.8.0#20161205-sha1:9ca40dbe >>> 2016 Copyright(C) Apache Software Foundation >>> >>> Ignite documentation: http://ignite.apache.org 17/03/01 04:11:03 INFO IgniteKernal%WCA: Config URL: n/a 17/03/01 04:11:03 INFO IgniteKernal%WCA: Daemon mode: off 17/03/01 04:11:03 INFO IgniteKernal%WCA: OS: Linux 2.6.32-431.5.1.el6.x86_64 amd64 17/03/01 04:11:03 INFO IgniteKernal%WCA: OS user: userName 17/03/01 04:11:03 INFO IgniteKernal%WCA: PID: 838 17/03/01 04:11:03 INFO IgniteKernal%WCA: Language runtime: Java Platform API Specification ver. 1.8 17/03/01 04:11:03 INFO IgniteKernal%WCA: VM information: Java(TM) SE Runtime Environment 1.8.0_60-b27 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.60-b23 17/03/01 04:11:03 INFO IgniteKernal%WCA: VM total memory: 36.0GB 17/03/01 04:11:03 INFO IgniteKernal%WCA: Remote Management [restart: off, REST: on, JMX (remote: off)] 17/03/01 04:11:03 INFO IgniteKernal%WCA: IGNITE_HOME=null 17/03/01 04:11:03 INFO IgniteKernal%WCA: VM arguments: [-Xmx40960m, -Djava.io.tmpdir=/data/6/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/container_e76_1487862040010_131981_01_000002/tmp, -Dspark.yarn.app.container.log.dir=/data/4/yarn/log/container/application_1487862040010_131981/container_e76_1487862040010_131981_01_000002] 17/03/01 04:11:03 INFO IgniteKernal%WCA: Configured caches ['ignite-marshaller-sys-cache', 'ignite-sys-cache', 'ignite-atomics-sys-cache'] 17/03/01 04:11:03 INFO IgnitePluginProcessor: Configured plugins: 17/03/01 04:11:03 INFO IgnitePluginProcessor: ^-- None 17/03/01 04:11:03 INFO IgnitePluginProcessor: 17/03/01 04:11:03 INFO TcpCommunicationSpi: IPC shared memory server endpoint started [port=48100, tokDir=/data/6/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/container_e76_1487862040010_131981_01_000002/tmp/ignite/work/ipc/shmem/6172ee3a-eb33-4bf5-9080-c255f52caed8-838] 17/03/01 04:11:03 INFO TcpCommunicationSpi: Successfully bound shared memory communication to TCP port [port=48100, locHost=0.0.0.0/0.0.0.0] 17/03/01 04:11:03 INFO TcpCommunicationSpi: Successfully bound to TCP port [port=47100, locHost=0.0.0.0/0.0.0.0] 17/03/01 04:11:03 INFO YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hostName:42726/user/Executor#-2077982225]) with ID 36 17/03/01 04:11:03 WARN NoopCheckpointSpi: Checkpoints are disabled (to enable configure any GridCheckpointSpi implementation) 17/03/01 04:11:03 WARN GridCollisionManager: Collision resolution is disabled (all jobs will be activated upon arrival). 17/03/01 04:11:03 WARN NoopSwapSpaceSpi: Swap space is disabled. To enable use FileSwapSpaceSpi. 17/03/01 04:11:03 INFO IgniteKernal%WCA: Security status [authentication=off, tls/ssl=off] 17/03/01 04:11:03 INFO BlockManagerMasterEndpoint: Registering block manager hostName:51773 with 7.8 GB RAM, BlockManagerId(36, hostName, 51773) 17/03/01 04:11:03 INFO GridTcpRestProtocol: Command protocol successfully started [name=TCP binary, host=0.0.0.0/0.0.0.0, port=11211] 17/03/01 04:11:03 INFO IgniteKernal%WCA: Non-loopback local IPs: ipaddress 17/03/01 04:11:03 INFO IgniteKernal%WCA: Enabled local MACs: 246E96024ED0 17/03/01 04:11:03 INFO TcpDiscoverySpi: Successfully bound to TCP port [port=47500, localHost=0.0.0.0/0.0.0.0, locNodeId=6172ee3a-eb33-4bf5-9080-c255f52caed8] 17/03/01 04:11:04 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:50265 17/03/01 04:11:04 INFO YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hostName:36607/user/Executor#-721041719]) with ID 37 17/03/01 04:11:04 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:39105 17/03/01 04:11:04 INFO BlockManagerMasterEndpoint: Registering block manager hostName:56472 with 7.8 GB RAM, BlockManagerId(37, hostName, 56472) 17/03/01 04:11:04 INFO GridCacheProcessor: Started cache [name=ignite-sys-cache, mode=REPLICATED] 17/03/01 04:11:04 INFO GridCacheProcessor: Started cache [name=ignite-atomics-sys-cache, mode=PARTITIONED] 17/03/01 04:11:04 INFO GridCacheProcessor: Started cache [name=ignite-marshaller-sys-cache, mode=REPLICATED] 17/03/01 04:11:04 INFO GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=1, minorTopVer=0], evt=NODE_JOINED, node=6172ee3a-eb33-4bf5-9080-c255f52caed8] 17/03/01 04:11:04 INFO IgniteKernal%WCA: To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} 17/03/01 04:11:04 INFO IgniteKernal%WCA: 17/03/01 04:11:04 INFO IgniteKernal%WCA: >>> +----------------------------------------------------------------------+ >>> Ignite ver. 1.8.0#20161205-sha1:9ca40dbeb7d559fcb299bdb6f5c90cdf8ce7e533 >>> +----------------------------------------------------------------------+ >>> OS name: Linux 2.6.32-431.5.1.el6.x86_64 amd64 >>> CPU(s): 48 >>> Heap: 36.0GB >>> VM name: 838@hostName >>> Grid name: WCA >>> Local node [ID=6172EE3A-EB33-4BF5-9080-C255F52CAED8, order=1, clientMode=false] >>> Local node addresses: [hostName/ipaddress, /127.0.0.1] >>> Local ports: TCP:11211 TCP:47100 TCP:47500 TCP:48100 17/03/01 04:11:04 INFO GridDiscoveryManager: Topology snapshot [ver=1, servers=1, clients=0, CPUs=48, heap=36.0GB] 17/03/01 04:11:04 INFO GridCacheProcessor: Started cache [name=WCAIgniteCache, mode=PARTITIONED] 17/03/01 04:11:04 INFO CompanyResolverSparkTest: Started ignite node on driver 17/03/01 04:11:04 INFO GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=1, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, node=6172ee3a-eb33-4bf5-9080-c255f52caed8] 17/03/01 04:11:04 INFO YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hostName:34871/user/Executor#1981969905]) with ID 10 17/03/01 04:11:04 INFO BlockManagerMasterEndpoint: Registering block manager hostName:40903 with 7.8 GB RAM, BlockManagerId(10, hostName, 40903) 17/03/01 04:11:54 WARN UserGroupInformation: PriviledgedActionException as:userName (auth:SIMPLE) cause:org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:11:54 WARN Client: Exception encountered while connecting to the server : org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:11:54 WARN UserGroupInformation: PriviledgedActionException as:userName (auth:SIMPLE) cause:org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:11:55 INFO AvroRelation: Listing avro path on driver 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(146152) called with curMem=3390, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_1 stored as values in memory (estimated size 142.7 KB, free 19.2 GB) 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=149542, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_1_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:56 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:56 INFO SparkContext: Created broadcast 1 from show at CompanyResolverSparkTest.scala:142 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(354800) called with curMem=174185, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_2 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=528985, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_2_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:56 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:56 INFO SparkContext: Created broadcast 2 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=553628, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_3 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=908484, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_3_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:56 INFO BlockManagerInfo: Added broadcast_3_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:56 INFO SparkContext: Created broadcast 3 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=933127, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_4 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=1287983, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_4_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:56 INFO BlockManagerInfo: Added broadcast_4_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:56 INFO SparkContext: Created broadcast 4 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=1312626, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_5 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=1667482, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_5_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:56 INFO BlockManagerInfo: Added broadcast_5_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:56 INFO SparkContext: Created broadcast 5 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=1692125, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_6 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=2046981, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_6_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:56 INFO BlockManagerInfo: Added broadcast_6_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:56 INFO SparkContext: Created broadcast 6 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=2071624, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_7 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=2426480, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_7_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:56 INFO BlockManagerInfo: Added broadcast_7_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:56 INFO SparkContext: Created broadcast 7 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=2451123, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_8 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=2805979, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_8_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:56 INFO BlockManagerInfo: Added broadcast_8_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:56 INFO SparkContext: Created broadcast 8 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=2830622, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_9 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=3185478, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_9_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:56 INFO BlockManagerInfo: Added broadcast_9_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:56 INFO SparkContext: Created broadcast 9 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=3210121, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_10 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=3564977, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_10_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:56 INFO BlockManagerInfo: Added broadcast_10_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:56 INFO SparkContext: Created broadcast 10 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=3589620, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_11 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=3944476, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_11_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:56 INFO BlockManagerInfo: Added broadcast_11_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:56 INFO SparkContext: Created broadcast 11 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=3969119, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_12 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=4323975, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_12_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:56 INFO BlockManagerInfo: Added broadcast_12_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:56 INFO SparkContext: Created broadcast 12 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=4348618, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_13 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=4703474, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_13_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:56 INFO BlockManagerInfo: Added broadcast_13_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:56 INFO SparkContext: Created broadcast 13 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=4728117, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_14 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=5082973, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_14_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:56 INFO BlockManagerInfo: Added broadcast_14_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:56 INFO SparkContext: Created broadcast 14 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=5107616, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_15 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=5462472, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_15_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:56 INFO BlockManagerInfo: Added broadcast_15_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:56 INFO SparkContext: Created broadcast 15 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=5487115, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_16 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=5841971, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_16_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:56 INFO BlockManagerInfo: Added broadcast_16_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:56 INFO SparkContext: Created broadcast 16 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=5866614, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_17 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=6221470, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_17_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:56 INFO BlockManagerInfo: Added broadcast_17_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:56 INFO SparkContext: Created broadcast 17 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=6246113, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_18 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=6600969, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_18_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:56 INFO BlockManagerInfo: Added broadcast_18_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:56 INFO SparkContext: Created broadcast 18 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=6625612, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_19 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=6980468, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_19_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:56 INFO BlockManagerInfo: Added broadcast_19_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:56 INFO SparkContext: Created broadcast 19 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=7005111, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_20 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=7359967, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_20_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:56 INFO BlockManagerInfo: Added broadcast_20_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:56 INFO SparkContext: Created broadcast 20 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=7384610, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_21 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=7739466, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_21_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:56 INFO BlockManagerInfo: Added broadcast_21_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:56 INFO SparkContext: Created broadcast 21 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=7764109, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_22 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=8118965, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_22_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:56 INFO BlockManagerInfo: Added broadcast_22_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:56 INFO SparkContext: Created broadcast 22 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=8143608, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_23 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=8498464, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_23_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:56 INFO BlockManagerInfo: Added broadcast_23_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:56 INFO SparkContext: Created broadcast 23 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=8523107, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_24 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=8877963, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_24_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:56 INFO BlockManagerInfo: Added broadcast_24_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:56 INFO SparkContext: Created broadcast 24 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=8902606, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_25 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=9257462, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_25_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:56 INFO BlockManagerInfo: Added broadcast_25_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:56 INFO SparkContext: Created broadcast 25 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=9282105, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_26 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=9636961, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_26_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:56 INFO BlockManagerInfo: Added broadcast_26_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:56 INFO SparkContext: Created broadcast 26 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=9661604, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_27 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=10016460, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_27_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:56 INFO BlockManagerInfo: Added broadcast_27_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:56 INFO SparkContext: Created broadcast 27 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=10041103, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_28 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=10395959, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_28_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:56 INFO BlockManagerInfo: Added broadcast_28_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:56 INFO SparkContext: Created broadcast 28 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=10420602, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_29 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=10775458, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_29_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:56 INFO BlockManagerInfo: Added broadcast_29_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:56 INFO SparkContext: Created broadcast 29 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=10800101, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_30 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=11154957, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_30_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:56 INFO BlockManagerInfo: Added broadcast_30_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:56 INFO SparkContext: Created broadcast 30 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=11179600, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_31 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=11534456, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_31_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:56 INFO BlockManagerInfo: Added broadcast_31_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:56 INFO SparkContext: Created broadcast 31 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=11559099, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_32 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=11913955, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_32_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:56 INFO BlockManagerInfo: Added broadcast_32_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:56 INFO SparkContext: Created broadcast 32 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=11938598, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_33 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=12293454, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_33_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:56 INFO BlockManagerInfo: Added broadcast_33_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:56 INFO SparkContext: Created broadcast 33 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=12318097, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_34 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=12672953, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_34_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:56 INFO BlockManagerInfo: Added broadcast_34_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:56 INFO SparkContext: Created broadcast 34 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=12697596, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_35 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=13052452, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_35_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:56 INFO BlockManagerInfo: Added broadcast_35_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:56 INFO SparkContext: Created broadcast 35 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=13077095, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_36 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=13431951, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_36_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:56 INFO BlockManagerInfo: Added broadcast_36_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:56 INFO SparkContext: Created broadcast 36 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=13456594, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_37 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=13811450, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_37_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:56 INFO BlockManagerInfo: Added broadcast_37_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:56 INFO SparkContext: Created broadcast 37 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=13836093, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_38 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=14190949, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_38_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:56 INFO BlockManagerInfo: Added broadcast_38_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:56 INFO SparkContext: Created broadcast 38 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=14215592, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_39 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=14570448, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_39_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:56 INFO BlockManagerInfo: Added broadcast_39_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:56 INFO SparkContext: Created broadcast 39 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=14595091, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_40 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=14949947, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_40_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:56 INFO BlockManagerInfo: Added broadcast_40_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:56 INFO SparkContext: Created broadcast 40 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=14974590, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_41 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:56 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=15329446, maxMem=20615905935 17/03/01 04:11:56 INFO MemoryStore: Block broadcast_41_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:56 INFO BlockManagerInfo: Added broadcast_41_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:56 INFO SparkContext: Created broadcast 41 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:57 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /E01_S012_AJ018/01:1004 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AK067/5:1004 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AK067/3:1004 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /ELL_MFRM_U_034/77:1004 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AH079/2:1004 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AH079/5:1004 17/03/01 04:11:57 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:11:57 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:11:57 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /ELL_MFRM_T_021/06:1004 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AI067/81:1004 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /ELL_MFRM_S_021/95:1004 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AI067/77:1004 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /E01_S012_AO016/5:1004 17/03/01 04:11:57 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:11:57 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:11:57 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:11:57 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:11:57 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AA029/:1004 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /ELL_MFRM_Z_029/5:1004 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AA029/2:1004 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /ELL_MFRM_P_046/37:1004 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /ELL_MFRM_P_046/39:1004 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /E01_S012_AO021/4:1004 17/03/01 04:11:57 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:11:57 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:11:57 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:11:57 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AI067/08:1004 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /ELL_MFRM_Z_029/5:1004 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /ELL_MFRM_Z_029/5:1004 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /E01_S012_AO020/7:1004 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /E01_S012_AO020/5:1004 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AK067/5:1004 17/03/01 04:11:57 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:11:57 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AA029/8:1004 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AA029/9:1004 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /ELL_MFRM_Y_029/9:1004 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /E01_S012_AO021/:1004 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /E01_S012_AO019/8:1004 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /E01_S012_AO019/:1004 17/03/01 04:11:57 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:11:57 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:11:57 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:11:57 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:11:57 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:11:57 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:11:57 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:11:57 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:11:57 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AA029/9:1004 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AA029/8:1004 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /E01_S012_AO017/7:1004 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AK076/58:1004 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AK076/62:1004 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /ELL_ALCOVE_CL093/7:1004 17/03/01 04:11:57 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AK076/62:1004 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AE026/71:1004 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AK076/69:1004 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /E01_S012_AO020/:1004 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AI067/06:1004 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AI067/79:1004 17/03/01 04:11:57 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:11:57 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:11:57 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:11:57 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:11:57 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:11:57 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:11:57 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /ELL_MFRM_Y_029/:1004 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AJ067/8:1004 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /ELL_MFRM_Y_029/:1004 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /E01_S012_AO019/2:1004 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /ELL_MFRM_Y_029/4:1004 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /E01_S012_AO019/6:1004 17/03/01 04:11:57 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AF079/0:1004 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AJ067/2:1004 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AJ067/4:1004 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /ELL_MFRM_S_021/07:1004 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AA029/8:1004 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AA029/3:1004 17/03/01 04:11:57 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AF079/3:1004 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AF079/0:1004 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AK076/62:1004 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /ELL_MFRM_T_021/98:1004 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AK067/:1004 17/03/01 04:11:57 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AK067/5:1004 17/03/01 04:11:57 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:11:57 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:11:57 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:11:57 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:11:57 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:11:57 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:11:57 INFO SparkContext: Starting job: show at CompanyResolverSparkTest.scala:142 17/03/01 04:11:57 INFO DAGScheduler: Got job 1 (show at CompanyResolverSparkTest.scala:142) with 1 output partitions 17/03/01 04:11:57 INFO DAGScheduler: Final stage: ResultStage 1(show at CompanyResolverSparkTest.scala:142) 17/03/01 04:11:57 INFO DAGScheduler: Parents of final stage: List() 17/03/01 04:11:57 INFO DAGScheduler: Missing parents: List() 17/03/01 04:11:57 INFO DAGScheduler: Submitting ResultStage 1 (MapPartitionsRDD[164] at show at CompanyResolverSparkTest.scala:142), which has no missing parents 17/03/01 04:11:57 INFO MemoryStore: ensureFreeSpace(27216) called with curMem=15354089, maxMem=20615905935 17/03/01 04:11:57 INFO MemoryStore: Block broadcast_42 stored as values in memory (estimated size 26.6 KB, free 19.2 GB) 17/03/01 04:11:57 INFO MemoryStore: ensureFreeSpace(6993) called with curMem=15381305, maxMem=20615905935 17/03/01 04:11:57 INFO MemoryStore: Block broadcast_42_piece0 stored as bytes in memory (estimated size 6.8 KB, free 19.2 GB) 17/03/01 04:11:57 INFO BlockManagerInfo: Added broadcast_42_piece0 in memory on ipaddress:43498 (size: 6.8 KB, free: 19.2 GB) 17/03/01 04:11:57 INFO SparkContext: Created broadcast 42 from broadcast at DAGScheduler.scala:861 17/03/01 04:11:57 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 1 (MapPartitionsRDD[164] at show at CompanyResolverSparkTest.scala:142) 17/03/01 04:11:57 INFO YarnClusterScheduler: Adding task set 1.0 with 1 tasks 17/03/01 04:11:57 INFO TaskSetManager: Starting task 0.0 in stage 1.0 (TID 40, hostName, partition 0,NODE_LOCAL, 2329 bytes) 17/03/01 04:11:57 INFO BlockManagerInfo: Added broadcast_42_piece0 in memory on hostName:46376 (size: 6.8 KB, free: 7.8 GB) 17/03/01 04:11:58 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on hostName:46376 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:11:59 INFO TaskSetManager: Finished task 0.0 in stage 1.0 (TID 40) in 1614 ms on hostName (1/1) 17/03/01 04:11:59 INFO DAGScheduler: ResultStage 1 (show at CompanyResolverSparkTest.scala:142) finished in 1.616 s 17/03/01 04:11:59 INFO YarnClusterScheduler: Removed TaskSet 1.0, whose tasks have all completed, from pool 17/03/01 04:11:59 INFO DAGScheduler: Job 1 finished: show at CompanyResolverSparkTest.scala:142, took 1.712104 s 17/03/01 04:11:59 INFO MemoryStore: ensureFreeSpace(382192) called with curMem=15388298, maxMem=20615905935 17/03/01 04:11:59 INFO MemoryStore: Block broadcast_43 stored as values in memory (estimated size 373.2 KB, free 19.2 GB) 17/03/01 04:11:59 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=15770490, maxMem=20615905935 17/03/01 04:11:59 INFO MemoryStore: Block broadcast_43_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:59 INFO BlockManagerInfo: Added broadcast_43_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:59 INFO SparkContext: Created broadcast 43 from count at CompanyResolverSparkTest.scala:143 17/03/01 04:11:59 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=15795133, maxMem=20615905935 17/03/01 04:11:59 INFO MemoryStore: Block broadcast_44 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:59 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=16149989, maxMem=20615905935 17/03/01 04:11:59 INFO MemoryStore: Block broadcast_44_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:59 INFO BlockManagerInfo: Added broadcast_44_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:59 INFO SparkContext: Created broadcast 44 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:59 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=16174632, maxMem=20615905935 17/03/01 04:11:59 INFO MemoryStore: Block broadcast_45 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:59 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=16529488, maxMem=20615905935 17/03/01 04:11:59 INFO MemoryStore: Block broadcast_45_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:59 INFO BlockManagerInfo: Added broadcast_45_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:59 INFO SparkContext: Created broadcast 45 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:59 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=16554131, maxMem=20615905935 17/03/01 04:11:59 INFO MemoryStore: Block broadcast_46 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:59 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=16908987, maxMem=20615905935 17/03/01 04:11:59 INFO MemoryStore: Block broadcast_46_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:59 INFO BlockManagerInfo: Added broadcast_46_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:59 INFO SparkContext: Created broadcast 46 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:59 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=16933630, maxMem=20615905935 17/03/01 04:11:59 INFO MemoryStore: Block broadcast_47 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:59 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=17288486, maxMem=20615905935 17/03/01 04:11:59 INFO MemoryStore: Block broadcast_47_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:59 INFO BlockManagerInfo: Added broadcast_47_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:59 INFO SparkContext: Created broadcast 47 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:59 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=17313129, maxMem=20615905935 17/03/01 04:11:59 INFO MemoryStore: Block broadcast_48 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:59 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=17667985, maxMem=20615905935 17/03/01 04:11:59 INFO MemoryStore: Block broadcast_48_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:59 INFO BlockManagerInfo: Added broadcast_48_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:59 INFO SparkContext: Created broadcast 48 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:59 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=17692628, maxMem=20615905935 17/03/01 04:11:59 INFO MemoryStore: Block broadcast_49 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:59 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=18047484, maxMem=20615905935 17/03/01 04:11:59 INFO MemoryStore: Block broadcast_49_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:59 INFO BlockManagerInfo: Added broadcast_49_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:59 INFO SparkContext: Created broadcast 49 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:59 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=18072127, maxMem=20615905935 17/03/01 04:11:59 INFO MemoryStore: Block broadcast_50 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:59 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=18426983, maxMem=20615905935 17/03/01 04:11:59 INFO MemoryStore: Block broadcast_50_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:59 INFO BlockManagerInfo: Added broadcast_50_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:59 INFO SparkContext: Created broadcast 50 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:59 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=18451626, maxMem=20615905935 17/03/01 04:11:59 INFO MemoryStore: Block broadcast_51 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:59 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=18806482, maxMem=20615905935 17/03/01 04:11:59 INFO MemoryStore: Block broadcast_51_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:59 INFO BlockManagerInfo: Added broadcast_51_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:59 INFO SparkContext: Created broadcast 51 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:59 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=18831125, maxMem=20615905935 17/03/01 04:11:59 INFO MemoryStore: Block broadcast_52 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:59 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=19185981, maxMem=20615905935 17/03/01 04:11:59 INFO MemoryStore: Block broadcast_52_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:59 INFO BlockManagerInfo: Added broadcast_52_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:59 INFO SparkContext: Created broadcast 52 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:59 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=19210624, maxMem=20615905935 17/03/01 04:11:59 INFO MemoryStore: Block broadcast_53 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:59 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=19565480, maxMem=20615905935 17/03/01 04:11:59 INFO MemoryStore: Block broadcast_53_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:59 INFO BlockManagerInfo: Added broadcast_53_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:59 INFO SparkContext: Created broadcast 53 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:59 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=19590123, maxMem=20615905935 17/03/01 04:11:59 INFO MemoryStore: Block broadcast_54 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:59 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=19944979, maxMem=20615905935 17/03/01 04:11:59 INFO MemoryStore: Block broadcast_54_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:59 INFO BlockManagerInfo: Added broadcast_54_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:59 INFO SparkContext: Created broadcast 54 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:59 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=19969622, maxMem=20615905935 17/03/01 04:11:59 INFO MemoryStore: Block broadcast_55 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:59 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=20324478, maxMem=20615905935 17/03/01 04:11:59 INFO MemoryStore: Block broadcast_55_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:59 INFO BlockManagerInfo: Added broadcast_55_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:59 INFO SparkContext: Created broadcast 55 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:59 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=20349121, maxMem=20615905935 17/03/01 04:11:59 INFO MemoryStore: Block broadcast_56 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:59 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=20703977, maxMem=20615905935 17/03/01 04:11:59 INFO MemoryStore: Block broadcast_56_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:59 INFO BlockManagerInfo: Added broadcast_56_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:59 INFO SparkContext: Created broadcast 56 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:59 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=20728620, maxMem=20615905935 17/03/01 04:11:59 INFO MemoryStore: Block broadcast_57 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:59 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=21083476, maxMem=20615905935 17/03/01 04:11:59 INFO MemoryStore: Block broadcast_57_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:59 INFO BlockManagerInfo: Added broadcast_57_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:59 INFO SparkContext: Created broadcast 57 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:59 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=21108119, maxMem=20615905935 17/03/01 04:11:59 INFO MemoryStore: Block broadcast_58 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:59 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=21462975, maxMem=20615905935 17/03/01 04:11:59 INFO MemoryStore: Block broadcast_58_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:59 INFO BlockManagerInfo: Added broadcast_58_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:59 INFO SparkContext: Created broadcast 58 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:59 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=21487618, maxMem=20615905935 17/03/01 04:11:59 INFO MemoryStore: Block broadcast_59 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:59 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=21842474, maxMem=20615905935 17/03/01 04:11:59 INFO MemoryStore: Block broadcast_59_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:59 INFO BlockManagerInfo: Added broadcast_59_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:59 INFO SparkContext: Created broadcast 59 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:59 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=21867117, maxMem=20615905935 17/03/01 04:11:59 INFO MemoryStore: Block broadcast_60 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:59 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=22221973, maxMem=20615905935 17/03/01 04:11:59 INFO MemoryStore: Block broadcast_60_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:59 INFO BlockManagerInfo: Added broadcast_60_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:59 INFO SparkContext: Created broadcast 60 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:59 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=22246616, maxMem=20615905935 17/03/01 04:11:59 INFO MemoryStore: Block broadcast_61 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:59 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=22601472, maxMem=20615905935 17/03/01 04:11:59 INFO MemoryStore: Block broadcast_61_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:59 INFO BlockManagerInfo: Added broadcast_61_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:59 INFO SparkContext: Created broadcast 61 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:59 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=22626115, maxMem=20615905935 17/03/01 04:11:59 INFO MemoryStore: Block broadcast_62 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:59 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=22980971, maxMem=20615905935 17/03/01 04:11:59 INFO MemoryStore: Block broadcast_62_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:59 INFO BlockManagerInfo: Added broadcast_62_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:59 INFO SparkContext: Created broadcast 62 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:59 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=23005614, maxMem=20615905935 17/03/01 04:11:59 INFO MemoryStore: Block broadcast_63 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:59 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=23360470, maxMem=20615905935 17/03/01 04:11:59 INFO MemoryStore: Block broadcast_63_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:59 INFO BlockManagerInfo: Added broadcast_63_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:59 INFO SparkContext: Created broadcast 63 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:59 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=23385113, maxMem=20615905935 17/03/01 04:11:59 INFO MemoryStore: Block broadcast_64 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:11:59 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=23739969, maxMem=20615905935 17/03/01 04:11:59 INFO MemoryStore: Block broadcast_64_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:11:59 INFO BlockManagerInfo: Added broadcast_64_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:11:59 INFO SparkContext: Created broadcast 64 from hadoopFile at AvroRelation.scala:121 17/03/01 04:11:59 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=23764612, maxMem=20615905935 17/03/01 04:11:59 INFO MemoryStore: Block broadcast_65 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:00 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=24119468, maxMem=20615905935 17/03/01 04:12:00 INFO MemoryStore: Block broadcast_65_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:00 INFO BlockManagerInfo: Added broadcast_65_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:00 INFO SparkContext: Created broadcast 65 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:00 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=24144111, maxMem=20615905935 17/03/01 04:12:00 INFO MemoryStore: Block broadcast_66 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:00 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=24498967, maxMem=20615905935 17/03/01 04:12:00 INFO MemoryStore: Block broadcast_66_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:00 INFO BlockManagerInfo: Added broadcast_66_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:00 INFO SparkContext: Created broadcast 66 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:00 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=24523610, maxMem=20615905935 17/03/01 04:12:00 INFO MemoryStore: Block broadcast_67 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:00 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=24878466, maxMem=20615905935 17/03/01 04:12:00 INFO MemoryStore: Block broadcast_67_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:00 INFO BlockManagerInfo: Added broadcast_67_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:00 INFO SparkContext: Created broadcast 67 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:00 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=24903109, maxMem=20615905935 17/03/01 04:12:00 INFO MemoryStore: Block broadcast_68 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:00 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=25257965, maxMem=20615905935 17/03/01 04:12:00 INFO MemoryStore: Block broadcast_68_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:00 INFO BlockManagerInfo: Added broadcast_68_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:00 INFO SparkContext: Created broadcast 68 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:00 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=25282608, maxMem=20615905935 17/03/01 04:12:00 INFO MemoryStore: Block broadcast_69 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:00 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=25637464, maxMem=20615905935 17/03/01 04:12:00 INFO MemoryStore: Block broadcast_69_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:00 INFO BlockManagerInfo: Added broadcast_69_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:00 INFO SparkContext: Created broadcast 69 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:00 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=25662107, maxMem=20615905935 17/03/01 04:12:00 INFO MemoryStore: Block broadcast_70 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:00 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=26016963, maxMem=20615905935 17/03/01 04:12:00 INFO MemoryStore: Block broadcast_70_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:00 INFO BlockManagerInfo: Added broadcast_70_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:00 INFO SparkContext: Created broadcast 70 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:00 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=26041606, maxMem=20615905935 17/03/01 04:12:00 INFO MemoryStore: Block broadcast_71 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:00 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=26396462, maxMem=20615905935 17/03/01 04:12:00 INFO MemoryStore: Block broadcast_71_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:00 INFO BlockManagerInfo: Added broadcast_71_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:00 INFO SparkContext: Created broadcast 71 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:00 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=26421105, maxMem=20615905935 17/03/01 04:12:00 INFO MemoryStore: Block broadcast_72 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:00 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=26775961, maxMem=20615905935 17/03/01 04:12:00 INFO MemoryStore: Block broadcast_72_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:00 INFO BlockManagerInfo: Added broadcast_72_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:00 INFO SparkContext: Created broadcast 72 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:00 INFO BlockManagerInfo: Removed broadcast_42_piece0 on ipaddress:43498 in memory (size: 6.8 KB, free: 19.2 GB) 17/03/01 04:12:00 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=26766395, maxMem=20615905935 17/03/01 04:12:00 INFO MemoryStore: Block broadcast_73 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:00 INFO BlockManagerInfo: Removed broadcast_42_piece0 on hostName:46376 in memory (size: 6.8 KB, free: 7.8 GB) 17/03/01 04:12:00 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=27121251, maxMem=20615905935 17/03/01 04:12:00 INFO MemoryStore: Block broadcast_73_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:00 INFO BlockManagerInfo: Added broadcast_73_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:00 INFO SparkContext: Created broadcast 73 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:00 INFO ContextCleaner: Cleaned accumulator 2 17/03/01 04:12:00 INFO BlockManagerInfo: Removed broadcast_1_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:00 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=26975099, maxMem=20615905935 17/03/01 04:12:00 INFO MemoryStore: Block broadcast_74 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:00 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=27329955, maxMem=20615905935 17/03/01 04:12:00 INFO MemoryStore: Block broadcast_74_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:00 INFO BlockManagerInfo: Added broadcast_74_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:00 INFO SparkContext: Created broadcast 74 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:00 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=27354598, maxMem=20615905935 17/03/01 04:12:00 INFO MemoryStore: Block broadcast_75 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:00 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=27709454, maxMem=20615905935 17/03/01 04:12:00 INFO MemoryStore: Block broadcast_75_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:00 INFO BlockManagerInfo: Added broadcast_75_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:00 INFO SparkContext: Created broadcast 75 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:00 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=27734097, maxMem=20615905935 17/03/01 04:12:00 INFO MemoryStore: Block broadcast_76 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:00 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=28088953, maxMem=20615905935 17/03/01 04:12:00 INFO MemoryStore: Block broadcast_76_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:00 INFO BlockManagerInfo: Added broadcast_76_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:00 INFO SparkContext: Created broadcast 76 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:00 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=28113596, maxMem=20615905935 17/03/01 04:12:00 INFO MemoryStore: Block broadcast_77 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:00 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=28468452, maxMem=20615905935 17/03/01 04:12:00 INFO MemoryStore: Block broadcast_77_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:00 INFO BlockManagerInfo: Added broadcast_77_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:00 INFO SparkContext: Created broadcast 77 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:00 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=28493095, maxMem=20615905935 17/03/01 04:12:00 INFO MemoryStore: Block broadcast_78 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:00 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=28847951, maxMem=20615905935 17/03/01 04:12:00 INFO MemoryStore: Block broadcast_78_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:00 INFO BlockManagerInfo: Added broadcast_78_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:00 INFO SparkContext: Created broadcast 78 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:00 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=28872594, maxMem=20615905935 17/03/01 04:12:00 INFO MemoryStore: Block broadcast_79 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:00 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=29227450, maxMem=20615905935 17/03/01 04:12:00 INFO MemoryStore: Block broadcast_79_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:00 INFO BlockManagerInfo: Added broadcast_79_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:00 INFO SparkContext: Created broadcast 79 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:00 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=29252093, maxMem=20615905935 17/03/01 04:12:00 INFO MemoryStore: Block broadcast_80 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:00 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=29606949, maxMem=20615905935 17/03/01 04:12:00 INFO MemoryStore: Block broadcast_80_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:00 INFO BlockManagerInfo: Added broadcast_80_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:00 INFO SparkContext: Created broadcast 80 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:00 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=29631592, maxMem=20615905935 17/03/01 04:12:00 INFO MemoryStore: Block broadcast_81 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:00 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=29986448, maxMem=20615905935 17/03/01 04:12:00 INFO MemoryStore: Block broadcast_81_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:00 INFO BlockManagerInfo: Added broadcast_81_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:00 INFO SparkContext: Created broadcast 81 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:00 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=30011091, maxMem=20615905935 17/03/01 04:12:00 INFO MemoryStore: Block broadcast_82 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:00 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=30365947, maxMem=20615905935 17/03/01 04:12:00 INFO MemoryStore: Block broadcast_82_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:00 INFO BlockManagerInfo: Added broadcast_82_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:00 INFO SparkContext: Created broadcast 82 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:00 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=30390590, maxMem=20615905935 17/03/01 04:12:00 INFO MemoryStore: Block broadcast_83 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:00 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=30745446, maxMem=20615905935 17/03/01 04:12:00 INFO MemoryStore: Block broadcast_83_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:00 INFO BlockManagerInfo: Added broadcast_83_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:00 INFO SparkContext: Created broadcast 83 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:00 INFO SparkContext: Starting job: count at CompanyResolverSparkTest.scala:143 17/03/01 04:12:00 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AK067/5:1004 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AK067/3:1004 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /E01_S012_AJ018/01:1004 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /ELL_MFRM_U_034/77:1004 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AH079/5:1004 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AH079/2:1004 17/03/01 04:12:00 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:00 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:00 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AI067/81:1004 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /ELL_MFRM_T_021/06:1004 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /ELL_MFRM_S_021/95:1004 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AI067/77:1004 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /E01_S012_AO016/5:1004 17/03/01 04:12:00 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:00 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:00 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:00 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:00 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AA029/:1004 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /ELL_MFRM_Z_029/5:1004 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AA029/2:1004 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /ELL_MFRM_P_046/39:1004 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /ELL_MFRM_P_046/37:1004 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /E01_S012_AO021/4:1004 17/03/01 04:12:00 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:00 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:00 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:00 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AI067/08:1004 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /ELL_MFRM_Z_029/5:1004 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /ELL_MFRM_Z_029/5:1004 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /E01_S012_AO020/7:1004 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /E01_S012_AO020/5:1004 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AK067/5:1004 17/03/01 04:12:00 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:00 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AA029/9:1004 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AA029/8:1004 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /ELL_MFRM_Y_029/9:1004 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /E01_S012_AO019/:1004 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /E01_S012_AO019/8:1004 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /E01_S012_AO021/:1004 17/03/01 04:12:00 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:00 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:00 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:00 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:00 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:00 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:00 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:00 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:00 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AA029/8:1004 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AA029/9:1004 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /E01_S012_AO017/7:1004 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /ELL_ALCOVE_CL093/7:1004 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AK076/58:1004 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AK076/62:1004 17/03/01 04:12:00 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AK076/62:1004 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AE026/71:1004 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AK076/69:1004 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AI067/79:1004 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AI067/06:1004 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /E01_S012_AO020/:1004 17/03/01 04:12:00 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:00 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:00 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:00 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:00 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:00 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:00 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /ELL_MFRM_Y_029/:1004 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AJ067/8:1004 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /ELL_MFRM_Y_029/:1004 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /ELL_MFRM_Y_029/4:1004 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /E01_S012_AO019/2:1004 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /E01_S012_AO019/6:1004 17/03/01 04:12:00 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AF079/0:1004 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AJ067/2:1004 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AJ067/4:1004 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AA029/3:1004 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /ELL_MFRM_S_021/07:1004 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AA029/8:1004 17/03/01 04:12:00 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AF079/3:1004 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AK076/62:1004 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AF079/0:1004 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /ELL_MFRM_T_021/98:1004 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AK067/:1004 17/03/01 04:12:00 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AK067/5:1004 17/03/01 04:12:01 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:01 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:01 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:01 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:01 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:01 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:01 INFO DAGScheduler: Registering RDD 328 (count at CompanyResolverSparkTest.scala:143) 17/03/01 04:12:01 INFO DAGScheduler: Got job 2 (count at CompanyResolverSparkTest.scala:143) with 1 output partitions 17/03/01 04:12:01 INFO DAGScheduler: Final stage: ResultStage 3(count at CompanyResolverSparkTest.scala:143) 17/03/01 04:12:01 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 2) 17/03/01 04:12:01 INFO DAGScheduler: Missing parents: List(ShuffleMapStage 2) 17/03/01 04:12:01 INFO DAGScheduler: Submitting ShuffleMapStage 2 (MapPartitionsRDD[328] at count at CompanyResolverSparkTest.scala:143), which has no missing parents 17/03/01 04:12:01 INFO MemoryStore: ensureFreeSpace(32720) called with curMem=30770089, maxMem=20615905935 17/03/01 04:12:01 INFO MemoryStore: Block broadcast_84 stored as values in memory (estimated size 32.0 KB, free 19.2 GB) 17/03/01 04:12:01 INFO MemoryStore: ensureFreeSpace(9240) called with curMem=30802809, maxMem=20615905935 17/03/01 04:12:01 INFO MemoryStore: Block broadcast_84_piece0 stored as bytes in memory (estimated size 9.0 KB, free 19.2 GB) 17/03/01 04:12:01 INFO BlockManagerInfo: Added broadcast_84_piece0 in memory on ipaddress:43498 (size: 9.0 KB, free: 19.2 GB) 17/03/01 04:12:01 INFO SparkContext: Created broadcast 84 from broadcast at DAGScheduler.scala:861 17/03/01 04:12:01 INFO DAGScheduler: Submitting 80 missing tasks from ShuffleMapStage 2 (MapPartitionsRDD[328] at count at CompanyResolverSparkTest.scala:143) 17/03/01 04:12:01 INFO YarnClusterScheduler: Adding task set 2.0 with 80 tasks 17/03/01 04:12:03 INFO TaskSetManager: Starting task 58.0 in stage 2.0 (TID 41, hostName, partition 58,NODE_LOCAL, 2318 bytes) 17/03/01 04:12:03 INFO TaskSetManager: Starting task 16.0 in stage 2.0 (TID 42, hostName, partition 16,NODE_LOCAL, 2318 bytes) 17/03/01 04:12:03 INFO TaskSetManager: Starting task 54.0 in stage 2.0 (TID 43, hostName, partition 54,NODE_LOCAL, 2318 bytes) 17/03/01 04:12:03 INFO TaskSetManager: Starting task 46.0 in stage 2.0 (TID 44, hostName, partition 46,NODE_LOCAL, 2318 bytes) 17/03/01 04:12:03 INFO TaskSetManager: Starting task 40.0 in stage 2.0 (TID 45, hostName, partition 40,NODE_LOCAL, 2318 bytes) 17/03/01 04:12:03 INFO TaskSetManager: Starting task 74.0 in stage 2.0 (TID 46, hostName, partition 74,NODE_LOCAL, 2318 bytes) 17/03/01 04:12:03 INFO TaskSetManager: Starting task 41.0 in stage 2.0 (TID 47, hostName, partition 41,NODE_LOCAL, 2318 bytes) 17/03/01 04:12:03 INFO TaskSetManager: Starting task 52.0 in stage 2.0 (TID 48, hostName, partition 52,NODE_LOCAL, 2318 bytes) 17/03/01 04:12:03 INFO TaskSetManager: Starting task 18.0 in stage 2.0 (TID 49, hostName, partition 18,NODE_LOCAL, 2318 bytes) 17/03/01 04:12:03 INFO TaskSetManager: Starting task 2.0 in stage 2.0 (TID 50, hostName, partition 2,NODE_LOCAL, 2318 bytes) 17/03/01 04:12:03 INFO TaskSetManager: Starting task 48.0 in stage 2.0 (TID 51, hostName, partition 48,NODE_LOCAL, 2318 bytes) 17/03/01 04:12:03 INFO TaskSetManager: Starting task 59.0 in stage 2.0 (TID 52, hostName, partition 59,NODE_LOCAL, 2318 bytes) 17/03/01 04:12:03 INFO TaskSetManager: Starting task 0.0 in stage 2.0 (TID 53, hostName, partition 0,NODE_LOCAL, 2318 bytes) 17/03/01 04:12:03 INFO TaskSetManager: Starting task 28.0 in stage 2.0 (TID 54, hostName, partition 28,NODE_LOCAL, 2318 bytes) 17/03/01 04:12:03 INFO TaskSetManager: Starting task 14.0 in stage 2.0 (TID 55, hostName, partition 14,NODE_LOCAL, 2318 bytes) 17/03/01 04:12:03 INFO TaskSetManager: Starting task 15.0 in stage 2.0 (TID 56, hostName, partition 15,NODE_LOCAL, 2318 bytes) 17/03/01 04:12:03 INFO TaskSetManager: Starting task 12.0 in stage 2.0 (TID 57, hostName, partition 12,NODE_LOCAL, 2318 bytes) 17/03/01 04:12:03 INFO TaskSetManager: Starting task 50.0 in stage 2.0 (TID 58, hostName, partition 50,NODE_LOCAL, 2318 bytes) 17/03/01 04:12:03 INFO BlockManagerInfo: Added broadcast_84_piece0 in memory on hostName:46376 (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:03 INFO BlockManagerInfo: Added broadcast_84_piece0 in memory on hostName:38204 (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:03 INFO BlockManagerInfo: Added broadcast_84_piece0 in memory on hostName:48144 (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:03 INFO BlockManagerInfo: Added broadcast_84_piece0 in memory on hostName:34517 (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:03 INFO BlockManagerInfo: Added broadcast_84_piece0 in memory on hostName:56293 (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:03 INFO BlockManagerInfo: Added broadcast_84_piece0 in memory on hostName:42418 (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:03 INFO BlockManagerInfo: Added broadcast_84_piece0 in memory on hostName:56606 (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:03 INFO BlockManagerInfo: Added broadcast_84_piece0 in memory on hostName:49788 (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:03 INFO BlockManagerInfo: Added broadcast_84_piece0 in memory on hostName:48862 (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:03 INFO BlockManagerInfo: Added broadcast_84_piece0 in memory on hostName:52284 (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:03 INFO BlockManagerInfo: Added broadcast_84_piece0 in memory on hostName:43477 (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:03 INFO BlockManagerInfo: Added broadcast_84_piece0 in memory on hostName:56727 (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:03 INFO BlockManagerInfo: Added broadcast_84_piece0 in memory on hostName:45520 (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:03 INFO BlockManagerInfo: Added broadcast_84_piece0 in memory on hostName:51382 (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:03 INFO BlockManagerInfo: Added broadcast_84_piece0 in memory on hostName:41809 (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:03 INFO BlockManagerInfo: Added broadcast_84_piece0 in memory on hostName:43142 (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:03 INFO BlockManagerInfo: Added broadcast_84_piece0 in memory on hostName:33016 (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:03 INFO BlockManagerInfo: Added broadcast_84_piece0 in memory on hostName:56472 (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:03 INFO BlockManagerInfo: Added broadcast_44_piece0 in memory on hostName:46376 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:04 INFO BlockManagerInfo: Added broadcast_68_piece0 in memory on hostName:38204 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:04 INFO BlockManagerInfo: Added broadcast_50_piece0 in memory on hostName:45520 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:04 INFO BlockManagerInfo: Added broadcast_73_piece0 in memory on hostName:42418 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:04 INFO BlockManagerInfo: Added broadcast_81_piece0 in memory on hostName:49788 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:04 INFO BlockManagerInfo: Added broadcast_64_piece0 in memory on hostName:51382 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:04 INFO BlockManagerInfo: Added broadcast_70_piece0 in memory on hostName:41809 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:04 INFO BlockManagerInfo: Added broadcast_67_piece0 in memory on hostName:56727 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:04 INFO BlockManagerInfo: Added broadcast_71_piece0 in memory on hostName:33016 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:04 INFO BlockManagerInfo: Added broadcast_51_piece0 in memory on hostName:34517 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:04 INFO BlockManagerInfo: Added broadcast_45_piece0 in memory on hostName:48144 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:04 INFO BlockManagerInfo: Added broadcast_52_piece0 in memory on hostName:56606 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:04 INFO BlockManagerInfo: Added broadcast_69_piece0 in memory on hostName:43477 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:04 INFO BlockManagerInfo: Added broadcast_51_piece0 in memory on hostName:48862 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:04 INFO BlockManagerInfo: Added broadcast_53_piece0 in memory on hostName:56293 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:04 INFO BlockManagerInfo: Added broadcast_64_piece0 in memory on hostName:43142 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:04 INFO BlockManagerInfo: Added broadcast_73_piece0 in memory on hostName:52284 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:04 INFO BlockManagerInfo: Added broadcast_58_piece0 in memory on hostName:56472 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:04 INFO IgniteKernal%WCA: Metrics for local node (to disable set 'metricsLogFrequency' to 0) ^-- Node [id=6172ee3a, name=WCA, uptime=00:01:00:007] ^-- H/N/C [hosts=1, nodes=1, CPUs=48] ^-- CPU [cur=0.63%, avg=0.76%, GC=0%] ^-- Heap [used=871MB, free=97.61%, comm=3279MB] ^-- Non heap [used=124MB, free=-1%, comm=126MB] ^-- Public thread pool [active=0, idle=0, qSize=0] ^-- System thread pool [active=0, idle=0, qSize=0] ^-- Outbound messages queue [size=0] 17/03/01 04:12:06 INFO TaskSetManager: Starting task 13.0 in stage 2.0 (TID 59, hostName, partition 13,NODE_LOCAL, 2318 bytes) 17/03/01 04:12:06 INFO TaskSetManager: Finished task 12.0 in stage 2.0 (TID 57) in 3384 ms on hostName (1/80) 17/03/01 04:12:06 INFO TaskSetManager: Finished task 59.0 in stage 2.0 (TID 52) in 3417 ms on hostName (2/80) 17/03/01 04:12:06 INFO TaskSetManager: Finished task 58.0 in stage 2.0 (TID 41) in 3599 ms on hostName (3/80) 17/03/01 04:12:07 INFO TaskSetManager: Starting task 53.0 in stage 2.0 (TID 60, hostName, partition 53,NODE_LOCAL, 2318 bytes) 17/03/01 04:12:07 INFO TaskSetManager: Finished task 52.0 in stage 2.0 (TID 48) in 3924 ms on hostName (4/80) 17/03/01 04:12:07 INFO TaskSetManager: Finished task 14.0 in stage 2.0 (TID 55) in 3974 ms on hostName (5/80) 17/03/01 04:12:07 INFO TaskSetManager: Starting task 3.0 in stage 2.0 (TID 61, hostName, partition 3,NODE_LOCAL, 2318 bytes) 17/03/01 04:12:07 INFO TaskSetManager: Finished task 2.0 in stage 2.0 (TID 50) in 4070 ms on hostName (6/80) 17/03/01 04:12:07 INFO TaskSetManager: Finished task 40.0 in stage 2.0 (TID 45) in 4200 ms on hostName (7/80) 17/03/01 04:12:07 INFO TaskSetManager: Starting task 19.0 in stage 2.0 (TID 62, hostName, partition 19,NODE_LOCAL, 2318 bytes) 17/03/01 04:12:07 INFO TaskSetManager: Finished task 18.0 in stage 2.0 (TID 49) in 4244 ms on hostName (8/80) 17/03/01 04:12:07 INFO TaskSetManager: Starting task 51.0 in stage 2.0 (TID 63, hostName, partition 51,NODE_LOCAL, 2318 bytes) 17/03/01 04:12:07 INFO TaskSetManager: Finished task 50.0 in stage 2.0 (TID 58) in 4366 ms on hostName (9/80) 17/03/01 04:12:07 INFO TaskSetManager: Finished task 15.0 in stage 2.0 (TID 56) in 4463 ms on hostName (10/80) 17/03/01 04:12:07 INFO TaskSetManager: Finished task 41.0 in stage 2.0 (TID 47) in 4582 ms on hostName (11/80) 17/03/01 04:12:07 INFO TaskSetManager: Starting task 24.0 in stage 2.0 (TID 64, hostName, partition 24,NODE_LOCAL, 2318 bytes) 17/03/01 04:12:07 INFO TaskSetManager: Finished task 13.0 in stage 2.0 (TID 59) in 1200 ms on hostName (12/80) 17/03/01 04:12:07 INFO BlockManagerInfo: Added broadcast_56_piece0 in memory on hostName:45520 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:07 INFO TaskSetManager: Starting task 75.0 in stage 2.0 (TID 65, hostName, partition 75,NODE_LOCAL, 2318 bytes) 17/03/01 04:12:07 INFO TaskSetManager: Finished task 74.0 in stage 2.0 (TID 46) in 4661 ms on hostName (13/80) 17/03/01 04:12:07 INFO TaskSetManager: Starting task 55.0 in stage 2.0 (TID 66, hostName, partition 55,NODE_LOCAL, 2318 bytes) 17/03/01 04:12:07 INFO TaskSetManager: Finished task 54.0 in stage 2.0 (TID 43) in 4733 ms on hostName (14/80) 17/03/01 04:12:08 INFO TaskSetManager: Finished task 0.0 in stage 2.0 (TID 53) in 5348 ms on hostName (15/80) 17/03/01 04:12:08 INFO TaskSetManager: Finished task 53.0 in stage 2.0 (TID 60) in 1563 ms on hostName (16/80) 17/03/01 04:12:08 INFO TaskSetManager: Finished task 3.0 in stage 2.0 (TID 61) in 1457 ms on hostName (17/80) 17/03/01 04:12:08 INFO TaskSetManager: Finished task 16.0 in stage 2.0 (TID 42) in 5661 ms on hostName (18/80) 17/03/01 04:12:09 INFO TaskSetManager: Finished task 19.0 in stage 2.0 (TID 62) in 1565 ms on hostName (19/80) 17/03/01 04:12:09 INFO TaskSetManager: Finished task 51.0 in stage 2.0 (TID 63) in 1869 ms on hostName (20/80) 17/03/01 04:12:09 INFO TaskSetManager: Finished task 28.0 in stage 2.0 (TID 54) in 6286 ms on hostName (21/80) 17/03/01 04:12:09 INFO TaskSetManager: Finished task 46.0 in stage 2.0 (TID 44) in 6434 ms on hostName (22/80) 17/03/01 04:12:09 INFO TaskSetManager: Finished task 75.0 in stage 2.0 (TID 65) in 1809 ms on hostName (23/80) 17/03/01 04:12:09 INFO TaskSetManager: Finished task 48.0 in stage 2.0 (TID 51) in 6606 ms on hostName (24/80) 17/03/01 04:12:10 INFO TaskSetManager: Finished task 55.0 in stage 2.0 (TID 66) in 2301 ms on hostName (25/80) 17/03/01 04:12:11 INFO TaskSetManager: Starting task 72.0 in stage 2.0 (TID 67, hostName, partition 72,NODE_LOCAL, 2318 bytes) 17/03/01 04:12:11 INFO TaskSetManager: Finished task 24.0 in stage 2.0 (TID 64) in 3904 ms on hostName (26/80) 17/03/01 04:12:11 INFO BlockManagerInfo: Added broadcast_80_piece0 in memory on hostName:45520 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:13 INFO TaskSetManager: Starting task 73.0 in stage 2.0 (TID 68, hostName, partition 73,NODE_LOCAL, 2318 bytes) 17/03/01 04:12:13 INFO TaskSetManager: Finished task 72.0 in stage 2.0 (TID 67) in 1813 ms on hostName (27/80) 17/03/01 04:12:14 INFO GridUpdateNotifier: Update status is not available. 17/03/01 04:12:15 INFO TaskSetManager: Finished task 73.0 in stage 2.0 (TID 68) in 1922 ms on hostName (28/80) 17/03/01 04:12:16 INFO TaskSetManager: Starting task 25.0 in stage 2.0 (TID 69, hostName, partition 25,RACK_LOCAL, 2318 bytes) 17/03/01 04:12:16 INFO TaskSetManager: Starting task 20.0 in stage 2.0 (TID 70, hostName, partition 20,RACK_LOCAL, 2318 bytes) 17/03/01 04:12:16 INFO TaskSetManager: Starting task 17.0 in stage 2.0 (TID 71, hostName, partition 17,RACK_LOCAL, 2318 bytes) 17/03/01 04:12:16 INFO TaskSetManager: Starting task 49.0 in stage 2.0 (TID 72, hostName, partition 49,RACK_LOCAL, 2318 bytes) 17/03/01 04:12:16 INFO TaskSetManager: Starting task 78.0 in stage 2.0 (TID 73, hostName, partition 78,RACK_LOCAL, 2318 bytes) 17/03/01 04:12:16 INFO TaskSetManager: Starting task 22.0 in stage 2.0 (TID 74, hostName, partition 22,RACK_LOCAL, 2318 bytes) 17/03/01 04:12:16 INFO TaskSetManager: Starting task 32.0 in stage 2.0 (TID 75, hostName, partition 32,RACK_LOCAL, 2318 bytes) 17/03/01 04:12:16 INFO TaskSetManager: Starting task 23.0 in stage 2.0 (TID 76, hostName, partition 23,RACK_LOCAL, 2318 bytes) 17/03/01 04:12:16 INFO TaskSetManager: Starting task 47.0 in stage 2.0 (TID 77, hostName, partition 47,RACK_LOCAL, 2318 bytes) 17/03/01 04:12:16 INFO TaskSetManager: Starting task 34.0 in stage 2.0 (TID 78, hostName, partition 34,RACK_LOCAL, 2318 bytes) 17/03/01 04:12:16 INFO TaskSetManager: Starting task 6.0 in stage 2.0 (TID 79, hostName, partition 6,RACK_LOCAL, 2318 bytes) 17/03/01 04:12:16 INFO TaskSetManager: Starting task 29.0 in stage 2.0 (TID 80, hostName, partition 29,RACK_LOCAL, 2318 bytes) 17/03/01 04:12:16 INFO TaskSetManager: Starting task 7.0 in stage 2.0 (TID 81, hostName, partition 7,RACK_LOCAL, 2318 bytes) 17/03/01 04:12:16 INFO TaskSetManager: Starting task 79.0 in stage 2.0 (TID 82, hostName, partition 79,RACK_LOCAL, 2318 bytes) 17/03/01 04:12:16 INFO TaskSetManager: Starting task 4.0 in stage 2.0 (TID 83, hostName, partition 4,RACK_LOCAL, 2318 bytes) 17/03/01 04:12:16 INFO TaskSetManager: Starting task 33.0 in stage 2.0 (TID 84, hostName, partition 33,RACK_LOCAL, 2318 bytes) 17/03/01 04:12:16 INFO TaskSetManager: Starting task 38.0 in stage 2.0 (TID 85, hostName, partition 38,RACK_LOCAL, 2318 bytes) 17/03/01 04:12:16 INFO TaskSetManager: Starting task 66.0 in stage 2.0 (TID 86, hostName, partition 66,RACK_LOCAL, 2318 bytes) 17/03/01 04:12:16 INFO TaskSetManager: Starting task 5.0 in stage 2.0 (TID 87, hostName, partition 5,RACK_LOCAL, 2318 bytes) 17/03/01 04:12:16 INFO BlockManagerInfo: Added broadcast_47_piece0 in memory on hostName:45520 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:16 INFO BlockManagerInfo: Added broadcast_60_piece0 in memory on hostName:41809 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:16 INFO BlockManagerInfo: Added broadcast_77_piece0 in memory on hostName:38204 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:16 INFO BlockManagerInfo: Added broadcast_46_piece0 in memory on hostName:52284 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:16 INFO BlockManagerInfo: Added broadcast_68_piece0 in memory on hostName:49788 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:16 INFO BlockManagerInfo: Added broadcast_84_piece0 in memory on hostName:36400 (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:16 INFO BlockManagerInfo: Added broadcast_84_piece0 in memory on hostName:60209 (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:16 INFO BlockManagerInfo: Added broadcast_84_piece0 in memory on hostName:51137 (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:16 INFO BlockManagerInfo: Added broadcast_84_piece0 in memory on hostName:49289 (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:16 INFO BlockManagerInfo: Added broadcast_84_piece0 in memory on hostName:50848 (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:16 INFO BlockManagerInfo: Added broadcast_84_piece0 in memory on hostName:35888 (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:16 INFO BlockManagerInfo: Added broadcast_84_piece0 in memory on hostName:46027 (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:16 INFO BlockManagerInfo: Added broadcast_84_piece0 in memory on hostName:58857 (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:16 INFO BlockManagerInfo: Added broadcast_84_piece0 in memory on hostName:46180 (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:17 INFO BlockManagerInfo: Added broadcast_84_piece0 in memory on hostName:32912 (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:17 INFO BlockManagerInfo: Added broadcast_84_piece0 in memory on hostName:51773 (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:17 INFO BlockManagerInfo: Added broadcast_84_piece0 in memory on hostName:40903 (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:17 INFO BlockManagerInfo: Added broadcast_61_piece0 in memory on hostName:51137 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:17 INFO BlockManagerInfo: Added broadcast_54_piece0 in memory on hostName:46180 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:17 INFO BlockManagerInfo: Added broadcast_63_piece0 in memory on hostName:60209 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:17 INFO BlockManagerInfo: Added broadcast_83_piece0 in memory on hostName:50848 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:17 INFO BlockManagerInfo: Added broadcast_67_piece0 in memory on hostName:32912 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:17 INFO BlockManagerInfo: Added broadcast_55_piece0 in memory on hostName:49289 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:17 INFO BlockManagerInfo: Added broadcast_60_piece0 in memory on hostName:36400 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:17 INFO BlockManagerInfo: Added broadcast_56_piece0 in memory on hostName:35888 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:17 INFO BlockManagerInfo: Added broadcast_83_piece0 in memory on hostName:46027 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:17 INFO BlockManagerInfo: Added broadcast_46_piece0 in memory on hostName:58857 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:18 INFO BlockManagerInfo: Added broadcast_47_piece0 in memory on hostName:51773 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:18 INFO BlockManagerInfo: Added broadcast_55_piece0 in memory on hostName:40903 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:18 INFO TaskSetManager: Finished task 32.0 in stage 2.0 (TID 75) in 1782 ms on hostName (29/80) 17/03/01 04:12:18 INFO TaskSetManager: Starting task 42.0 in stage 2.0 (TID 88, hostName, partition 42,RACK_LOCAL, 2318 bytes) 17/03/01 04:12:18 INFO TaskSetManager: Finished task 4.0 in stage 2.0 (TID 83) in 1825 ms on hostName (30/80) 17/03/01 04:12:18 INFO BlockManagerInfo: Added broadcast_65_piece0 in memory on hostName:52284 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:19 INFO TaskSetManager: Starting task 26.0 in stage 2.0 (TID 89, hostName, partition 26,RACK_LOCAL, 2318 bytes) 17/03/01 04:12:19 INFO TaskSetManager: Finished task 7.0 in stage 2.0 (TID 81) in 2583 ms on hostName (31/80) 17/03/01 04:12:19 INFO BlockManagerInfo: Added broadcast_57_piece0 in memory on hostName:45520 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:19 INFO TaskSetManager: Starting task 67.0 in stage 2.0 (TID 90, hostName, partition 67,RACK_LOCAL, 2318 bytes) 17/03/01 04:12:19 INFO TaskSetManager: Finished task 66.0 in stage 2.0 (TID 86) in 2600 ms on hostName (32/80) 17/03/01 04:12:19 INFO TaskSetManager: Starting task 35.0 in stage 2.0 (TID 91, hostName, partition 35,RACK_LOCAL, 2318 bytes) 17/03/01 04:12:19 INFO TaskSetManager: Finished task 34.0 in stage 2.0 (TID 78) in 2719 ms on hostName (33/80) 17/03/01 04:12:19 INFO TaskSetManager: Starting task 43.0 in stage 2.0 (TID 92, hostName, partition 43,RACK_LOCAL, 2318 bytes) 17/03/01 04:12:19 INFO TaskSetManager: Finished task 42.0 in stage 2.0 (TID 88) in 1133 ms on hostName (34/80) 17/03/01 04:12:19 INFO TaskSetManager: Starting task 65.0 in stage 2.0 (TID 93, hostName, partition 65,RACK_LOCAL, 2318 bytes) 17/03/01 04:12:19 INFO TaskSetManager: Finished task 17.0 in stage 2.0 (TID 71) in 3012 ms on hostName (35/80) 17/03/01 04:12:19 INFO BlockManagerInfo: Added broadcast_76_piece0 in memory on hostName:56606 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:20 INFO TaskSetManager: Starting task 39.0 in stage 2.0 (TID 94, hostName, partition 39,RACK_LOCAL, 2318 bytes) 17/03/01 04:12:20 INFO TaskSetManager: Finished task 38.0 in stage 2.0 (TID 85) in 3287 ms on hostName (36/80) 17/03/01 04:12:20 INFO TaskSetManager: Starting task 36.0 in stage 2.0 (TID 95, hostName, partition 36,RACK_LOCAL, 2318 bytes) 17/03/01 04:12:20 INFO TaskSetManager: Finished task 35.0 in stage 2.0 (TID 91) in 578 ms on hostName (37/80) 17/03/01 04:12:20 INFO BlockManagerInfo: Added broadcast_62_piece0 in memory on hostName:51137 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:20 INFO TaskSetManager: Finished task 29.0 in stage 2.0 (TID 80) in 3370 ms on hostName (38/80) 17/03/01 04:12:20 INFO TaskSetManager: Starting task 27.0 in stage 2.0 (TID 96, hostName, partition 27,RACK_LOCAL, 2318 bytes) 17/03/01 04:12:20 INFO TaskSetManager: Finished task 26.0 in stage 2.0 (TID 89) in 882 ms on hostName (39/80) 17/03/01 04:12:20 INFO TaskSetManager: Finished task 22.0 in stage 2.0 (TID 74) in 3557 ms on hostName (40/80) 17/03/01 04:12:20 INFO TaskSetManager: Finished task 78.0 in stage 2.0 (TID 73) in 3767 ms on hostName (41/80) 17/03/01 04:12:20 INFO TaskSetManager: Finished task 79.0 in stage 2.0 (TID 82) in 3967 ms on hostName (42/80) 17/03/01 04:12:20 INFO TaskSetManager: Finished task 33.0 in stage 2.0 (TID 84) in 4053 ms on hostName (43/80) 17/03/01 04:12:21 INFO TaskSetManager: Starting task 62.0 in stage 2.0 (TID 97, hostName, partition 62,RACK_LOCAL, 2318 bytes) 17/03/01 04:12:21 INFO TaskSetManager: Finished task 43.0 in stage 2.0 (TID 92) in 1134 ms on hostName (44/80) 17/03/01 04:12:21 INFO BlockManagerInfo: Added broadcast_75_piece0 in memory on hostName:52284 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:21 INFO TaskSetManager: Finished task 27.0 in stage 2.0 (TID 96) in 668 ms on hostName (45/80) 17/03/01 04:12:21 INFO TaskSetManager: Starting task 21.0 in stage 2.0 (TID 98, hostName, partition 21,RACK_LOCAL, 2318 bytes) 17/03/01 04:12:21 INFO TaskSetManager: Finished task 20.0 in stage 2.0 (TID 70) in 4315 ms on hostName (46/80) 17/03/01 04:12:21 INFO TaskSetManager: Starting task 60.0 in stage 2.0 (TID 99, hostName, partition 60,RACK_LOCAL, 2318 bytes) 17/03/01 04:12:21 INFO TaskSetManager: Finished task 5.0 in stage 2.0 (TID 87) in 4314 ms on hostName (47/80) 17/03/01 04:12:21 INFO BlockManagerInfo: Added broadcast_74_piece0 in memory on hostName:58857 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:21 INFO TaskSetManager: Starting task 56.0 in stage 2.0 (TID 100, hostName, partition 56,RACK_LOCAL, 2318 bytes) 17/03/01 04:12:21 INFO TaskSetManager: Finished task 39.0 in stage 2.0 (TID 94) in 1073 ms on hostName (48/80) 17/03/01 04:12:21 INFO BlockManagerInfo: Added broadcast_72_piece0 in memory on hostName:60209 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:21 INFO TaskSetManager: Finished task 23.0 in stage 2.0 (TID 76) in 4485 ms on hostName (49/80) 17/03/01 04:12:21 INFO TaskSetManager: Finished task 49.0 in stage 2.0 (TID 72) in 4519 ms on hostName (50/80) 17/03/01 04:12:21 INFO TaskSetManager: Starting task 76.0 in stage 2.0 (TID 101, hostName, partition 76,RACK_LOCAL, 2318 bytes) 17/03/01 04:12:21 INFO TaskSetManager: Finished task 67.0 in stage 2.0 (TID 90) in 2402 ms on hostName (51/80) 17/03/01 04:12:21 INFO BlockManagerInfo: Added broadcast_82_piece0 in memory on hostName:38204 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:22 INFO TaskSetManager: Starting task 37.0 in stage 2.0 (TID 102, hostName, partition 37,RACK_LOCAL, 2318 bytes) 17/03/01 04:12:22 INFO TaskSetManager: Finished task 36.0 in stage 2.0 (TID 95) in 2016 ms on hostName (52/80) 17/03/01 04:12:22 INFO TaskSetManager: Starting task 70.0 in stage 2.0 (TID 103, hostName, partition 70,RACK_LOCAL, 2318 bytes) 17/03/01 04:12:22 INFO TaskSetManager: Finished task 6.0 in stage 2.0 (TID 79) in 5567 ms on hostName (53/80) 17/03/01 04:12:22 INFO BlockManagerInfo: Added broadcast_79_piece0 in memory on hostName:51773 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:22 INFO TaskSetManager: Starting task 57.0 in stage 2.0 (TID 104, hostName, partition 57,RACK_LOCAL, 2318 bytes) 17/03/01 04:12:22 INFO TaskSetManager: Finished task 56.0 in stage 2.0 (TID 100) in 1298 ms on hostName (54/80) 17/03/01 04:12:22 INFO TaskSetManager: Finished task 21.0 in stage 2.0 (TID 98) in 1709 ms on hostName (55/80) 17/03/01 04:12:23 INFO TaskSetManager: Starting task 77.0 in stage 2.0 (TID 105, hostName, partition 77,RACK_LOCAL, 2318 bytes) 17/03/01 04:12:23 INFO TaskSetManager: Finished task 76.0 in stage 2.0 (TID 101) in 1164 ms on hostName (56/80) 17/03/01 04:12:23 INFO TaskSetManager: Finished task 47.0 in stage 2.0 (TID 77) in 6294 ms on hostName (57/80) 17/03/01 04:12:23 INFO TaskSetManager: Finished task 65.0 in stage 2.0 (TID 93) in 3485 ms on hostName (58/80) 17/03/01 04:12:23 INFO TaskSetManager: Starting task 61.0 in stage 2.0 (TID 106, hostName, partition 61,RACK_LOCAL, 2318 bytes) 17/03/01 04:12:23 INFO TaskSetManager: Finished task 60.0 in stage 2.0 (TID 99) in 2494 ms on hostName (59/80) 17/03/01 04:12:23 INFO TaskSetManager: Finished task 25.0 in stage 2.0 (TID 69) in 6913 ms on hostName (60/80) 17/03/01 04:12:23 INFO TaskSetManager: Finished task 57.0 in stage 2.0 (TID 104) in 1309 ms on hostName (61/80) 17/03/01 04:12:24 INFO TaskSetManager: Finished task 77.0 in stage 2.0 (TID 105) in 1138 ms on hostName (62/80) 17/03/01 04:12:24 INFO TaskSetManager: Starting task 44.0 in stage 2.0 (TID 107, hostName, partition 44,RACK_LOCAL, 2318 bytes) 17/03/01 04:12:24 INFO TaskSetManager: Finished task 37.0 in stage 2.0 (TID 102) in 2016 ms on hostName (63/80) 17/03/01 04:12:24 INFO BlockManagerInfo: Added broadcast_66_piece0 in memory on hostName:51137 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:24 INFO TaskSetManager: Starting task 63.0 in stage 2.0 (TID 108, hostName, partition 63,RACK_LOCAL, 2318 bytes) 17/03/01 04:12:24 INFO TaskSetManager: Finished task 62.0 in stage 2.0 (TID 97) in 3545 ms on hostName (64/80) 17/03/01 04:12:24 INFO TaskSetManager: Starting task 71.0 in stage 2.0 (TID 109, hostName, partition 71,RACK_LOCAL, 2318 bytes) 17/03/01 04:12:24 INFO TaskSetManager: Finished task 70.0 in stage 2.0 (TID 103) in 2207 ms on hostName (65/80) 17/03/01 04:12:25 INFO TaskSetManager: Starting task 45.0 in stage 2.0 (TID 110, hostName, partition 45,RACK_LOCAL, 2318 bytes) 17/03/01 04:12:25 INFO TaskSetManager: Finished task 44.0 in stage 2.0 (TID 107) in 1655 ms on hostName (66/80) 17/03/01 04:12:25 INFO TaskSetManager: Finished task 61.0 in stage 2.0 (TID 106) in 2262 ms on hostName (67/80) 17/03/01 04:12:26 INFO TaskSetManager: Finished task 71.0 in stage 2.0 (TID 109) in 2050 ms on hostName (68/80) 17/03/01 04:12:27 INFO TaskSetManager: Finished task 45.0 in stage 2.0 (TID 110) in 1597 ms on hostName (69/80) 17/03/01 04:12:27 INFO TaskSetManager: Starting task 68.0 in stage 2.0 (TID 111, hostName, partition 68,RACK_LOCAL, 2318 bytes) 17/03/01 04:12:27 INFO TaskSetManager: Finished task 63.0 in stage 2.0 (TID 108) in 3254 ms on hostName (70/80) 17/03/01 04:12:27 INFO BlockManagerInfo: Added broadcast_78_piece0 in memory on hostName:52284 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:28 INFO TaskSetManager: Starting task 69.0 in stage 2.0 (TID 112, hostName, partition 69,RACK_LOCAL, 2318 bytes) 17/03/01 04:12:28 INFO TaskSetManager: Finished task 68.0 in stage 2.0 (TID 111) in 924 ms on hostName (71/80) 17/03/01 04:12:29 INFO TaskSetManager: Finished task 69.0 in stage 2.0 (TID 112) in 928 ms on hostName (72/80) 17/03/01 04:12:31 INFO TaskSetManager: Starting task 1.0 in stage 2.0 (TID 113, hostName, partition 1,ANY, 2318 bytes) 17/03/01 04:12:31 INFO TaskSetManager: Starting task 8.0 in stage 2.0 (TID 114, hostName, partition 8,ANY, 2318 bytes) 17/03/01 04:12:31 INFO TaskSetManager: Starting task 9.0 in stage 2.0 (TID 115, hostName, partition 9,ANY, 2318 bytes) 17/03/01 04:12:31 INFO TaskSetManager: Starting task 10.0 in stage 2.0 (TID 116, hostName, partition 10,ANY, 2318 bytes) 17/03/01 04:12:31 INFO TaskSetManager: Starting task 11.0 in stage 2.0 (TID 117, hostName, partition 11,ANY, 2318 bytes) 17/03/01 04:12:31 INFO TaskSetManager: Starting task 30.0 in stage 2.0 (TID 118, hostName, partition 30,ANY, 2318 bytes) 17/03/01 04:12:31 INFO TaskSetManager: Starting task 31.0 in stage 2.0 (TID 119, hostName, partition 31,ANY, 2318 bytes) 17/03/01 04:12:31 INFO TaskSetManager: Starting task 64.0 in stage 2.0 (TID 120, hostName, partition 64,ANY, 2318 bytes) 17/03/01 04:12:31 INFO BlockManagerInfo: Added broadcast_48_piece0 in memory on hostName:56606 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:31 INFO BlockManagerInfo: Added broadcast_59_piece0 in memory on hostName:51773 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:31 INFO BlockManagerInfo: Added broadcast_49_piece0 in memory on hostName:50848 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:31 INFO BlockManagerInfo: Added broadcast_59_piece0 in memory on hostName:43142 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:31 INFO BlockManagerInfo: Added broadcast_49_piece0 in memory on hostName:32912 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:31 INFO BlockManagerInfo: Added broadcast_76_piece0 in memory on hostName:46027 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:31 INFO BlockManagerInfo: Added broadcast_84_piece0 in memory on hostName:35569 (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:31 INFO BlockManagerInfo: Added broadcast_44_piece0 in memory on hostName:52284 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:32 INFO BlockManagerInfo: Added broadcast_48_piece0 in memory on hostName:35569 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:33 INFO TaskSetManager: Finished task 9.0 in stage 2.0 (TID 115) in 1401 ms on hostName (73/80) 17/03/01 04:12:33 INFO TaskSetManager: Finished task 10.0 in stage 2.0 (TID 116) in 1659 ms on hostName (74/80) 17/03/01 04:12:33 INFO TaskSetManager: Finished task 11.0 in stage 2.0 (TID 117) in 1798 ms on hostName (75/80) 17/03/01 04:12:34 INFO TaskSetManager: Finished task 31.0 in stage 2.0 (TID 119) in 2485 ms on hostName (76/80) 17/03/01 04:12:34 INFO TaskSetManager: Finished task 30.0 in stage 2.0 (TID 118) in 2492 ms on hostName (77/80) 17/03/01 04:12:35 INFO TaskSetManager: Finished task 64.0 in stage 2.0 (TID 120) in 3568 ms on hostName (78/80) 17/03/01 04:12:36 INFO TaskSetManager: Finished task 8.0 in stage 2.0 (TID 114) in 4312 ms on hostName (79/80) 17/03/01 04:12:38 INFO TaskSetManager: Finished task 1.0 in stage 2.0 (TID 113) in 6144 ms on hostName (80/80) 17/03/01 04:12:38 INFO YarnClusterScheduler: Removed TaskSet 2.0, whose tasks have all completed, from pool 17/03/01 04:12:38 INFO DAGScheduler: ShuffleMapStage 2 (count at CompanyResolverSparkTest.scala:143) finished in 34.858 s 17/03/01 04:12:38 INFO DAGScheduler: looking for newly runnable stages 17/03/01 04:12:38 INFO DAGScheduler: running: Set() 17/03/01 04:12:38 INFO DAGScheduler: waiting: Set(ResultStage 3) 17/03/01 04:12:38 INFO DAGScheduler: failed: Set() 17/03/01 04:12:38 INFO DAGScheduler: Missing parents for ResultStage 3: List() 17/03/01 04:12:38 INFO DAGScheduler: Submitting ResultStage 3 (MapPartitionsRDD[331] at count at CompanyResolverSparkTest.scala:143), which is now runnable 17/03/01 04:12:38 INFO MemoryStore: ensureFreeSpace(33344) called with curMem=30812049, maxMem=20615905935 17/03/01 04:12:38 INFO MemoryStore: Block broadcast_85 stored as values in memory (estimated size 32.6 KB, free 19.2 GB) 17/03/01 04:12:38 INFO MemoryStore: ensureFreeSpace(9776) called with curMem=30845393, maxMem=20615905935 17/03/01 04:12:38 INFO MemoryStore: Block broadcast_85_piece0 stored as bytes in memory (estimated size 9.5 KB, free 19.2 GB) 17/03/01 04:12:38 INFO BlockManagerInfo: Added broadcast_85_piece0 in memory on ipaddress:43498 (size: 9.5 KB, free: 19.2 GB) 17/03/01 04:12:38 INFO SparkContext: Created broadcast 85 from broadcast at DAGScheduler.scala:861 17/03/01 04:12:38 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 3 (MapPartitionsRDD[331] at count at CompanyResolverSparkTest.scala:143) 17/03/01 04:12:38 INFO YarnClusterScheduler: Adding task set 3.0 with 1 tasks 17/03/01 04:12:38 INFO TaskSetManager: Starting task 0.0 in stage 3.0 (TID 121, hostName, partition 0,PROCESS_LOCAL, 1914 bytes) 17/03/01 04:12:38 INFO BlockManagerInfo: Added broadcast_85_piece0 in memory on hostName:49289 (size: 9.5 KB, free: 7.8 GB) 17/03/01 04:12:38 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 0 to hostName:52829 17/03/01 04:12:38 INFO MapOutputTrackerMaster: Size of output statuses for shuffle 0 is 676 bytes 17/03/01 04:12:38 INFO TaskSetManager: Finished task 0.0 in stage 3.0 (TID 121) in 219 ms on hostName (1/1) 17/03/01 04:12:38 INFO YarnClusterScheduler: Removed TaskSet 3.0, whose tasks have all completed, from pool 17/03/01 04:12:38 INFO DAGScheduler: ResultStage 3 (count at CompanyResolverSparkTest.scala:143) finished in 0.220 s 17/03/01 04:12:38 INFO DAGScheduler: Job 2 finished: count at CompanyResolverSparkTest.scala:143, took 37.859467 s 17/03/01 04:12:38 INFO CompanyResolverSparkTest: Count of the DataFrame - 43857742 17/03/01 04:12:38 INFO CompanyResolverSparkTest: Will start Ignite nodes on 40 workers 17/03/01 04:12:38 INFO SparkContext: Starting job: foreachPartition at CompanyResolverSparkTest.scala:152 17/03/01 04:12:38 INFO DAGScheduler: Got job 3 (foreachPartition at CompanyResolverSparkTest.scala:152) with 40 output partitions 17/03/01 04:12:38 INFO DAGScheduler: Final stage: ResultStage 4(foreachPartition at CompanyResolverSparkTest.scala:152) 17/03/01 04:12:38 INFO DAGScheduler: Parents of final stage: List() 17/03/01 04:12:38 INFO DAGScheduler: Missing parents: List() 17/03/01 04:12:38 INFO DAGScheduler: Submitting ResultStage 4 (ParallelCollectionRDD[332] at parallelize at CompanyResolverSparkTest.scala:152), which has no missing parents 17/03/01 04:12:38 INFO MemoryStore: ensureFreeSpace(6560) called with curMem=30855169, maxMem=20615905935 17/03/01 04:12:38 INFO MemoryStore: Block broadcast_86 stored as values in memory (estimated size 6.4 KB, free 19.2 GB) 17/03/01 04:12:38 INFO MemoryStore: ensureFreeSpace(2290) called with curMem=30861729, maxMem=20615905935 17/03/01 04:12:38 INFO MemoryStore: Block broadcast_86_piece0 stored as bytes in memory (estimated size 2.2 KB, free 19.2 GB) 17/03/01 04:12:38 INFO BlockManagerInfo: Added broadcast_86_piece0 in memory on ipaddress:43498 (size: 2.2 KB, free: 19.2 GB) 17/03/01 04:12:38 INFO SparkContext: Created broadcast 86 from broadcast at DAGScheduler.scala:861 17/03/01 04:12:38 INFO DAGScheduler: Submitting 40 missing tasks from ResultStage 4 (ParallelCollectionRDD[332] at parallelize at CompanyResolverSparkTest.scala:152) 17/03/01 04:12:38 INFO YarnClusterScheduler: Adding task set 4.0 with 40 tasks 17/03/01 04:12:38 INFO TaskSetManager: Starting task 0.0 in stage 4.0 (TID 122, hostName, partition 0,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:12:38 INFO TaskSetManager: Starting task 1.0 in stage 4.0 (TID 123, hostName, partition 1,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:12:38 INFO TaskSetManager: Starting task 2.0 in stage 4.0 (TID 124, hostName, partition 2,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:12:38 INFO TaskSetManager: Starting task 3.0 in stage 4.0 (TID 125, hostName, partition 3,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:12:38 INFO TaskSetManager: Starting task 4.0 in stage 4.0 (TID 126, hostName, partition 4,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:12:38 INFO TaskSetManager: Starting task 5.0 in stage 4.0 (TID 127, hostName, partition 5,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:12:38 INFO TaskSetManager: Starting task 6.0 in stage 4.0 (TID 128, hostName, partition 6,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:12:38 INFO TaskSetManager: Starting task 7.0 in stage 4.0 (TID 129, hostName, partition 7,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:12:38 INFO TaskSetManager: Starting task 8.0 in stage 4.0 (TID 130, hostName, partition 8,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:12:38 INFO TaskSetManager: Starting task 9.0 in stage 4.0 (TID 131, hostName, partition 9,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:12:38 INFO TaskSetManager: Starting task 10.0 in stage 4.0 (TID 132, hostName, partition 10,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:12:38 INFO TaskSetManager: Starting task 11.0 in stage 4.0 (TID 133, hostName, partition 11,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:12:38 INFO TaskSetManager: Starting task 12.0 in stage 4.0 (TID 134, hostName, partition 12,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:12:38 INFO TaskSetManager: Starting task 13.0 in stage 4.0 (TID 135, hostName, partition 13,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:12:38 INFO TaskSetManager: Starting task 14.0 in stage 4.0 (TID 136, hostName, partition 14,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:12:38 INFO TaskSetManager: Starting task 15.0 in stage 4.0 (TID 137, hostName, partition 15,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:12:38 INFO TaskSetManager: Starting task 16.0 in stage 4.0 (TID 138, hostName, partition 16,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:12:38 INFO TaskSetManager: Starting task 17.0 in stage 4.0 (TID 139, hostName, partition 17,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:12:38 INFO TaskSetManager: Starting task 18.0 in stage 4.0 (TID 140, hostName, partition 18,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:12:38 INFO TaskSetManager: Starting task 19.0 in stage 4.0 (TID 141, hostName, partition 19,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:12:38 INFO TaskSetManager: Starting task 20.0 in stage 4.0 (TID 142, hostName, partition 20,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:12:38 INFO TaskSetManager: Starting task 21.0 in stage 4.0 (TID 143, hostName, partition 21,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:12:38 INFO TaskSetManager: Starting task 22.0 in stage 4.0 (TID 144, hostName, partition 22,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:12:38 INFO TaskSetManager: Starting task 23.0 in stage 4.0 (TID 145, hostName, partition 23,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:12:38 INFO TaskSetManager: Starting task 24.0 in stage 4.0 (TID 146, hostName, partition 24,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:12:38 INFO TaskSetManager: Starting task 25.0 in stage 4.0 (TID 147, hostName, partition 25,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:12:38 INFO TaskSetManager: Starting task 26.0 in stage 4.0 (TID 148, hostName, partition 26,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:12:38 INFO TaskSetManager: Starting task 27.0 in stage 4.0 (TID 149, hostName, partition 27,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:12:38 INFO TaskSetManager: Starting task 28.0 in stage 4.0 (TID 150, hostName, partition 28,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:12:38 INFO TaskSetManager: Starting task 29.0 in stage 4.0 (TID 151, hostName, partition 29,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:12:38 INFO TaskSetManager: Starting task 30.0 in stage 4.0 (TID 152, hostName, partition 30,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:12:38 INFO TaskSetManager: Starting task 31.0 in stage 4.0 (TID 153, hostName, partition 31,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:12:38 INFO TaskSetManager: Starting task 32.0 in stage 4.0 (TID 154, hostName, partition 32,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:12:38 INFO TaskSetManager: Starting task 33.0 in stage 4.0 (TID 155, hostName, partition 33,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:12:38 INFO TaskSetManager: Starting task 34.0 in stage 4.0 (TID 156, hostName, partition 34,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:12:38 INFO TaskSetManager: Starting task 35.0 in stage 4.0 (TID 157, hostName, partition 35,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:12:38 INFO TaskSetManager: Starting task 36.0 in stage 4.0 (TID 158, hostName, partition 36,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:12:38 INFO TaskSetManager: Starting task 37.0 in stage 4.0 (TID 159, hostName, partition 37,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:12:38 INFO TaskSetManager: Starting task 38.0 in stage 4.0 (TID 160, hostName, partition 38,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:12:38 INFO TaskSetManager: Starting task 39.0 in stage 4.0 (TID 161, hostName, partition 39,PROCESS_LOCAL, 2142 bytes) 17/03/01 04:12:38 INFO BlockManagerInfo: Added broadcast_86_piece0 in memory on hostName:45520 (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:38 INFO BlockManagerInfo: Added broadcast_86_piece0 in memory on hostName:56606 (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:38 INFO BlockManagerInfo: Added broadcast_86_piece0 in memory on hostName:51137 (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:38 INFO BlockManagerInfo: Added broadcast_86_piece0 in memory on hostName:38204 (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:38 INFO BlockManagerInfo: Added broadcast_86_piece0 in memory on hostName:46376 (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:38 INFO BlockManagerInfo: Added broadcast_86_piece0 in memory on hostName:60209 (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:38 INFO BlockManagerInfo: Added broadcast_86_piece0 in memory on hostName:49788 (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:38 INFO BlockManagerInfo: Added broadcast_86_piece0 in memory on hostName:49289 (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:38 INFO BlockManagerInfo: Added broadcast_86_piece0 in memory on hostName:43142 (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:38 INFO BlockManagerInfo: Added broadcast_86_piece0 in memory on hostName:32912 (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:38 INFO BlockManagerInfo: Added broadcast_86_piece0 in memory on hostName:43477 (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:38 INFO BlockManagerInfo: Added broadcast_86_piece0 in memory on hostName:52284 (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:38 INFO BlockManagerInfo: Added broadcast_86_piece0 in memory on hostName:41809 (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:38 INFO BlockManagerInfo: Added broadcast_86_piece0 in memory on hostName:50848 (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:38 INFO BlockManagerInfo: Added broadcast_86_piece0 in memory on hostName:35888 (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:38 INFO BlockManagerInfo: Added broadcast_86_piece0 in memory on hostName:36400 (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:38 INFO BlockManagerInfo: Added broadcast_86_piece0 in memory on hostName:48862 (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:38 INFO BlockManagerInfo: Added broadcast_86_piece0 in memory on hostName:34517 (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:38 INFO BlockManagerInfo: Added broadcast_86_piece0 in memory on hostName:35569 (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:38 INFO BlockManagerInfo: Added broadcast_86_piece0 in memory on hostName:57052 (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:38 INFO BlockManagerInfo: Added broadcast_86_piece0 in memory on hostName:33016 (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:38 INFO BlockManagerInfo: Added broadcast_86_piece0 in memory on hostName:46027 (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:38 INFO BlockManagerInfo: Added broadcast_86_piece0 in memory on hostName:51382 (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:38 INFO BlockManagerInfo: Added broadcast_86_piece0 in memory on hostName:56727 (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:38 INFO BlockManagerInfo: Added broadcast_86_piece0 in memory on hostName:48144 (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:38 INFO BlockManagerInfo: Added broadcast_86_piece0 in memory on hostName:41952 (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:38 INFO BlockManagerInfo: Added broadcast_86_piece0 in memory on hostName:45617 (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:38 INFO BlockManagerInfo: Added broadcast_86_piece0 in memory on hostName:51773 (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:38 INFO BlockManagerInfo: Added broadcast_86_piece0 in memory on hostName:41443 (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:38 INFO BlockManagerInfo: Added broadcast_86_piece0 in memory on hostName:37357 (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:38 INFO BlockManagerInfo: Added broadcast_86_piece0 in memory on hostName:46180 (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:38 INFO BlockManagerInfo: Added broadcast_86_piece0 in memory on hostName:42418 (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:38 INFO BlockManagerInfo: Added broadcast_86_piece0 in memory on hostName:50154 (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:38 INFO BlockManagerInfo: Added broadcast_86_piece0 in memory on hostName:56472 (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:38 INFO BlockManagerInfo: Added broadcast_86_piece0 in memory on hostName:44583 (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:38 INFO BlockManagerInfo: Added broadcast_86_piece0 in memory on hostName:56293 (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:38 INFO BlockManagerInfo: Added broadcast_86_piece0 in memory on hostName:55987 (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:38 INFO BlockManagerInfo: Added broadcast_86_piece0 in memory on hostName:40903 (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:38 INFO BlockManagerInfo: Added broadcast_86_piece0 in memory on hostName:58857 (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:38 INFO BlockManagerInfo: Added broadcast_86_piece0 in memory on hostName:44721 (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:39 INFO GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=90db2cab-26f6-463d-9755-d03d059a8723, addrs=[69, 127.0.0.1], sockAddrs=[hostName/69:47500, /127.0.0.1:47500], discPort=47500, order=2, intOrder=2, lastExchangeTime=1488363159586, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:39 INFO GridDiscoveryManager: Topology snapshot [ver=2, servers=2, clients=0, CPUs=96, heap=51.0GB] 17/03/01 04:12:39 INFO GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=3e101db5-8c5c-47b7-bbdb-a9a892c4bada, addrs=[08, 127.0.0.1], sockAddrs=[hostName/08:47500, /127.0.0.1:47500], discPort=47500, order=3, intOrder=3, lastExchangeTime=1488363159606, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:39 INFO GridDiscoveryManager: Topology snapshot [ver=3, servers=3, clients=0, CPUs=144, heap=66.0GB] 17/03/01 04:12:39 INFO GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=40d089f0-7c80-4f1f-8659-350791f57a4c, addrs=[37, 127.0.0.1], sockAddrs=[hostName/37:47500, /127.0.0.1:47500], discPort=47500, order=4, intOrder=4, lastExchangeTime=1488363159737, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:39 INFO GridDiscoveryManager: Topology snapshot [ver=4, servers=4, clients=0, CPUs=192, heap=81.0GB] 17/03/01 04:12:39 INFO GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=90532831-88fb-4eb8-adc9-db7a86744869, addrs=[0, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/0:47500], discPort=47500, order=5, intOrder=5, lastExchangeTime=1488363159748, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:39 INFO GridDiscoveryManager: Topology snapshot [ver=5, servers=5, clients=0, CPUs=232, heap=96.0GB] 17/03/01 04:12:40 INFO GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=d4a9fe7f-de19-4df7-874c-a084da78562f, addrs=[4, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/4:47500], discPort=47500, order=6, intOrder=6, lastExchangeTime=1488363159748, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:40 INFO GridDiscoveryManager: Topology snapshot [ver=6, servers=6, clients=0, CPUs=272, heap=110.0GB] 17/03/01 04:12:40 INFO GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=5bc51e21-1dcf-498a-b87e-6dd24f7e36ad, addrs=[8, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/8:47500], discPort=47500, order=7, intOrder=7, lastExchangeTime=1488363159899, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:40 INFO GridDiscoveryManager: Topology snapshot [ver=7, servers=7, clients=0, CPUs=312, heap=130.0GB] 17/03/01 04:12:40 INFO GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=daed0152-83fc-4828-ada6-64c74787b190, addrs=[, 127.0.0.1], sockAddrs=[hostName/:47500, /127.0.0.1:47500], discPort=47500, order=8, intOrder=8, lastExchangeTime=1488363159909, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:40 INFO GridDiscoveryManager: Topology snapshot [ver=8, servers=8, clients=0, CPUs=352, heap=140.0GB] 17/03/01 04:12:40 INFO GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=29716cf1-ed55-4550-82bd-cf980a0aee2c, addrs=[, 127.0.0.1], sockAddrs=[hostName/:47501, /127.0.0.1:47501], discPort=47501, order=9, intOrder=9, lastExchangeTime=1488363159940, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:40 INFO GridDiscoveryManager: Topology snapshot [ver=9, servers=9, clients=0, CPUs=392, heap=160.0GB] 17/03/01 04:12:40 INFO GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=0], evt=NODE_JOINED, node=90db2cab-26f6-463d-9755-d03d059a8723] 17/03/01 04:12:40 INFO GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=717de453-fc6b-4a46-91b2-b5c54ab8a4be, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=10, intOrder=10, lastExchangeTime=1488363159950, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:40 INFO GridDiscoveryManager: Topology snapshot [ver=10, servers=10, clients=0, CPUs=432, heap=170.0GB] 17/03/01 04:12:40 INFO GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_JOINED, node=3e101db5-8c5c-47b7-bbdb-a9a892c4bada] 17/03/01 04:12:40 INFO GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=ffe19475-7849-4027-8648-ce56598ff50f, addrs=[7, 127.0.0.1], sockAddrs=[/127.0.0.1:47501, hostName/7:47501], discPort=47501, order=11, intOrder=11, lastExchangeTime=1488363159960, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:40 INFO GridDiscoveryManager: Topology snapshot [ver=11, servers=11, clients=0, CPUs=472, heap=190.0GB] 17/03/01 04:12:40 INFO GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_JOINED, node=40d089f0-7c80-4f1f-8659-350791f57a4c] 17/03/01 04:12:40 INFO GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=8be1bd05-d62c-4f1a-83f2-91dcb3f3b62a, addrs=[07, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/07:47500], discPort=47500, order=12, intOrder=12, lastExchangeTime=1488363159960, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:40 INFO GridDiscoveryManager: Topology snapshot [ver=12, servers=12, clients=0, CPUs=504, heap=200.0GB] 17/03/01 04:12:40 INFO GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=133c388f-3399-4cc8-b2f1-7ae8ba971b03, addrs=[7, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/7:47500], discPort=47500, order=13, intOrder=13, lastExchangeTime=1488363160000, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:40 INFO GridDiscoveryManager: Topology snapshot [ver=13, servers=13, clients=0, CPUs=544, heap=220.0GB] 17/03/01 04:12:40 INFO GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=5, minorTopVer=0], evt=NODE_JOINED, node=90532831-88fb-4eb8-adc9-db7a86744869] 17/03/01 04:12:40 INFO GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=6, minorTopVer=0], evt=NODE_JOINED, node=d4a9fe7f-de19-4df7-874c-a084da78562f] 17/03/01 04:12:40 INFO GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=23f61699-e2c9-4ff6-8731-2483934e84c4, addrs=[0, 127.0.0.1], sockAddrs=[hostName/0:47500, /127.0.0.1:47500], discPort=47500, order=14, intOrder=14, lastExchangeTime=1488363160010, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:40 INFO GridDiscoveryManager: Topology snapshot [ver=14, servers=14, clients=0, CPUs=584, heap=230.0GB] 17/03/01 04:12:41 INFO GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=95f164b5-4b73-438f-804f-62854d615b5b, addrs=[9, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/9:47500], discPort=47500, order=15, intOrder=15, lastExchangeTime=1488363160010, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO GridDiscoveryManager: Topology snapshot [ver=15, servers=15, clients=0, CPUs=624, heap=250.0GB] 17/03/01 04:12:41 INFO GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=7, minorTopVer=0], evt=NODE_JOINED, node=5bc51e21-1dcf-498a-b87e-6dd24f7e36ad] 17/03/01 04:12:41 INFO GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=c4f4f6bb-b71a-4a29-9575-afee2ddc1b2d, addrs=[6, 127.0.0.1], sockAddrs=[hostName/6:47500, /127.0.0.1:47500], discPort=47500, order=16, intOrder=16, lastExchangeTime=1488363160010, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO GridDiscoveryManager: Topology snapshot [ver=16, servers=16, clients=0, CPUs=664, heap=260.0GB] 17/03/01 04:12:41 INFO GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=8, minorTopVer=0], evt=NODE_JOINED, node=daed0152-83fc-4828-ada6-64c74787b190] 17/03/01 04:12:41 INFO GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=ddc47224-d030-4d1f-ba66-08f61368a395, addrs=[4, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/4:47500], discPort=47500, order=17, intOrder=17, lastExchangeTime=1488363160020, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO GridDiscoveryManager: Topology snapshot [ver=17, servers=17, clients=0, CPUs=704, heap=280.0GB] 17/03/01 04:12:41 INFO GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=9, minorTopVer=0], evt=NODE_JOINED, node=29716cf1-ed55-4550-82bd-cf980a0aee2c] 17/03/01 04:12:41 INFO GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=47c1a0d8-9d4d-4d0d-9b27-388bd7f49278, addrs=[1, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/1:47500], discPort=47500, order=18, intOrder=18, lastExchangeTime=1488363160020, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO GridDiscoveryManager: Topology snapshot [ver=18, servers=18, clients=0, CPUs=744, heap=290.0GB] 17/03/01 04:12:41 INFO GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=10, minorTopVer=0], evt=NODE_JOINED, node=717de453-fc6b-4a46-91b2-b5c54ab8a4be] 17/03/01 04:12:41 INFO GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=e87f12ce-5981-4418-8468-f6bfed0a0cd8, addrs=[6, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/6:47500], discPort=47500, order=19, intOrder=19, lastExchangeTime=1488363160020, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO GridDiscoveryManager: Topology snapshot [ver=19, servers=19, clients=0, CPUs=784, heap=310.0GB] 17/03/01 04:12:41 INFO GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=11, minorTopVer=0], evt=NODE_JOINED, node=ffe19475-7849-4027-8648-ce56598ff50f] 17/03/01 04:12:41 INFO GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=e2cba212-89dd-48dd-8d7e-821b5725fe03, addrs=[8, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/8:47500], discPort=47500, order=20, intOrder=20, lastExchangeTime=1488363160121, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO GridDiscoveryManager: Topology snapshot [ver=20, servers=20, clients=0, CPUs=816, heap=320.0GB] 17/03/01 04:12:41 INFO GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=12, minorTopVer=0], evt=NODE_JOINED, node=8be1bd05-d62c-4f1a-83f2-91dcb3f3b62a] 17/03/01 04:12:41 INFO GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=13, minorTopVer=0], evt=NODE_JOINED, node=133c388f-3399-4cc8-b2f1-7ae8ba971b03] 17/03/01 04:12:41 INFO GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=f9ce8dd7-2060-4c34-b597-d7bee86ebedb, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=21, intOrder=21, lastExchangeTime=1488363160141, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO GridDiscoveryManager: Topology snapshot [ver=21, servers=21, clients=0, CPUs=856, heap=340.0GB] 17/03/01 04:12:42 INFO GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=14, minorTopVer=0], evt=NODE_JOINED, node=23f61699-e2c9-4ff6-8731-2483934e84c4] 17/03/01 04:12:42 INFO GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=6b1889dd-9de5-4f1b-8ec9-c123c7df8ea2, addrs=[, 127.0.0.1], sockAddrs=[hostName/:47500, /127.0.0.1:47500], discPort=47500, order=22, intOrder=22, lastExchangeTime=1488363160212, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO GridDiscoveryManager: Topology snapshot [ver=22, servers=22, clients=0, CPUs=896, heap=350.0GB] 17/03/01 04:12:42 INFO GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=15, minorTopVer=0], evt=NODE_JOINED, node=95f164b5-4b73-438f-804f-62854d615b5b] 17/03/01 04:12:42 INFO GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=9fb6e583-cea0-4f78-b403-b403a8bc9a0e, addrs=[7, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/7:47500], discPort=47500, order=23, intOrder=23, lastExchangeTime=1488363160212, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO GridDiscoveryManager: Topology snapshot [ver=23, servers=23, clients=0, CPUs=936, heap=370.0GB] 17/03/01 04:12:42 INFO GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=20860cae-2881-4311-a3f5-edaa160ef37f, addrs=[7, 127.0.0.1], sockAddrs=[hostName/7:47500, /127.0.0.1:47500], discPort=47500, order=24, intOrder=24, lastExchangeTime=1488363160222, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO GridDiscoveryManager: Topology snapshot [ver=24, servers=24, clients=0, CPUs=976, heap=380.0GB] 17/03/01 04:12:42 INFO GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=16, minorTopVer=0], evt=NODE_JOINED, node=c4f4f6bb-b71a-4a29-9575-afee2ddc1b2d] 17/03/01 04:12:42 INFO GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=0d675d57-b9b9-4cff-a994-77337d618bbe, addrs=[4, 127.0.0.1], sockAddrs=[hostName/4:47500, /127.0.0.1:47500], discPort=47500, order=25, intOrder=25, lastExchangeTime=1488363160222, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO GridDiscoveryManager: Topology snapshot [ver=25, servers=25, clients=0, CPUs=1016, heap=400.0GB] 17/03/01 04:12:42 INFO GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=17, minorTopVer=0], evt=NODE_JOINED, node=ddc47224-d030-4d1f-ba66-08f61368a395] 17/03/01 04:12:42 INFO GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=a6343860-6e84-4d9c-9b87-84ffd76280cd, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=26, intOrder=26, lastExchangeTime=1488363160222, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO GridDiscoveryManager: Topology snapshot [ver=26, servers=26, clients=0, CPUs=1056, heap=410.0GB] 17/03/01 04:12:42 INFO GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=18, minorTopVer=0], evt=NODE_JOINED, node=47c1a0d8-9d4d-4d0d-9b27-388bd7f49278] 17/03/01 04:12:42 INFO GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=19, minorTopVer=0], evt=NODE_JOINED, node=e87f12ce-5981-4418-8468-f6bfed0a0cd8] 17/03/01 04:12:42 INFO GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=479b18e6-54af-4313-85f7-c7525f6229a4, addrs=[, 127.0.0.1], sockAddrs=[hostName/:47500, /127.0.0.1:47500], discPort=47500, order=27, intOrder=27, lastExchangeTime=1488363160313, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO GridDiscoveryManager: Topology snapshot [ver=27, servers=27, clients=0, CPUs=1104, heap=430.0GB] 17/03/01 04:12:42 INFO GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=20, minorTopVer=0], evt=NODE_JOINED, node=e2cba212-89dd-48dd-8d7e-821b5725fe03] 17/03/01 04:12:43 INFO GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=058a99e8-3b65-4ec9-84b0-6f3502c2afce, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=28, intOrder=28, lastExchangeTime=1488363160605, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO GridDiscoveryManager: Topology snapshot [ver=28, servers=28, clients=0, CPUs=1144, heap=440.0GB] 17/03/01 04:12:43 INFO GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=21, minorTopVer=0], evt=NODE_JOINED, node=f9ce8dd7-2060-4c34-b597-d7bee86ebedb] 17/03/01 04:12:43 INFO GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=57c09d88-a4dc-4179-98b4-1144fd97d8cc, addrs=[35, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/35:47500], discPort=47500, order=29, intOrder=29, lastExchangeTime=1488363160656, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO GridDiscoveryManager: Topology snapshot [ver=29, servers=29, clients=0, CPUs=1192, heap=460.0GB] 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_59_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_59_piece0 on hostName:51773 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_59_piece0 on hostName:43142 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_85_piece0 on ipaddress:43498 in memory (size: 9.5 KB, free: 19.2 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_85_piece0 on hostName:49289 in memory (size: 9.5 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO ContextCleaner: Cleaned accumulator 9 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_84_piece0 on ipaddress:43498 in memory (size: 9.0 KB, free: 19.2 GB) 17/03/01 04:12:43 INFO GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=58298821-7aa9-4b58-ba15-e7f1ef2830fb, addrs=[3, 127.0.0.1], sockAddrs=[hostName/3:47500, /127.0.0.1:47500], discPort=47500, order=30, intOrder=30, lastExchangeTime=1488363160656, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO GridDiscoveryManager: Topology snapshot [ver=30, servers=30, clients=0, CPUs=1232, heap=470.0GB] 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_84_piece0 on hostName:46376 in memory (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_84_piece0 on hostName:43142 in memory (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_84_piece0 on hostName:51773 in memory (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_84_piece0 on hostName:49289 in memory (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_84_piece0 on hostName:38204 in memory (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_84_piece0 on hostName:35569 in memory (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_84_piece0 on hostName:41809 in memory (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_84_piece0 on hostName:50848 in memory (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_84_piece0 on hostName:34517 in memory (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_84_piece0 on hostName:32912 in memory (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_84_piece0 on hostName:45520 in memory (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_84_piece0 on hostName:46180 in memory (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_84_piece0 on hostName:51137 in memory (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_84_piece0 on hostName:60209 in memory (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_84_piece0 on hostName:36400 in memory (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_84_piece0 on hostName:43477 in memory (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_84_piece0 on hostName:49788 in memory (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_84_piece0 on hostName:51382 in memory (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_84_piece0 on hostName:35888 in memory (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_84_piece0 on hostName:56606 in memory (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_84_piece0 on hostName:56727 in memory (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_84_piece0 on hostName:42418 in memory (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_84_piece0 on hostName:56472 in memory (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_84_piece0 on hostName:46027 in memory (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_84_piece0 on hostName:52284 in memory (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_84_piece0 on hostName:48862 in memory (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_84_piece0 on hostName:48144 in memory (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_84_piece0 on hostName:56293 in memory (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_84_piece0 on hostName:33016 in memory (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_84_piece0 on hostName:40903 in memory (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_84_piece0 on hostName:58857 in memory (size: 9.0 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO ContextCleaner: Cleaned accumulator 8 17/03/01 04:12:43 INFO ContextCleaner: Cleaned shuffle 0 17/03/01 04:12:43 INFO ContextCleaner: Cleaned accumulator 7 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_58_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_58_piece0 on hostName:56472 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_57_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_57_piece0 on hostName:45520 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_56_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_56_piece0 on hostName:35888 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_56_piece0 on hostName:45520 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_55_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_55_piece0 on hostName:49289 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_55_piece0 on hostName:40903 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_54_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_54_piece0 on hostName:46180 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_53_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_53_piece0 on hostName:56293 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_52_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_52_piece0 on hostName:56606 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_51_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:43 INFO GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=22, minorTopVer=0], evt=NODE_JOINED, node=6b1889dd-9de5-4f1b-8ec9-c123c7df8ea2] 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_51_piece0 on hostName:34517 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_51_piece0 on hostName:48862 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_50_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_50_piece0 on hostName:45520 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_49_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_49_piece0 on hostName:50848 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_49_piece0 on hostName:32912 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_48_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_48_piece0 on hostName:35569 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4d5de2f3-d975-4b28-b593-0cc0481cdc74, addrs=[03, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/03:47500], discPort=47500, order=31, intOrder=31, lastExchangeTime=1488363160777, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_48_piece0 on hostName:56606 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO GridDiscoveryManager: Topology snapshot [ver=31, servers=31, clients=0, CPUs=1280, heap=490.0GB] 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_47_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_47_piece0 on hostName:45520 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_47_piece0 on hostName:51773 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_46_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_46_piece0 on hostName:52284 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_46_piece0 on hostName:58857 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_45_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_45_piece0 on hostName:48144 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_44_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_44_piece0 on hostName:52284 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_44_piece0 on hostName:46376 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_43_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_79_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_79_piece0 on hostName:51773 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_78_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_78_piece0 on hostName:52284 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_77_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_77_piece0 on hostName:38204 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_76_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_76_piece0 on hostName:56606 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_76_piece0 on hostName:46027 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_75_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_75_piece0 on hostName:52284 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_74_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_74_piece0 on hostName:58857 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_73_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_73_piece0 on hostName:42418 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_73_piece0 on hostName:52284 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_72_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_72_piece0 on hostName:60209 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=fa09caab-f4dc-43b6-ac8b-4a4bae6e7da6, addrs=[01, 127.0.0.1], sockAddrs=[hostName/01:47500, /127.0.0.1:47500], discPort=47500, order=32, intOrder=32, lastExchangeTime=1488363161432, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO GridDiscoveryManager: Topology snapshot [ver=32, servers=32, clients=0, CPUs=1320, heap=500.0GB] 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_71_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_71_piece0 on hostName:33016 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_70_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_70_piece0 on hostName:41809 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_69_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_69_piece0 on hostName:43477 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_68_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_68_piece0 on hostName:49788 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_68_piece0 on hostName:38204 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_67_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_67_piece0 on hostName:56727 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_67_piece0 on hostName:32912 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=23, minorTopVer=0], evt=NODE_JOINED, node=9fb6e583-cea0-4f78-b403-b403a8bc9a0e] 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_66_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_66_piece0 on hostName:51137 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_65_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_65_piece0 on hostName:52284 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_64_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_64_piece0 on hostName:43142 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_64_piece0 on hostName:51382 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_63_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_63_piece0 on hostName:60209 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_62_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_62_piece0 on hostName:51137 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_61_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_61_piece0 on hostName:51137 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_60_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_60_piece0 on hostName:41809 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_60_piece0 on hostName:36400 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO ContextCleaner: Cleaned accumulator 6 17/03/01 04:12:43 INFO ContextCleaner: Cleaned accumulator 5 17/03/01 04:12:43 INFO ContextCleaner: Cleaned accumulator 4 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_83_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_83_piece0 on hostName:50848 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_83_piece0 on hostName:46027 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_82_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_82_piece0 on hostName:38204 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_81_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_81_piece0 on hostName:49788 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_80_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:43 INFO BlockManagerInfo: Removed broadcast_80_piece0 on hostName:45520 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:43 INFO GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=24, minorTopVer=0], evt=NODE_JOINED, node=20860cae-2881-4311-a3f5-edaa160ef37f] 17/03/01 04:12:43 INFO GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=af5837f0-25ec-4f3d-a1c1-90c09dc424cb, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=33, intOrder=33, lastExchangeTime=1488363161563, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO GridDiscoveryManager: Topology snapshot [ver=33, servers=33, clients=0, CPUs=1360, heap=520.0GB] 17/03/01 04:12:44 INFO GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=25, minorTopVer=0], evt=NODE_JOINED, node=0d675d57-b9b9-4cff-a994-77337d618bbe] 17/03/01 04:12:44 INFO GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=e9e49d2d-5eeb-474f-8757-e447efc8ca8f, addrs=[6, 127.0.0.1], sockAddrs=[hostName/6:47500, /127.0.0.1:47500], discPort=47500, order=34, intOrder=34, lastExchangeTime=1488363161573, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO GridDiscoveryManager: Topology snapshot [ver=34, servers=34, clients=0, CPUs=1400, heap=530.0GB] 17/03/01 04:12:44 INFO GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=26, minorTopVer=0], evt=NODE_JOINED, node=a6343860-6e84-4d9c-9b87-84ffd76280cd] 17/03/01 04:12:44 INFO GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4b90e5a3-253a-435b-84ca-6b592610cf0c, addrs=[4, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/4:47500], discPort=47500, order=35, intOrder=35, lastExchangeTime=1488363161573, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO GridDiscoveryManager: Topology snapshot [ver=35, servers=35, clients=0, CPUs=1432, heap=550.0GB] 17/03/01 04:12:44 INFO GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=8fd4eea2-2a45-4563-ae87-1848fd388a98, addrs=[3, 127.0.0.1], sockAddrs=[hostName/3:47500, /127.0.0.1:47500], discPort=47500, order=36, intOrder=36, lastExchangeTime=1488363161573, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO GridDiscoveryManager: Topology snapshot [ver=36, servers=36, clients=0, CPUs=1472, heap=560.0GB] 17/03/01 04:12:44 INFO GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=27, minorTopVer=0], evt=NODE_JOINED, node=479b18e6-54af-4313-85f7-c7525f6229a4] 17/03/01 04:12:44 INFO GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=28, minorTopVer=0], evt=NODE_JOINED, node=058a99e8-3b65-4ec9-84b0-6f3502c2afce] 17/03/01 04:12:44 INFO GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=d7b45a02-0411-4028-acdf-f004e592f294, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=37, intOrder=37, lastExchangeTime=1488363161876, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO GridDiscoveryManager: Topology snapshot [ver=37, servers=37, clients=0, CPUs=1512, heap=580.0GB] 17/03/01 04:12:44 INFO GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=29, minorTopVer=0], evt=NODE_JOINED, node=57c09d88-a4dc-4179-98b4-1144fd97d8cc] 17/03/01 04:12:44 INFO GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=cf4e6e83-207e-42da-a55c-5621bc20b891, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=38, intOrder=38, lastExchangeTime=1488363162632, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO GridDiscoveryManager: Topology snapshot [ver=38, servers=38, clients=0, CPUs=1552, heap=590.0GB] 17/03/01 04:12:45 INFO GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=30, minorTopVer=0], evt=NODE_JOINED, node=58298821-7aa9-4b58-ba15-e7f1ef2830fb] 17/03/01 04:12:45 INFO GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=d8926a2c-2c00-4445-beb4-633c2d656c41, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=39, intOrder=39, lastExchangeTime=1488363162642, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO GridDiscoveryManager: Topology snapshot [ver=39, servers=39, clients=0, CPUs=1584, heap=610.0GB] 17/03/01 04:12:45 INFO GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=31, minorTopVer=0], evt=NODE_JOINED, node=4d5de2f3-d975-4b28-b593-0cc0481cdc74] 17/03/01 04:12:45 INFO GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4136a0c9-14d5-42b3-9a60-81689c800438, addrs=[3, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/3:47500], discPort=47500, order=40, intOrder=40, lastExchangeTime=1488363162864, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO GridDiscoveryManager: Topology snapshot [ver=40, servers=40, clients=0, CPUs=1624, heap=620.0GB] 17/03/01 04:12:45 INFO GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=32, minorTopVer=0], evt=NODE_JOINED, node=fa09caab-f4dc-43b6-ac8b-4a4bae6e7da6] 17/03/01 04:12:45 INFO GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=694a80b8-02a3-44c9-a2dd-45bed7d20a50, addrs=[1, 127.0.0.1], sockAddrs=[hostName/1:47500, /127.0.0.1:47500], discPort=47500, order=41, intOrder=41, lastExchangeTime=1488363162875, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO GridDiscoveryManager: Topology snapshot [ver=41, servers=41, clients=0, CPUs=1664, heap=640.0GB] 17/03/01 04:12:45 INFO GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=33, minorTopVer=0], evt=NODE_JOINED, node=af5837f0-25ec-4f3d-a1c1-90c09dc424cb] 17/03/01 04:12:45 INFO GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=34, minorTopVer=0], evt=NODE_JOINED, node=e9e49d2d-5eeb-474f-8757-e447efc8ca8f] 17/03/01 04:12:46 INFO GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=35, minorTopVer=0], evt=NODE_JOINED, node=4b90e5a3-253a-435b-84ca-6b592610cf0c] 17/03/01 04:12:46 INFO GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=36, minorTopVer=0], evt=NODE_JOINED, node=8fd4eea2-2a45-4563-ae87-1848fd388a98] 17/03/01 04:12:46 INFO GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=37, minorTopVer=0], evt=NODE_JOINED, node=d7b45a02-0411-4028-acdf-f004e592f294] 17/03/01 04:12:46 INFO GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=38, minorTopVer=0], evt=NODE_JOINED, node=cf4e6e83-207e-42da-a55c-5621bc20b891] 17/03/01 04:12:46 INFO GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=39, minorTopVer=0], evt=NODE_JOINED, node=d8926a2c-2c00-4445-beb4-633c2d656c41] 17/03/01 04:12:47 INFO GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=40, minorTopVer=0], evt=NODE_JOINED, node=4136a0c9-14d5-42b3-9a60-81689c800438] 17/03/01 04:12:47 INFO GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=41, minorTopVer=0], evt=NODE_JOINED, node=694a80b8-02a3-44c9-a2dd-45bed7d20a50] 17/03/01 04:12:47 INFO TaskSetManager: Finished task 25.0 in stage 4.0 (TID 147) in 9111 ms on hostName (1/40) 17/03/01 04:12:47 INFO TaskSetManager: Finished task 22.0 in stage 4.0 (TID 144) in 9113 ms on hostName (2/40) 17/03/01 04:12:47 INFO TaskSetManager: Finished task 4.0 in stage 4.0 (TID 126) in 9116 ms on hostName (3/40) 17/03/01 04:12:47 INFO TaskSetManager: Finished task 26.0 in stage 4.0 (TID 148) in 9114 ms on hostName (4/40) 17/03/01 04:12:47 INFO TaskSetManager: Finished task 24.0 in stage 4.0 (TID 146) in 9116 ms on hostName (5/40) 17/03/01 04:12:47 INFO TaskSetManager: Finished task 34.0 in stage 4.0 (TID 156) in 9118 ms on hostName (6/40) 17/03/01 04:12:47 INFO TaskSetManager: Finished task 37.0 in stage 4.0 (TID 159) in 9117 ms on hostName (7/40) 17/03/01 04:12:47 INFO TaskSetManager: Finished task 2.0 in stage 4.0 (TID 124) in 9121 ms on hostName (8/40) 17/03/01 04:12:47 INFO TaskSetManager: Finished task 28.0 in stage 4.0 (TID 150) in 9120 ms on hostName (9/40) 17/03/01 04:12:47 INFO TaskSetManager: Finished task 38.0 in stage 4.0 (TID 160) in 9120 ms on hostName (10/40) 17/03/01 04:12:47 INFO TaskSetManager: Finished task 5.0 in stage 4.0 (TID 127) in 9124 ms on hostName (11/40) 17/03/01 04:12:47 INFO TaskSetManager: Finished task 16.0 in stage 4.0 (TID 138) in 9124 ms on hostName (12/40) 17/03/01 04:12:47 INFO TaskSetManager: Finished task 13.0 in stage 4.0 (TID 135) in 9124 ms on hostName (13/40) 17/03/01 04:12:47 INFO TaskSetManager: Finished task 14.0 in stage 4.0 (TID 136) in 9124 ms on hostName (14/40) 17/03/01 04:12:47 INFO TaskSetManager: Finished task 1.0 in stage 4.0 (TID 123) in 9126 ms on hostName (15/40) 17/03/01 04:12:47 INFO TaskSetManager: Finished task 35.0 in stage 4.0 (TID 157) in 9124 ms on hostName (16/40) 17/03/01 04:12:47 INFO TaskSetManager: Finished task 12.0 in stage 4.0 (TID 134) in 9128 ms on hostName (17/40) 17/03/01 04:12:47 INFO TaskSetManager: Finished task 39.0 in stage 4.0 (TID 161) in 9125 ms on hostName (18/40) 17/03/01 04:12:47 INFO TaskSetManager: Finished task 33.0 in stage 4.0 (TID 155) in 9126 ms on hostName (19/40) 17/03/01 04:12:47 INFO TaskSetManager: Finished task 8.0 in stage 4.0 (TID 130) in 9128 ms on hostName (20/40) 17/03/01 04:12:47 INFO TaskSetManager: Finished task 9.0 in stage 4.0 (TID 131) in 9129 ms on hostName (21/40) 17/03/01 04:12:47 INFO TaskSetManager: Finished task 15.0 in stage 4.0 (TID 137) in 9128 ms on hostName (22/40) 17/03/01 04:12:47 INFO TaskSetManager: Finished task 31.0 in stage 4.0 (TID 153) in 9128 ms on hostName (23/40) 17/03/01 04:12:47 INFO TaskSetManager: Finished task 18.0 in stage 4.0 (TID 140) in 9129 ms on hostName (24/40) 17/03/01 04:12:47 INFO TaskSetManager: Finished task 17.0 in stage 4.0 (TID 139) in 9129 ms on hostName (25/40) 17/03/01 04:12:47 INFO TaskSetManager: Finished task 0.0 in stage 4.0 (TID 122) in 9133 ms on hostName (26/40) 17/03/01 04:12:47 INFO TaskSetManager: Finished task 7.0 in stage 4.0 (TID 129) in 9131 ms on hostName (27/40) 17/03/01 04:12:47 INFO TaskSetManager: Finished task 21.0 in stage 4.0 (TID 143) in 9129 ms on hostName (28/40) 17/03/01 04:12:47 INFO TaskSetManager: Finished task 6.0 in stage 4.0 (TID 128) in 9131 ms on hostName (29/40) 17/03/01 04:12:47 INFO TaskSetManager: Finished task 32.0 in stage 4.0 (TID 154) in 9129 ms on hostName (30/40) 17/03/01 04:12:47 INFO TaskSetManager: Finished task 19.0 in stage 4.0 (TID 141) in 9131 ms on hostName (31/40) 17/03/01 04:12:47 INFO TaskSetManager: Finished task 10.0 in stage 4.0 (TID 132) in 9133 ms on hostName (32/40) 17/03/01 04:12:47 INFO TaskSetManager: Finished task 20.0 in stage 4.0 (TID 142) in 9133 ms on hostName (33/40) 17/03/01 04:12:47 INFO TaskSetManager: Finished task 36.0 in stage 4.0 (TID 158) in 9132 ms on hostName (34/40) 17/03/01 04:12:47 INFO TaskSetManager: Finished task 29.0 in stage 4.0 (TID 151) in 9133 ms on hostName (35/40) 17/03/01 04:12:47 INFO TaskSetManager: Finished task 27.0 in stage 4.0 (TID 149) in 9136 ms on hostName (36/40) 17/03/01 04:12:47 INFO TaskSetManager: Finished task 11.0 in stage 4.0 (TID 133) in 9155 ms on hostName (37/40) 17/03/01 04:12:47 INFO TaskSetManager: Finished task 23.0 in stage 4.0 (TID 145) in 9153 ms on hostName (38/40) 17/03/01 04:12:47 INFO TaskSetManager: Finished task 3.0 in stage 4.0 (TID 125) in 9195 ms on hostName (39/40) 17/03/01 04:12:47 INFO TaskSetManager: Finished task 30.0 in stage 4.0 (TID 152) in 9327 ms on hostName (40/40) 17/03/01 04:12:47 INFO YarnClusterScheduler: Removed TaskSet 4.0, whose tasks have all completed, from pool 17/03/01 04:12:47 INFO DAGScheduler: ResultStage 4 (foreachPartition at CompanyResolverSparkTest.scala:152) finished in 9.334 s 17/03/01 04:12:47 INFO DAGScheduler: Job 3 finished: foreachPartition at CompanyResolverSparkTest.scala:152, took 9.337795 s 17/03/01 04:12:47 INFO MemoryStore: ensureFreeSpace(382192) called with curMem=15192144, maxMem=20615905935 17/03/01 04:12:47 INFO MemoryStore: Block broadcast_87 stored as values in memory (estimated size 373.2 KB, free 19.2 GB) 17/03/01 04:12:47 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=15574336, maxMem=20615905935 17/03/01 04:12:47 INFO MemoryStore: Block broadcast_87_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:47 INFO BlockManagerInfo: Added broadcast_87_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:47 INFO SparkContext: Created broadcast 87 from map at CompanyResolverSparkTest.scala:213 17/03/01 04:12:47 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=15598979, maxMem=20615905935 17/03/01 04:12:47 INFO MemoryStore: Block broadcast_88 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:47 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=15953835, maxMem=20615905935 17/03/01 04:12:47 INFO MemoryStore: Block broadcast_88_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:47 INFO BlockManagerInfo: Added broadcast_88_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:47 INFO SparkContext: Created broadcast 88 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:47 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=15978478, maxMem=20615905935 17/03/01 04:12:47 INFO MemoryStore: Block broadcast_89 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:47 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=16333334, maxMem=20615905935 17/03/01 04:12:47 INFO MemoryStore: Block broadcast_89_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:47 INFO BlockManagerInfo: Added broadcast_89_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:47 INFO SparkContext: Created broadcast 89 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:47 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=16357977, maxMem=20615905935 17/03/01 04:12:47 INFO MemoryStore: Block broadcast_90 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:47 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=16712833, maxMem=20615905935 17/03/01 04:12:47 INFO MemoryStore: Block broadcast_90_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:47 INFO BlockManagerInfo: Added broadcast_90_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:47 INFO SparkContext: Created broadcast 90 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:47 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=16737476, maxMem=20615905935 17/03/01 04:12:47 INFO MemoryStore: Block broadcast_91 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:47 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=17092332, maxMem=20615905935 17/03/01 04:12:47 INFO MemoryStore: Block broadcast_91_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:47 INFO BlockManagerInfo: Added broadcast_91_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:47 INFO SparkContext: Created broadcast 91 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:47 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=17116975, maxMem=20615905935 17/03/01 04:12:47 INFO MemoryStore: Block broadcast_92 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:47 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=17471831, maxMem=20615905935 17/03/01 04:12:47 INFO MemoryStore: Block broadcast_92_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:47 INFO BlockManagerInfo: Added broadcast_92_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:47 INFO SparkContext: Created broadcast 92 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:47 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=17496474, maxMem=20615905935 17/03/01 04:12:47 INFO MemoryStore: Block broadcast_93 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:47 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=17851330, maxMem=20615905935 17/03/01 04:12:47 INFO MemoryStore: Block broadcast_93_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:47 INFO BlockManagerInfo: Added broadcast_93_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:47 INFO SparkContext: Created broadcast 93 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:47 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=17875973, maxMem=20615905935 17/03/01 04:12:47 INFO MemoryStore: Block broadcast_94 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:47 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=18230829, maxMem=20615905935 17/03/01 04:12:47 INFO MemoryStore: Block broadcast_94_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:47 INFO BlockManagerInfo: Added broadcast_94_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:47 INFO SparkContext: Created broadcast 94 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:47 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=18255472, maxMem=20615905935 17/03/01 04:12:47 INFO MemoryStore: Block broadcast_95 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:47 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=18610328, maxMem=20615905935 17/03/01 04:12:47 INFO MemoryStore: Block broadcast_95_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:47 INFO BlockManagerInfo: Added broadcast_95_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:47 INFO SparkContext: Created broadcast 95 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:47 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=18634971, maxMem=20615905935 17/03/01 04:12:47 INFO MemoryStore: Block broadcast_96 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:47 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=18989827, maxMem=20615905935 17/03/01 04:12:47 INFO MemoryStore: Block broadcast_96_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:47 INFO BlockManagerInfo: Added broadcast_96_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:47 INFO SparkContext: Created broadcast 96 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:47 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=19014470, maxMem=20615905935 17/03/01 04:12:47 INFO MemoryStore: Block broadcast_97 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:47 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=19369326, maxMem=20615905935 17/03/01 04:12:47 INFO MemoryStore: Block broadcast_97_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:47 INFO BlockManagerInfo: Added broadcast_97_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:47 INFO SparkContext: Created broadcast 97 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:47 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=19393969, maxMem=20615905935 17/03/01 04:12:47 INFO MemoryStore: Block broadcast_98 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:47 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=19748825, maxMem=20615905935 17/03/01 04:12:47 INFO MemoryStore: Block broadcast_98_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:47 INFO BlockManagerInfo: Added broadcast_98_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:47 INFO SparkContext: Created broadcast 98 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:47 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=19773468, maxMem=20615905935 17/03/01 04:12:47 INFO MemoryStore: Block broadcast_99 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:47 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=20128324, maxMem=20615905935 17/03/01 04:12:47 INFO MemoryStore: Block broadcast_99_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:47 INFO BlockManagerInfo: Added broadcast_99_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:47 INFO SparkContext: Created broadcast 99 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:47 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=20152967, maxMem=20615905935 17/03/01 04:12:47 INFO MemoryStore: Block broadcast_100 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:47 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=20507823, maxMem=20615905935 17/03/01 04:12:47 INFO MemoryStore: Block broadcast_100_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:47 INFO BlockManagerInfo: Added broadcast_100_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:47 INFO SparkContext: Created broadcast 100 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:47 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=20532466, maxMem=20615905935 17/03/01 04:12:47 INFO MemoryStore: Block broadcast_101 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:47 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=20887322, maxMem=20615905935 17/03/01 04:12:47 INFO MemoryStore: Block broadcast_101_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:47 INFO BlockManagerInfo: Added broadcast_101_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:47 INFO SparkContext: Created broadcast 101 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:47 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=20911965, maxMem=20615905935 17/03/01 04:12:47 INFO MemoryStore: Block broadcast_102 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:47 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=21266821, maxMem=20615905935 17/03/01 04:12:47 INFO MemoryStore: Block broadcast_102_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:47 INFO BlockManagerInfo: Added broadcast_102_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:47 INFO SparkContext: Created broadcast 102 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:47 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=21291464, maxMem=20615905935 17/03/01 04:12:47 INFO MemoryStore: Block broadcast_103 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:47 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=21646320, maxMem=20615905935 17/03/01 04:12:47 INFO MemoryStore: Block broadcast_103_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:47 INFO BlockManagerInfo: Added broadcast_103_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:47 INFO SparkContext: Created broadcast 103 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:47 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=21670963, maxMem=20615905935 17/03/01 04:12:47 INFO MemoryStore: Block broadcast_104 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:47 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=22025819, maxMem=20615905935 17/03/01 04:12:47 INFO MemoryStore: Block broadcast_104_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:47 INFO BlockManagerInfo: Added broadcast_104_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:47 INFO SparkContext: Created broadcast 104 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:47 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=22050462, maxMem=20615905935 17/03/01 04:12:47 INFO MemoryStore: Block broadcast_105 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:47 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=22405318, maxMem=20615905935 17/03/01 04:12:47 INFO MemoryStore: Block broadcast_105_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:47 INFO BlockManagerInfo: Added broadcast_105_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:47 INFO SparkContext: Created broadcast 105 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:47 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=22429961, maxMem=20615905935 17/03/01 04:12:47 INFO MemoryStore: Block broadcast_106 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:47 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=22784817, maxMem=20615905935 17/03/01 04:12:47 INFO MemoryStore: Block broadcast_106_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:47 INFO BlockManagerInfo: Added broadcast_106_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:47 INFO SparkContext: Created broadcast 106 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:47 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=22809460, maxMem=20615905935 17/03/01 04:12:47 INFO MemoryStore: Block broadcast_107 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:47 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=23164316, maxMem=20615905935 17/03/01 04:12:47 INFO MemoryStore: Block broadcast_107_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:47 INFO BlockManagerInfo: Added broadcast_107_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:47 INFO SparkContext: Created broadcast 107 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:47 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=23188959, maxMem=20615905935 17/03/01 04:12:47 INFO MemoryStore: Block broadcast_108 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:47 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=23543815, maxMem=20615905935 17/03/01 04:12:47 INFO MemoryStore: Block broadcast_108_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:47 INFO BlockManagerInfo: Added broadcast_108_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:47 INFO SparkContext: Created broadcast 108 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:47 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=23568458, maxMem=20615905935 17/03/01 04:12:47 INFO MemoryStore: Block broadcast_109 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:47 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=23923314, maxMem=20615905935 17/03/01 04:12:47 INFO MemoryStore: Block broadcast_109_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:47 INFO BlockManagerInfo: Added broadcast_109_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:47 INFO SparkContext: Created broadcast 109 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:47 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=23947957, maxMem=20615905935 17/03/01 04:12:47 INFO MemoryStore: Block broadcast_110 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:48 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=24302813, maxMem=20615905935 17/03/01 04:12:48 INFO MemoryStore: Block broadcast_110_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:48 INFO BlockManagerInfo: Added broadcast_110_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:48 INFO SparkContext: Created broadcast 110 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:48 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=24327456, maxMem=20615905935 17/03/01 04:12:48 INFO MemoryStore: Block broadcast_111 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:48 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=24682312, maxMem=20615905935 17/03/01 04:12:48 INFO MemoryStore: Block broadcast_111_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:48 INFO BlockManagerInfo: Added broadcast_111_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:48 INFO SparkContext: Created broadcast 111 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:48 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=24706955, maxMem=20615905935 17/03/01 04:12:48 INFO MemoryStore: Block broadcast_112 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:48 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=25061811, maxMem=20615905935 17/03/01 04:12:48 INFO MemoryStore: Block broadcast_112_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:48 INFO BlockManagerInfo: Added broadcast_112_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:48 INFO SparkContext: Created broadcast 112 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:48 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=25086454, maxMem=20615905935 17/03/01 04:12:48 INFO MemoryStore: Block broadcast_113 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:48 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=25441310, maxMem=20615905935 17/03/01 04:12:48 INFO MemoryStore: Block broadcast_113_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:48 INFO BlockManagerInfo: Added broadcast_113_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:48 INFO SparkContext: Created broadcast 113 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:48 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=25465953, maxMem=20615905935 17/03/01 04:12:48 INFO MemoryStore: Block broadcast_114 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:48 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=25820809, maxMem=20615905935 17/03/01 04:12:48 INFO MemoryStore: Block broadcast_114_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:48 INFO BlockManagerInfo: Added broadcast_114_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:48 INFO SparkContext: Created broadcast 114 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:48 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=25845452, maxMem=20615905935 17/03/01 04:12:48 INFO MemoryStore: Block broadcast_115 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:48 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=26200308, maxMem=20615905935 17/03/01 04:12:48 INFO MemoryStore: Block broadcast_115_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:48 INFO BlockManagerInfo: Added broadcast_115_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:48 INFO SparkContext: Created broadcast 115 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:48 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=26224951, maxMem=20615905935 17/03/01 04:12:48 INFO MemoryStore: Block broadcast_116 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:48 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=26579807, maxMem=20615905935 17/03/01 04:12:48 INFO MemoryStore: Block broadcast_116_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:48 INFO BlockManagerInfo: Added broadcast_116_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:48 INFO SparkContext: Created broadcast 116 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:48 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=26604450, maxMem=20615905935 17/03/01 04:12:48 INFO MemoryStore: Block broadcast_117 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:48 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=26959306, maxMem=20615905935 17/03/01 04:12:48 INFO MemoryStore: Block broadcast_117_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:48 INFO BlockManagerInfo: Added broadcast_117_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:48 INFO SparkContext: Created broadcast 117 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:48 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=26983949, maxMem=20615905935 17/03/01 04:12:48 INFO MemoryStore: Block broadcast_118 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:48 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=27338805, maxMem=20615905935 17/03/01 04:12:48 INFO MemoryStore: Block broadcast_118_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:48 INFO BlockManagerInfo: Added broadcast_118_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:48 INFO SparkContext: Created broadcast 118 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:48 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=27363448, maxMem=20615905935 17/03/01 04:12:48 INFO MemoryStore: Block broadcast_119 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:48 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=27718304, maxMem=20615905935 17/03/01 04:12:48 INFO MemoryStore: Block broadcast_119_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:48 INFO BlockManagerInfo: Added broadcast_119_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:48 INFO SparkContext: Created broadcast 119 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:48 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=27742947, maxMem=20615905935 17/03/01 04:12:48 INFO MemoryStore: Block broadcast_120 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:48 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=28097803, maxMem=20615905935 17/03/01 04:12:48 INFO MemoryStore: Block broadcast_120_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:48 INFO BlockManagerInfo: Added broadcast_120_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:48 INFO SparkContext: Created broadcast 120 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:48 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=28122446, maxMem=20615905935 17/03/01 04:12:48 INFO MemoryStore: Block broadcast_121 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:48 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=28477302, maxMem=20615905935 17/03/01 04:12:48 INFO MemoryStore: Block broadcast_121_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:48 INFO BlockManagerInfo: Added broadcast_121_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:48 INFO SparkContext: Created broadcast 121 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:48 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=28501945, maxMem=20615905935 17/03/01 04:12:48 INFO MemoryStore: Block broadcast_122 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:48 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=28856801, maxMem=20615905935 17/03/01 04:12:48 INFO MemoryStore: Block broadcast_122_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:48 INFO BlockManagerInfo: Added broadcast_122_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:48 INFO SparkContext: Created broadcast 122 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:48 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=28881444, maxMem=20615905935 17/03/01 04:12:48 INFO MemoryStore: Block broadcast_123 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:48 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=29236300, maxMem=20615905935 17/03/01 04:12:48 INFO MemoryStore: Block broadcast_123_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:48 INFO BlockManagerInfo: Added broadcast_123_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:48 INFO SparkContext: Created broadcast 123 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:48 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=29260943, maxMem=20615905935 17/03/01 04:12:48 INFO MemoryStore: Block broadcast_124 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:48 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=29615799, maxMem=20615905935 17/03/01 04:12:48 INFO MemoryStore: Block broadcast_124_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:48 INFO BlockManagerInfo: Added broadcast_124_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:48 INFO SparkContext: Created broadcast 124 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:48 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=29640442, maxMem=20615905935 17/03/01 04:12:48 INFO MemoryStore: Block broadcast_125 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:48 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=29995298, maxMem=20615905935 17/03/01 04:12:48 INFO MemoryStore: Block broadcast_125_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:48 INFO BlockManagerInfo: Added broadcast_125_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:48 INFO SparkContext: Created broadcast 125 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:48 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=30019941, maxMem=20615905935 17/03/01 04:12:48 INFO MemoryStore: Block broadcast_126 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:48 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=30374797, maxMem=20615905935 17/03/01 04:12:48 INFO MemoryStore: Block broadcast_126_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:48 INFO BlockManagerInfo: Added broadcast_126_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:48 INFO SparkContext: Created broadcast 126 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:48 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=30399440, maxMem=20615905935 17/03/01 04:12:48 INFO MemoryStore: Block broadcast_127 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:12:48 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=30754296, maxMem=20615905935 17/03/01 04:12:48 INFO MemoryStore: Block broadcast_127_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:12:48 INFO BlockManagerInfo: Added broadcast_127_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:48 INFO SparkContext: Created broadcast 127 from hadoopFile at AvroRelation.scala:121 17/03/01 04:12:48 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /E01_S012_AJ018/01:1004 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AK067/3:1004 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AK067/5:1004 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AH079/2:1004 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AH079/5:1004 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /ELL_MFRM_U_034/77:1004 17/03/01 04:12:48 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:48 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:48 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /ELL_MFRM_T_021/06:1004 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /ELL_MFRM_S_021/95:1004 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AI067/81:1004 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AI067/77:1004 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /E01_S012_AO016/5:1004 17/03/01 04:12:48 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:48 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:48 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:48 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:48 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AA029/:1004 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AA029/2:1004 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /ELL_MFRM_Z_029/5:1004 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /ELL_MFRM_P_046/39:1004 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /ELL_MFRM_P_046/37:1004 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /E01_S012_AO021/4:1004 17/03/01 04:12:48 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:48 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:48 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:48 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AI067/08:1004 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /ELL_MFRM_Z_029/5:1004 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /ELL_MFRM_Z_029/5:1004 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /E01_S012_AO020/5:1004 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /E01_S012_AO020/7:1004 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AK067/5:1004 17/03/01 04:12:48 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:48 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /ELL_MFRM_Y_029/9:1004 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AA029/8:1004 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AA029/9:1004 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /E01_S012_AO019/:1004 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /E01_S012_AO019/8:1004 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /E01_S012_AO021/:1004 17/03/01 04:12:48 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:48 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:48 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:48 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:48 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:48 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:48 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:48 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:48 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AA029/8:1004 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AA029/9:1004 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /E01_S012_AO017/7:1004 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /ELL_ALCOVE_CL093/7:1004 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AK076/62:1004 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AK076/58:1004 17/03/01 04:12:48 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AK076/69:1004 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AK076/62:1004 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AE026/71:1004 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /E01_S012_AO020/:1004 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AI067/79:1004 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AI067/06:1004 17/03/01 04:12:48 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:48 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:48 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:48 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:48 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:48 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:48 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /ELL_MFRM_Y_029/:1004 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AJ067/8:1004 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /ELL_MFRM_Y_029/:1004 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /E01_S012_AO019/6:1004 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /ELL_MFRM_Y_029/4:1004 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /E01_S012_AO019/2:1004 17/03/01 04:12:48 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AJ067/4:1004 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AF079/0:1004 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AJ067/2:1004 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AA029/3:1004 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /ELL_MFRM_S_021/07:1004 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AA029/8:1004 17/03/01 04:12:48 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AF079/3:1004 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AK076/62:1004 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AF079/0:1004 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AK067/:1004 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /ELL_MFRM_T_021/98:1004 17/03/01 04:12:48 INFO NetworkTopology: Adding a new node: /ELL_MFRM_AK067/5:1004 17/03/01 04:12:48 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:48 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:48 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:48 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:48 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:48 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:12:48 INFO SparkContext: Starting job: count at CompanyResolverSparkTest.scala:259 17/03/01 04:12:48 INFO DAGScheduler: Got job 4 (count at CompanyResolverSparkTest.scala:259) with 80 output partitions 17/03/01 04:12:48 INFO DAGScheduler: Final stage: ResultStage 5(count at CompanyResolverSparkTest.scala:259) 17/03/01 04:12:48 INFO DAGScheduler: Parents of final stage: List() 17/03/01 04:12:48 INFO DAGScheduler: Missing parents: List() 17/03/01 04:12:48 INFO DAGScheduler: Submitting ResultStage 5 (MapPartitionsRDD[497] at mapPartitions at CompanyResolverSparkTest.scala:224), which has no missing parents 17/03/01 04:12:48 INFO MemoryStore: ensureFreeSpace(28184) called with curMem=30778939, maxMem=20615905935 17/03/01 04:12:48 INFO MemoryStore: Block broadcast_128 stored as values in memory (estimated size 27.5 KB, free 19.2 GB) 17/03/01 04:12:48 INFO MemoryStore: ensureFreeSpace(7311) called with curMem=30807123, maxMem=20615905935 17/03/01 04:12:48 INFO MemoryStore: Block broadcast_128_piece0 stored as bytes in memory (estimated size 7.1 KB, free 19.2 GB) 17/03/01 04:12:48 INFO BlockManagerInfo: Added broadcast_128_piece0 in memory on ipaddress:43498 (size: 7.1 KB, free: 19.2 GB) 17/03/01 04:12:48 INFO SparkContext: Created broadcast 128 from broadcast at DAGScheduler.scala:861 17/03/01 04:12:48 INFO DAGScheduler: Submitting 80 missing tasks from ResultStage 5 (MapPartitionsRDD[497] at mapPartitions at CompanyResolverSparkTest.scala:224) 17/03/01 04:12:48 INFO YarnClusterScheduler: Adding task set 5.0 with 80 tasks 17/03/01 04:12:48 INFO TaskSetManager: Starting task 54.0 in stage 5.0 (TID 162, hostName, partition 54,NODE_LOCAL, 2329 bytes) 17/03/01 04:12:48 INFO TaskSetManager: Starting task 28.0 in stage 5.0 (TID 163, hostName, partition 28,NODE_LOCAL, 2329 bytes) 17/03/01 04:12:48 INFO TaskSetManager: Starting task 58.0 in stage 5.0 (TID 164, hostName, partition 58,NODE_LOCAL, 2329 bytes) 17/03/01 04:12:48 INFO TaskSetManager: Starting task 50.0 in stage 5.0 (TID 165, hostName, partition 50,NODE_LOCAL, 2329 bytes) 17/03/01 04:12:48 INFO TaskSetManager: Starting task 14.0 in stage 5.0 (TID 166, hostName, partition 14,NODE_LOCAL, 2329 bytes) 17/03/01 04:12:48 INFO TaskSetManager: Starting task 74.0 in stage 5.0 (TID 167, hostName, partition 74,NODE_LOCAL, 2329 bytes) 17/03/01 04:12:48 INFO TaskSetManager: Starting task 40.0 in stage 5.0 (TID 168, hostName, partition 40,NODE_LOCAL, 2329 bytes) 17/03/01 04:12:48 INFO TaskSetManager: Starting task 12.0 in stage 5.0 (TID 169, hostName, partition 12,NODE_LOCAL, 2329 bytes) 17/03/01 04:12:48 INFO TaskSetManager: Starting task 52.0 in stage 5.0 (TID 170, hostName, partition 52,NODE_LOCAL, 2329 bytes) 17/03/01 04:12:48 INFO TaskSetManager: Starting task 15.0 in stage 5.0 (TID 171, hostName, partition 15,NODE_LOCAL, 2329 bytes) 17/03/01 04:12:48 INFO TaskSetManager: Starting task 0.0 in stage 5.0 (TID 172, hostName, partition 0,NODE_LOCAL, 2329 bytes) 17/03/01 04:12:48 INFO TaskSetManager: Starting task 48.0 in stage 5.0 (TID 173, hostName, partition 48,NODE_LOCAL, 2329 bytes) 17/03/01 04:12:48 INFO TaskSetManager: Starting task 16.0 in stage 5.0 (TID 174, hostName, partition 16,NODE_LOCAL, 2329 bytes) 17/03/01 04:12:48 INFO TaskSetManager: Starting task 59.0 in stage 5.0 (TID 175, hostName, partition 59,NODE_LOCAL, 2329 bytes) 17/03/01 04:12:48 INFO TaskSetManager: Starting task 46.0 in stage 5.0 (TID 176, hostName, partition 46,NODE_LOCAL, 2329 bytes) 17/03/01 04:12:48 INFO TaskSetManager: Starting task 41.0 in stage 5.0 (TID 177, hostName, partition 41,NODE_LOCAL, 2329 bytes) 17/03/01 04:12:48 INFO TaskSetManager: Starting task 18.0 in stage 5.0 (TID 178, hostName, partition 18,NODE_LOCAL, 2329 bytes) 17/03/01 04:12:48 INFO TaskSetManager: Starting task 2.0 in stage 5.0 (TID 179, hostName, partition 2,NODE_LOCAL, 2329 bytes) 17/03/01 04:12:49 INFO BlockManagerInfo: Added broadcast_128_piece0 in memory on hostName:52284 (size: 7.1 KB, free: 7.8 GB) 17/03/01 04:12:49 INFO BlockManagerInfo: Added broadcast_128_piece0 in memory on hostName:33016 (size: 7.1 KB, free: 7.8 GB) 17/03/01 04:12:49 INFO BlockManagerInfo: Added broadcast_128_piece0 in memory on hostName:56606 (size: 7.1 KB, free: 7.8 GB) 17/03/01 04:12:49 INFO BlockManagerInfo: Added broadcast_128_piece0 in memory on hostName:43477 (size: 7.1 KB, free: 7.8 GB) 17/03/01 04:12:49 INFO BlockManagerInfo: Added broadcast_128_piece0 in memory on hostName:48862 (size: 7.1 KB, free: 7.8 GB) 17/03/01 04:12:49 INFO BlockManagerInfo: Added broadcast_128_piece0 in memory on hostName:43142 (size: 7.1 KB, free: 7.8 GB) 17/03/01 04:12:49 INFO BlockManagerInfo: Added broadcast_128_piece0 in memory on hostName:34517 (size: 7.1 KB, free: 7.8 GB) 17/03/01 04:12:49 INFO BlockManagerInfo: Added broadcast_128_piece0 in memory on hostName:38204 (size: 7.1 KB, free: 7.8 GB) 17/03/01 04:12:49 INFO BlockManagerInfo: Added broadcast_128_piece0 in memory on hostName:45520 (size: 7.1 KB, free: 7.8 GB) 17/03/01 04:12:49 INFO BlockManagerInfo: Added broadcast_128_piece0 in memory on hostName:49788 (size: 7.1 KB, free: 7.8 GB) 17/03/01 04:12:49 INFO BlockManagerInfo: Added broadcast_128_piece0 in memory on hostName:42418 (size: 7.1 KB, free: 7.8 GB) 17/03/01 04:12:49 INFO BlockManagerInfo: Added broadcast_128_piece0 in memory on hostName:46376 (size: 7.1 KB, free: 7.8 GB) 17/03/01 04:12:49 INFO BlockManagerInfo: Added broadcast_128_piece0 in memory on hostName:56727 (size: 7.1 KB, free: 7.8 GB) 17/03/01 04:12:49 INFO BlockManagerInfo: Added broadcast_128_piece0 in memory on hostName:41809 (size: 7.1 KB, free: 7.8 GB) 17/03/01 04:12:49 INFO BlockManagerInfo: Added broadcast_128_piece0 in memory on hostName:48144 (size: 7.1 KB, free: 7.8 GB) 17/03/01 04:12:49 INFO BlockManagerInfo: Added broadcast_128_piece0 in memory on hostName:56293 (size: 7.1 KB, free: 7.8 GB) 17/03/01 04:12:49 INFO BlockManagerInfo: Added broadcast_128_piece0 in memory on hostName:51382 (size: 7.1 KB, free: 7.8 GB) 17/03/01 04:12:49 INFO BlockManagerInfo: Added broadcast_88_piece0 in memory on hostName:46376 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:49 INFO BlockManagerInfo: Added broadcast_112_piece0 in memory on hostName:38204 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:49 INFO BlockManagerInfo: Added broadcast_128_piece0 in memory on hostName:56472 (size: 7.1 KB, free: 7.8 GB) 17/03/01 04:12:49 INFO BlockManagerInfo: Added broadcast_125_piece0 in memory on hostName:49788 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:49 INFO BlockManagerInfo: Added broadcast_111_piece0 in memory on hostName:56727 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:49 INFO BlockManagerInfo: Added broadcast_96_piece0 in memory on hostName:56606 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:49 INFO BlockManagerInfo: Added broadcast_114_piece0 in memory on hostName:41809 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:49 INFO BlockManagerInfo: Added broadcast_95_piece0 in memory on hostName:48862 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:49 INFO BlockManagerInfo: Added broadcast_117_piece0 in memory on hostName:52284 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:49 INFO BlockManagerInfo: Added broadcast_108_piece0 in memory on hostName:43142 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:49 INFO BlockManagerInfo: Added broadcast_115_piece0 in memory on hostName:33016 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:49 INFO BlockManagerInfo: Added broadcast_117_piece0 in memory on hostName:42418 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:49 INFO BlockManagerInfo: Added broadcast_95_piece0 in memory on hostName:34517 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:49 INFO BlockManagerInfo: Added broadcast_89_piece0 in memory on hostName:48144 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:49 INFO BlockManagerInfo: Added broadcast_94_piece0 in memory on hostName:45520 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:49 INFO BlockManagerInfo: Added broadcast_113_piece0 in memory on hostName:43477 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:49 INFO BlockManagerInfo: Added broadcast_97_piece0 in memory on hostName:56293 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:49 INFO BlockManagerInfo: Added broadcast_108_piece0 in memory on hostName:51382 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:49 INFO BlockManagerInfo: Added broadcast_102_piece0 in memory on hostName:56472 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:49 INFO GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=41, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, node=6172ee3a-eb33-4bf5-9080-c255f52caed8] 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_41_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_87_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_86_piece0 on ipaddress:43498 in memory (size: 2.2 KB, free: 19.2 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_86_piece0 on hostName:45520 in memory (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_86_piece0 on hostName:52284 in memory (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_86_piece0 on hostName:48144 in memory (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_86_piece0 on hostName:60209 in memory (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_86_piece0 on hostName:49289 in memory (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_86_piece0 on hostName:49788 in memory (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_86_piece0 on hostName:51137 in memory (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_86_piece0 on hostName:56472 in memory (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_86_piece0 on hostName:43142 in memory (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_86_piece0 on hostName:35569 in memory (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_86_piece0 on hostName:38204 in memory (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_86_piece0 on hostName:43477 in memory (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_86_piece0 on hostName:32912 in memory (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_86_piece0 on hostName:56606 in memory (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_86_piece0 on hostName:50848 in memory (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_86_piece0 on hostName:34517 in memory (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_86_piece0 on hostName:36400 in memory (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_86_piece0 on hostName:48862 in memory (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_86_piece0 on hostName:46376 in memory (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_86_piece0 on hostName:33016 in memory (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_86_piece0 on hostName:46180 in memory (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_86_piece0 on hostName:51773 in memory (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_86_piece0 on hostName:56727 in memory (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_86_piece0 on hostName:41809 in memory (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_86_piece0 on hostName:46027 in memory (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_86_piece0 on hostName:44583 in memory (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_86_piece0 on hostName:35888 in memory (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_86_piece0 on hostName:41952 in memory (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_86_piece0 on hostName:50154 in memory (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_86_piece0 on hostName:45617 in memory (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_86_piece0 on hostName:42418 in memory (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_86_piece0 on hostName:56293 in memory (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_86_piece0 on hostName:44721 in memory (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_86_piece0 on hostName:57052 in memory (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_86_piece0 on hostName:41443 in memory (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_86_piece0 on hostName:55987 in memory (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_86_piece0 on hostName:40903 in memory (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_86_piece0 on hostName:37357 in memory (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_86_piece0 on hostName:51382 in memory (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_86_piece0 on hostName:58857 in memory (size: 2.2 KB, free: 7.8 GB) 17/03/01 04:12:51 INFO ContextCleaner: Cleaned accumulator 10 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_40_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_39_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_38_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_37_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_36_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_35_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_34_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_33_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_32_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_31_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_30_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_29_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_28_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_27_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_26_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_25_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_24_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_23_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:51 INFO BlockManagerInfo: Removed broadcast_22_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_21_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_20_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_19_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_18_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_17_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_16_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_15_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_14_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_13_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_12_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_11_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_10_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_9_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_8_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_7_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_6_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_5_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_4_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_3_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_2_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_2_piece0 on hostName:46376 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_0_piece0 on ipaddress:43498 in memory (size: 1310.0 B, free: 19.2 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_0_piece0 on hostName:46376 in memory (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_0_piece0 on hostName:50848 in memory (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_0_piece0 on hostName:52284 in memory (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_0_piece0 on hostName:38204 in memory (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_0_piece0 on hostName:43142 in memory (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_0_piece0 on hostName:60209 in memory (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_0_piece0 on hostName:49788 in memory (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_0_piece0 on hostName:45520 in memory (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_0_piece0 on hostName:51137 in memory (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_0_piece0 on hostName:56293 in memory (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_0_piece0 on hostName:49289 in memory (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_0_piece0 on hostName:33016 in memory (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_0_piece0 on hostName:44583 in memory (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_0_piece0 on hostName:44721 in memory (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_0_piece0 on hostName:50154 in memory (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_0_piece0 on hostName:46180 in memory (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_0_piece0 on hostName:55987 in memory (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_0_piece0 on hostName:56727 in memory (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_0_piece0 on hostName:57052 in memory (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_0_piece0 on hostName:51382 in memory (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_0_piece0 on hostName:48144 in memory (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_0_piece0 on hostName:45617 in memory (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_0_piece0 on hostName:32912 in memory (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_0_piece0 on hostName:56606 in memory (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_0_piece0 on hostName:34517 in memory (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_0_piece0 on hostName:41952 in memory (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_0_piece0 on hostName:48862 in memory (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_0_piece0 on hostName:41443 in memory (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_0_piece0 on hostName:43477 in memory (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_0_piece0 on hostName:42418 in memory (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_0_piece0 on hostName:35569 in memory (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_0_piece0 on hostName:46027 in memory (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_0_piece0 on hostName:36400 in memory (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_0_piece0 on hostName:41809 in memory (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_0_piece0 on hostName:37357 in memory (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_0_piece0 on hostName:35888 in memory (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Removed broadcast_0_piece0 on hostName:58857 in memory (size: 1310.0 B, free: 7.8 GB) 17/03/01 04:12:52 INFO ContextCleaner: Cleaned accumulator 1 17/03/01 04:12:52 INFO TaskSetManager: Starting task 47.0 in stage 5.0 (TID 180, hostName, partition 47,RACK_LOCAL, 2329 bytes) 17/03/01 04:12:52 INFO TaskSetManager: Starting task 13.0 in stage 5.0 (TID 181, hostName, partition 13,RACK_LOCAL, 2329 bytes) 17/03/01 04:12:52 INFO TaskSetManager: Starting task 3.0 in stage 5.0 (TID 182, hostName, partition 3,RACK_LOCAL, 2329 bytes) 17/03/01 04:12:52 INFO TaskSetManager: Starting task 34.0 in stage 5.0 (TID 183, hostName, partition 34,RACK_LOCAL, 2329 bytes) 17/03/01 04:12:52 INFO TaskSetManager: Starting task 38.0 in stage 5.0 (TID 184, hostName, partition 38,RACK_LOCAL, 2329 bytes) 17/03/01 04:12:52 INFO TaskSetManager: Starting task 20.0 in stage 5.0 (TID 185, hostName, partition 20,RACK_LOCAL, 2329 bytes) 17/03/01 04:12:52 INFO TaskSetManager: Starting task 32.0 in stage 5.0 (TID 186, hostName, partition 32,RACK_LOCAL, 2329 bytes) 17/03/01 04:12:52 INFO TaskSetManager: Starting task 4.0 in stage 5.0 (TID 187, hostName, partition 4,RACK_LOCAL, 2329 bytes) 17/03/01 04:12:52 INFO TaskSetManager: Starting task 22.0 in stage 5.0 (TID 188, hostName, partition 22,RACK_LOCAL, 2329 bytes) 17/03/01 04:12:52 INFO TaskSetManager: Starting task 23.0 in stage 5.0 (TID 189, hostName, partition 23,RACK_LOCAL, 2329 bytes) 17/03/01 04:12:52 INFO TaskSetManager: Starting task 25.0 in stage 5.0 (TID 190, hostName, partition 25,RACK_LOCAL, 2329 bytes) 17/03/01 04:12:52 INFO TaskSetManager: Starting task 6.0 in stage 5.0 (TID 191, hostName, partition 6,RACK_LOCAL, 2329 bytes) 17/03/01 04:12:52 INFO TaskSetManager: Starting task 19.0 in stage 5.0 (TID 192, hostName, partition 19,RACK_LOCAL, 2329 bytes) 17/03/01 04:12:52 INFO TaskSetManager: Starting task 49.0 in stage 5.0 (TID 193, hostName, partition 49,RACK_LOCAL, 2329 bytes) 17/03/01 04:12:52 INFO BlockManagerInfo: Added broadcast_128_piece0 in memory on hostName:51773 (size: 7.1 KB, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Added broadcast_128_piece0 in memory on hostName:32912 (size: 7.1 KB, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Added broadcast_128_piece0 in memory on hostName:46027 (size: 7.1 KB, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Added broadcast_128_piece0 in memory on hostName:60209 (size: 7.1 KB, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Added broadcast_128_piece0 in memory on hostName:50848 (size: 7.1 KB, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Added broadcast_128_piece0 in memory on hostName:36400 (size: 7.1 KB, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Added broadcast_128_piece0 in memory on hostName:46180 (size: 7.1 KB, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Added broadcast_128_piece0 in memory on hostName:35888 (size: 7.1 KB, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Added broadcast_128_piece0 in memory on hostName:51137 (size: 7.1 KB, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Added broadcast_128_piece0 in memory on hostName:40903 (size: 7.1 KB, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Added broadcast_128_piece0 in memory on hostName:45617 (size: 7.1 KB, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Added broadcast_128_piece0 in memory on hostName:57052 (size: 7.1 KB, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Added broadcast_128_piece0 in memory on hostName:44583 (size: 7.1 KB, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Added broadcast_107_piece0 in memory on hostName:60209 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Added broadcast_111_piece0 in memory on hostName:32912 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Added broadcast_91_piece0 in memory on hostName:51773 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Added broadcast_100_piece0 in memory on hostName:46027 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Added broadcast_98_piece0 in memory on hostName:46180 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Added broadcast_105_piece0 in memory on hostName:51137 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Added broadcast_104_piece0 in memory on hostName:36400 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Added broadcast_112_piece0 in memory on hostName:35888 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Added broadcast_128_piece0 in memory on hostName:58857 (size: 7.1 KB, free: 7.8 GB) 17/03/01 04:12:52 INFO BlockManagerInfo: Added broadcast_94_piece0 in memory on hostName:50848 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:53 INFO BlockManagerInfo: Added broadcast_90_piece0 in memory on hostName:58857 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:53 INFO BlockManagerInfo: Added broadcast_99_piece0 in memory on hostName:40903 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:53 INFO BlockManagerInfo: Added broadcast_97_piece0 in memory on hostName:57052 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:53 INFO BlockManagerInfo: Added broadcast_99_piece0 in memory on hostName:44583 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:53 INFO BlockManagerInfo: Added broadcast_89_piece0 in memory on hostName:45617 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:54 INFO TaskSetManager: Finished task 58.0 in stage 5.0 (TID 164) in 5131 ms on hostName (1/80) 17/03/01 04:12:54 INFO TaskSetManager: Starting task 5.0 in stage 5.0 (TID 194, hostName, partition 5,RACK_LOCAL, 2329 bytes) 17/03/01 04:12:54 INFO TaskSetManager: Finished task 59.0 in stage 5.0 (TID 175) in 5144 ms on hostName (2/80) 17/03/01 04:12:54 INFO BlockManagerInfo: Added broadcast_90_piece0 in memory on hostName:52284 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:54 INFO TaskSetManager: Starting task 24.0 in stage 5.0 (TID 195, hostName, partition 24,NODE_LOCAL, 2329 bytes) 17/03/01 04:12:54 INFO TaskSetManager: Finished task 12.0 in stage 5.0 (TID 169) in 5247 ms on hostName (3/80) 17/03/01 04:12:54 INFO BlockManagerInfo: Added broadcast_100_piece0 in memory on hostName:45520 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:12:56 INFO TaskSetManager: Starting task 53.0 in stage 5.0 (TID 196, hostName, partition 53,NODE_LOCAL, 2329 bytes) 17/03/01 04:12:56 INFO TaskSetManager: Finished task 52.0 in stage 5.0 (TID 170) in 7168 ms on hostName (4/80) 17/03/01 04:12:56 INFO TaskSetManager: Finished task 14.0 in stage 5.0 (TID 166) in 7171 ms on hostName (5/80) 17/03/01 04:12:56 INFO TaskSetManager: Finished task 2.0 in stage 5.0 (TID 179) in 7431 ms on hostName (6/80) 17/03/01 04:12:56 INFO TaskSetManager: Finished task 34.0 in stage 5.0 (TID 183) in 3574 ms on hostName (7/80) 17/03/01 04:12:56 INFO TaskSetManager: Finished task 18.0 in stage 5.0 (TID 178) in 7839 ms on hostName (8/80) 17/03/01 04:12:56 INFO TaskSetManager: Finished task 15.0 in stage 5.0 (TID 171) in 7895 ms on hostName (9/80) 17/03/01 04:12:57 INFO TaskSetManager: Finished task 41.0 in stage 5.0 (TID 177) in 8023 ms on hostName (10/80) 17/03/01 04:12:57 INFO TaskSetManager: Finished task 40.0 in stage 5.0 (TID 168) in 8305 ms on hostName (11/80) 17/03/01 04:12:57 INFO TaskSetManager: Starting task 51.0 in stage 5.0 (TID 197, hostName, partition 51,NODE_LOCAL, 2329 bytes) 17/03/01 04:12:57 INFO TaskSetManager: Finished task 50.0 in stage 5.0 (TID 165) in 8714 ms on hostName (12/80) 17/03/01 04:12:57 INFO TaskSetManager: Starting task 75.0 in stage 5.0 (TID 198, hostName, partition 75,NODE_LOCAL, 2329 bytes) 17/03/01 04:12:57 INFO TaskSetManager: Finished task 74.0 in stage 5.0 (TID 167) in 8810 ms on hostName (13/80) 17/03/01 04:12:57 INFO TaskSetManager: Finished task 38.0 in stage 5.0 (TID 184) in 5070 ms on hostName (14/80) 17/03/01 04:12:58 INFO TaskSetManager: Finished task 13.0 in stage 5.0 (TID 181) in 5641 ms on hostName (15/80) 17/03/01 04:12:58 INFO TaskSetManager: Starting task 55.0 in stage 5.0 (TID 199, hostName, partition 55,NODE_LOCAL, 2329 bytes) 17/03/01 04:12:58 INFO TaskSetManager: Finished task 54.0 in stage 5.0 (TID 162) in 9591 ms on hostName (16/80) 17/03/01 04:13:00 INFO TaskSetManager: Finished task 20.0 in stage 5.0 (TID 185) in 7600 ms on hostName (17/80) 17/03/01 04:13:00 INFO TaskSetManager: Finished task 4.0 in stage 5.0 (TID 187) in 7673 ms on hostName (18/80) 17/03/01 04:13:00 INFO TaskSetManager: Finished task 5.0 in stage 5.0 (TID 194) in 6506 ms on hostName (19/80) 17/03/01 04:13:01 INFO TaskSetManager: Finished task 16.0 in stage 5.0 (TID 174) in 12134 ms on hostName (20/80) 17/03/01 04:13:01 INFO TaskSetManager: Finished task 23.0 in stage 5.0 (TID 189) in 8246 ms on hostName (21/80) 17/03/01 04:13:01 INFO TaskSetManager: Finished task 32.0 in stage 5.0 (TID 186) in 8317 ms on hostName (22/80) 17/03/01 04:13:01 INFO TaskSetManager: Finished task 19.0 in stage 5.0 (TID 192) in 8602 ms on hostName (23/80) 17/03/01 04:13:01 INFO TaskSetManager: Finished task 22.0 in stage 5.0 (TID 188) in 8627 ms on hostName (24/80) 17/03/01 04:13:01 INFO TaskSetManager: Finished task 53.0 in stage 5.0 (TID 196) in 5401 ms on hostName (25/80) 17/03/01 04:13:01 INFO TaskSetManager: Starting task 29.0 in stage 5.0 (TID 200, hostName, partition 29,RACK_LOCAL, 2329 bytes) 17/03/01 04:13:01 INFO TaskSetManager: Starting task 17.0 in stage 5.0 (TID 201, hostName, partition 17,RACK_LOCAL, 2329 bytes) 17/03/01 04:13:01 INFO TaskSetManager: Starting task 33.0 in stage 5.0 (TID 202, hostName, partition 33,RACK_LOCAL, 2329 bytes) 17/03/01 04:13:01 INFO TaskSetManager: Starting task 35.0 in stage 5.0 (TID 203, hostName, partition 35,RACK_LOCAL, 2329 bytes) 17/03/01 04:13:01 INFO TaskSetManager: Starting task 78.0 in stage 5.0 (TID 204, hostName, partition 78,RACK_LOCAL, 2329 bytes) 17/03/01 04:13:01 INFO TaskSetManager: Starting task 21.0 in stage 5.0 (TID 205, hostName, partition 21,RACK_LOCAL, 2329 bytes) 17/03/01 04:13:01 INFO TaskSetManager: Starting task 39.0 in stage 5.0 (TID 206, hostName, partition 39,RACK_LOCAL, 2329 bytes) 17/03/01 04:13:01 INFO TaskSetManager: Starting task 60.0 in stage 5.0 (TID 207, hostName, partition 60,RACK_LOCAL, 2329 bytes) 17/03/01 04:13:01 INFO BlockManagerInfo: Added broadcast_102_piece0 in memory on hostName:52284 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:13:01 INFO BlockManagerInfo: Added broadcast_127_piece0 in memory on hostName:50848 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:13:01 INFO BlockManagerInfo: Added broadcast_118_piece0 in memory on hostName:58857 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:13:01 INFO TaskSetManager: Starting task 65.0 in stage 5.0 (TID 208, hostName, partition 65,RACK_LOCAL, 2329 bytes) 17/03/01 04:13:01 INFO TaskSetManager: Finished task 28.0 in stage 5.0 (TID 163) in 12975 ms on hostName (26/80) 17/03/01 04:13:01 INFO BlockManagerInfo: Added broadcast_120_piece0 in memory on hostName:56472 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:13:03 INFO TaskSetManager: Starting task 7.0 in stage 5.0 (TID 209, hostName, partition 7,RACK_LOCAL, 2329 bytes) 17/03/01 04:13:03 INFO TaskSetManager: Finished task 6.0 in stage 5.0 (TID 191) in 10777 ms on hostName (27/80) 17/03/01 04:13:03 INFO TaskSetManager: Finished task 3.0 in stage 5.0 (TID 182) in 10926 ms on hostName (28/80) 17/03/01 04:13:04 INFO TaskSetManager: Starting task 36.0 in stage 5.0 (TID 210, hostName, partition 36,RACK_LOCAL, 2329 bytes) 17/03/01 04:13:04 INFO TaskSetManager: Finished task 35.0 in stage 5.0 (TID 203) in 2438 ms on hostName (29/80) 17/03/01 04:13:04 INFO BlockManagerInfo: Added broadcast_106_piece0 in memory on hostName:51137 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:13:04 INFO IgniteKernal%WCA: Metrics for local node (to disable set 'metricsLogFrequency' to 0) ^-- Node [id=6172ee3a, name=WCA, uptime=00:02:00:007] ^-- H/N/C [hosts=41, nodes=41, CPUs=1664] ^-- CPU [cur=1.4%, avg=1.06%, GC=0%] ^-- Heap [used=1692MB, free=95.35%, comm=5304MB] ^-- Non heap [used=141MB, free=-1%, comm=146MB] ^-- Public thread pool [active=0, idle=0, qSize=0] ^-- System thread pool [active=0, idle=96, qSize=0] ^-- Outbound messages queue [size=0] 17/03/01 04:13:05 INFO TaskSetManager: Finished task 46.0 in stage 5.0 (TID 176) in 16755 ms on hostName (30/80) 17/03/01 04:13:06 INFO TaskSetManager: Starting task 79.0 in stage 5.0 (TID 211, hostName, partition 79,RACK_LOCAL, 2329 bytes) 17/03/01 04:13:06 INFO TaskSetManager: Finished task 51.0 in stage 5.0 (TID 197) in 8791 ms on hostName (31/80) 17/03/01 04:13:06 INFO BlockManagerInfo: Added broadcast_127_piece0 in memory on hostName:43477 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:13:06 INFO TaskSetManager: Finished task 75.0 in stage 5.0 (TID 198) in 8938 ms on hostName (32/80) 17/03/01 04:13:07 INFO TaskSetManager: Starting task 66.0 in stage 5.0 (TID 212, hostName, partition 66,RACK_LOCAL, 2329 bytes) 17/03/01 04:13:07 INFO TaskSetManager: Finished task 48.0 in stage 5.0 (TID 173) in 18064 ms on hostName (33/80) 17/03/01 04:13:07 INFO BlockManagerInfo: Added broadcast_121_piece0 in memory on hostName:38204 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:13:07 INFO TaskSetManager: Starting task 56.0 in stage 5.0 (TID 213, hostName, partition 56,RACK_LOCAL, 2329 bytes) 17/03/01 04:13:07 INFO TaskSetManager: Finished task 39.0 in stage 5.0 (TID 206) in 5941 ms on hostName (34/80) 17/03/01 04:13:07 INFO BlockManagerInfo: Added broadcast_116_piece0 in memory on hostName:60209 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:13:09 INFO TaskSetManager: Finished task 55.0 in stage 5.0 (TID 199) in 10496 ms on hostName (35/80) 17/03/01 04:13:09 INFO TaskSetManager: Finished task 78.0 in stage 5.0 (TID 204) in 7865 ms on hostName (36/80) 17/03/01 04:13:09 INFO TaskSetManager: Finished task 21.0 in stage 5.0 (TID 205) in 8076 ms on hostName (37/80) 17/03/01 04:13:10 INFO TaskSetManager: Finished task 33.0 in stage 5.0 (TID 202) in 8520 ms on hostName (38/80) 17/03/01 04:13:10 INFO TaskSetManager: Starting task 72.0 in stage 5.0 (TID 214, hostName, partition 72,NODE_LOCAL, 2329 bytes) 17/03/01 04:13:10 INFO TaskSetManager: Finished task 24.0 in stage 5.0 (TID 195) in 16284 ms on hostName (39/80) 17/03/01 04:13:10 INFO BlockManagerInfo: Added broadcast_124_piece0 in memory on hostName:45520 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:13:11 INFO TaskSetManager: Finished task 60.0 in stage 5.0 (TID 207) in 9513 ms on hostName (40/80) 17/03/01 04:13:11 INFO TaskSetManager: Finished task 47.0 in stage 5.0 (TID 180) in 18575 ms on hostName (41/80) 17/03/01 04:13:11 INFO TaskSetManager: Finished task 0.0 in stage 5.0 (TID 172) in 22699 ms on hostName (42/80) 17/03/01 04:13:12 INFO TaskSetManager: Finished task 25.0 in stage 5.0 (TID 190) in 19296 ms on hostName (43/80) 17/03/01 04:13:12 INFO TaskSetManager: Finished task 79.0 in stage 5.0 (TID 211) in 5838 ms on hostName (44/80) 17/03/01 04:13:12 INFO TaskSetManager: Finished task 36.0 in stage 5.0 (TID 210) in 8500 ms on hostName (45/80) 17/03/01 04:13:12 INFO TaskSetManager: Finished task 49.0 in stage 5.0 (TID 193) in 19955 ms on hostName (46/80) 17/03/01 04:13:13 INFO TaskSetManager: Starting task 61.0 in stage 5.0 (TID 215, hostName, partition 61,RACK_LOCAL, 2329 bytes) 17/03/01 04:13:13 INFO TaskSetManager: Starting task 37.0 in stage 5.0 (TID 216, hostName, partition 37,RACK_LOCAL, 2329 bytes) 17/03/01 04:13:14 INFO TaskSetManager: Starting task 57.0 in stage 5.0 (TID 217, hostName, partition 57,RACK_LOCAL, 2329 bytes) 17/03/01 04:13:14 INFO TaskSetManager: Finished task 56.0 in stage 5.0 (TID 213) in 6424 ms on hostName (47/80) 17/03/01 04:13:14 INFO TaskSetManager: Finished task 17.0 in stage 5.0 (TID 201) in 12703 ms on hostName (48/80) 17/03/01 04:13:14 INFO TaskSetManager: Starting task 42.0 in stage 5.0 (TID 218, hostName, partition 42,RACK_LOCAL, 2329 bytes) 17/03/01 04:13:14 INFO TaskSetManager: Finished task 29.0 in stage 5.0 (TID 200) in 12993 ms on hostName (49/80) 17/03/01 04:13:14 INFO BlockManagerInfo: Added broadcast_109_piece0 in memory on hostName:52284 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:13:15 INFO TaskSetManager: Starting task 70.0 in stage 5.0 (TID 219, hostName, partition 70,RACK_LOCAL, 2329 bytes) 17/03/01 04:13:15 INFO TaskSetManager: Finished task 7.0 in stage 5.0 (TID 209) in 11320 ms on hostName (50/80) 17/03/01 04:13:15 INFO BlockManagerInfo: Added broadcast_123_piece0 in memory on hostName:51773 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:13:15 INFO TaskSetManager: Finished task 65.0 in stage 5.0 (TID 208) in 13156 ms on hostName (51/80) 17/03/01 04:13:16 INFO TaskSetManager: Starting task 67.0 in stage 5.0 (TID 220, hostName, partition 67,RACK_LOCAL, 2329 bytes) 17/03/01 04:13:16 INFO TaskSetManager: Finished task 66.0 in stage 5.0 (TID 212) in 9784 ms on hostName (52/80) 17/03/01 04:13:18 INFO TaskSetManager: Starting task 73.0 in stage 5.0 (TID 221, hostName, partition 73,NODE_LOCAL, 2329 bytes) 17/03/01 04:13:18 INFO TaskSetManager: Finished task 72.0 in stage 5.0 (TID 214) in 7739 ms on hostName (53/80) 17/03/01 04:13:18 INFO TaskSetManager: Finished task 42.0 in stage 5.0 (TID 218) in 3919 ms on hostName (54/80) 17/03/01 04:13:19 INFO TaskSetManager: Finished task 57.0 in stage 5.0 (TID 217) in 5378 ms on hostName (55/80) 17/03/01 04:13:21 INFO TaskSetManager: Starting task 43.0 in stage 5.0 (TID 222, hostName, partition 43,RACK_LOCAL, 2329 bytes) 17/03/01 04:13:22 INFO TaskSetManager: Starting task 44.0 in stage 5.0 (TID 223, hostName, partition 44,RACK_LOCAL, 2329 bytes) 17/03/01 04:13:22 INFO TaskSetManager: Finished task 37.0 in stage 5.0 (TID 216) in 8391 ms on hostName (56/80) 17/03/01 04:13:22 INFO BlockManagerInfo: Added broadcast_110_piece0 in memory on hostName:51137 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:13:23 INFO TaskSetManager: Starting task 71.0 in stage 5.0 (TID 224, hostName, partition 71,RACK_LOCAL, 2329 bytes) 17/03/01 04:13:23 INFO TaskSetManager: Finished task 70.0 in stage 5.0 (TID 219) in 8120 ms on hostName (57/80) 17/03/01 04:13:23 INFO TaskSetManager: Finished task 61.0 in stage 5.0 (TID 215) in 9500 ms on hostName (58/80) 17/03/01 04:13:26 INFO TaskSetManager: Starting task 26.0 in stage 5.0 (TID 225, hostName, partition 26,RACK_LOCAL, 2329 bytes) 17/03/01 04:13:26 INFO TaskSetManager: Finished task 73.0 in stage 5.0 (TID 221) in 7880 ms on hostName (59/80) 17/03/01 04:13:26 INFO BlockManagerInfo: Added broadcast_101_piece0 in memory on hostName:45520 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:13:26 INFO TaskSetManager: Starting task 76.0 in stage 5.0 (TID 226, hostName, partition 76,RACK_LOCAL, 2329 bytes) 17/03/01 04:13:26 INFO TaskSetManager: Finished task 67.0 in stage 5.0 (TID 220) in 9648 ms on hostName (60/80) 17/03/01 04:13:26 INFO BlockManagerInfo: Added broadcast_126_piece0 in memory on hostName:38204 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:13:27 INFO TaskSetManager: Starting task 62.0 in stage 5.0 (TID 227, hostName, partition 62,RACK_LOCAL, 2329 bytes) 17/03/01 04:13:27 INFO TaskSetManager: Finished task 43.0 in stage 5.0 (TID 222) in 5124 ms on hostName (61/80) 17/03/01 04:13:27 INFO BlockManagerInfo: Added broadcast_119_piece0 in memory on hostName:52284 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:13:29 INFO TaskSetManager: Starting task 27.0 in stage 5.0 (TID 228, hostName, partition 27,RACK_LOCAL, 2329 bytes) 17/03/01 04:13:29 INFO TaskSetManager: Finished task 26.0 in stage 5.0 (TID 225) in 2874 ms on hostName (62/80) 17/03/01 04:13:29 INFO TaskSetManager: Starting task 45.0 in stage 5.0 (TID 229, hostName, partition 45,RACK_LOCAL, 2329 bytes) 17/03/01 04:13:29 INFO TaskSetManager: Finished task 44.0 in stage 5.0 (TID 223) in 7168 ms on hostName (63/80) 17/03/01 04:13:30 INFO TaskSetManager: Starting task 77.0 in stage 5.0 (TID 230, hostName, partition 77,RACK_LOCAL, 2329 bytes) 17/03/01 04:13:30 INFO TaskSetManager: Finished task 76.0 in stage 5.0 (TID 226) in 4351 ms on hostName (64/80) 17/03/01 04:13:32 INFO TaskSetManager: Finished task 71.0 in stage 5.0 (TID 224) in 9346 ms on hostName (65/80) 17/03/01 04:13:33 INFO TaskSetManager: Finished task 27.0 in stage 5.0 (TID 228) in 4099 ms on hostName (66/80) 17/03/01 04:13:33 INFO TaskSetManager: Starting task 1.0 in stage 5.0 (TID 231, hostName, partition 1,ANY, 2329 bytes) 17/03/01 04:13:33 INFO TaskSetManager: Starting task 8.0 in stage 5.0 (TID 232, hostName, partition 8,ANY, 2329 bytes) 17/03/01 04:13:33 INFO TaskSetManager: Starting task 9.0 in stage 5.0 (TID 233, hostName, partition 9,ANY, 2329 bytes) 17/03/01 04:13:33 INFO TaskSetManager: Starting task 10.0 in stage 5.0 (TID 234, hostName, partition 10,ANY, 2329 bytes) 17/03/01 04:13:33 INFO TaskSetManager: Starting task 11.0 in stage 5.0 (TID 235, hostName, partition 11,ANY, 2329 bytes) 17/03/01 04:13:33 INFO TaskSetManager: Starting task 30.0 in stage 5.0 (TID 236, hostName, partition 30,ANY, 2329 bytes) 17/03/01 04:13:33 INFO TaskSetManager: Starting task 31.0 in stage 5.0 (TID 237, hostName, partition 31,ANY, 2329 bytes) 17/03/01 04:13:33 INFO TaskSetManager: Starting task 63.0 in stage 5.0 (TID 238, hostName, partition 63,ANY, 2329 bytes) 17/03/01 04:13:33 INFO TaskSetManager: Starting task 64.0 in stage 5.0 (TID 239, hostName, partition 64,ANY, 2329 bytes) 17/03/01 04:13:33 INFO TaskSetManager: Starting task 68.0 in stage 5.0 (TID 240, hostName, partition 68,ANY, 2329 bytes) 17/03/01 04:13:33 INFO TaskSetManager: Starting task 69.0 in stage 5.0 (TID 241, hostName, partition 69,ANY, 2329 bytes) 17/03/01 04:13:33 INFO BlockManagerInfo: Added broadcast_103_piece0 in memory on hostName:43477 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:13:33 INFO BlockManagerInfo: Added broadcast_93_piece0 in memory on hostName:32912 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:13:33 INFO BlockManagerInfo: Added broadcast_122_piece0 in memory on hostName:45617 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:13:33 INFO BlockManagerInfo: Added broadcast_92_piece0 in memory on hostName:56472 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:13:33 INFO BlockManagerInfo: Added broadcast_103_piece0 in memory on hostName:51382 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:13:33 INFO BlockManagerInfo: Added broadcast_92_piece0 in memory on hostName:58857 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:13:33 INFO BlockManagerInfo: Added broadcast_128_piece0 in memory on hostName:37357 (size: 7.1 KB, free: 7.8 GB) 17/03/01 04:13:33 INFO BlockManagerInfo: Added broadcast_88_piece0 in memory on hostName:48144 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:13:33 INFO BlockManagerInfo: Added broadcast_93_piece0 in memory on hostName:44583 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:13:34 INFO BlockManagerInfo: Added broadcast_122_piece0 in memory on hostName:56293 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:13:34 INFO BlockManagerInfo: Added broadcast_128_piece0 in memory on hostName:50154 (size: 7.1 KB, free: 7.8 GB) 17/03/01 04:13:35 INFO BlockManagerInfo: Added broadcast_119_piece0 in memory on hostName:37357 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:13:36 INFO BlockManagerInfo: Added broadcast_120_piece0 in memory on hostName:50154 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:13:36 INFO TaskSetManager: Finished task 77.0 in stage 5.0 (TID 230) in 5688 ms on hostName (67/80) 17/03/01 04:13:38 INFO TaskSetManager: Finished task 69.0 in stage 5.0 (TID 241) in 4746 ms on hostName (68/80) 17/03/01 04:13:39 INFO TaskSetManager: Finished task 45.0 in stage 5.0 (TID 229) in 9692 ms on hostName (69/80) 17/03/01 04:13:41 INFO TaskSetManager: Finished task 8.0 in stage 5.0 (TID 232) in 7938 ms on hostName (70/80) 17/03/01 04:13:43 INFO TaskSetManager: Finished task 11.0 in stage 5.0 (TID 235) in 9576 ms on hostName (71/80) 17/03/01 04:13:43 INFO TaskSetManager: Finished task 68.0 in stage 5.0 (TID 240) in 9716 ms on hostName (72/80) 17/03/01 04:13:43 INFO TaskSetManager: Finished task 31.0 in stage 5.0 (TID 237) in 9860 ms on hostName (73/80) 17/03/01 04:13:44 INFO TaskSetManager: Finished task 9.0 in stage 5.0 (TID 233) in 11015 ms on hostName (74/80) 17/03/01 04:13:45 INFO TaskSetManager: Finished task 30.0 in stage 5.0 (TID 236) in 11293 ms on hostName (75/80) 17/03/01 04:13:47 INFO TaskSetManager: Finished task 10.0 in stage 5.0 (TID 234) in 13136 ms on hostName (76/80) 17/03/01 04:13:47 INFO TaskSetManager: Finished task 62.0 in stage 5.0 (TID 227) in 20843 ms on hostName (77/80) 17/03/01 04:13:54 INFO TaskSetManager: Finished task 63.0 in stage 5.0 (TID 238) in 20549 ms on hostName (78/80) 17/03/01 04:13:58 INFO TaskSetManager: Finished task 64.0 in stage 5.0 (TID 239) in 24536 ms on hostName (79/80) 17/03/01 04:14:00 INFO TaskSetManager: Finished task 1.0 in stage 5.0 (TID 231) in 26167 ms on hostName (80/80) 17/03/01 04:14:00 INFO YarnClusterScheduler: Removed TaskSet 5.0, whose tasks have all completed, from pool 17/03/01 04:14:00 INFO DAGScheduler: ResultStage 5 (count at CompanyResolverSparkTest.scala:259) finished in 71.091 s 17/03/01 04:14:00 INFO DAGScheduler: Job 4 finished: count at CompanyResolverSparkTest.scala:259, took 71.181946 s 17/03/01 04:14:00 INFO CompanyResolverSparkTest: wca data load time -72440 17/03/01 04:14:00 INFO MemoryStore: ensureFreeSpace(354856) called with curMem=15215455, maxMem=20615905935 17/03/01 04:14:00 INFO MemoryStore: Block broadcast_129 stored as values in memory (estimated size 346.5 KB, free 19.2 GB) 17/03/01 04:14:00 INFO MemoryStore: ensureFreeSpace(24643) called with curMem=15570311, maxMem=20615905935 17/03/01 04:14:00 INFO MemoryStore: Block broadcast_129_piece0 stored as bytes in memory (estimated size 24.1 KB, free 19.2 GB) 17/03/01 04:14:00 INFO BlockManagerInfo: Added broadcast_129_piece0 in memory on ipaddress:43498 (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:14:00 INFO SparkContext: Created broadcast 129 from textFile at CompanyResolverSparkTest.scala:287 17/03/01 04:14:00 ERROR GPLNativeCodeLoader: Could not load native gpl library java.lang.UnsatisfiedLinkError: no gplcompression in java.library.path at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1864) at java.lang.Runtime.loadLibrary0(Runtime.java:870) at java.lang.System.loadLibrary(System.java:1122) at com.hadoop.compression.lzo.GPLNativeCodeLoader.(GPLNativeCodeLoader.java:32) at com.hadoop.compression.lzo.LzoCodec.(LzoCodec.java:71) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:348) at org.apache.hadoop.conf.Configuration.getClassByNameOrNull(Configuration.java:2138) at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2103) at org.apache.hadoop.io.compress.CompressionCodecFactory.getCodecClasses(CompressionCodecFactory.java:128) at org.apache.hadoop.io.compress.CompressionCodecFactory.(CompressionCodecFactory.java:175) at org.apache.hadoop.mapred.TextInputFormat.configure(TextInputFormat.java:45) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:106) at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:75) at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:133) at org.apache.spark.rdd.HadoopRDD.getInputFormat(HadoopRDD.scala:190) at org.apache.spark.rdd.HadoopRDD.getPartitions(HadoopRDD.scala:203) at org.apache.spark.rdd.RDD$$anonfun$partitions$2.apply(RDD.scala:239) at org.apache.spark.rdd.RDD$$anonfun$partitions$2.apply(RDD.scala:237) at scala.Option.getOrElse(Option.scala:120) at org.apache.spark.rdd.RDD.partitions(RDD.scala:237) at org.apache.spark.rdd.MapPartitionsRDD.getPartitions(MapPartitionsRDD.scala:35) at org.apache.spark.rdd.RDD$$anonfun$partitions$2.apply(RDD.scala:239) at org.apache.spark.rdd.RDD$$anonfun$partitions$2.apply(RDD.scala:237) at scala.Option.getOrElse(Option.scala:120) at org.apache.spark.rdd.RDD.partitions(RDD.scala:237) at org.apache.spark.SparkContext.runJob(SparkContext.scala:1921) at org.apache.spark.rdd.RDD$$anonfun$collect$1.apply(RDD.scala:905) at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:147) at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:108) at org.apache.spark.rdd.RDD.withScope(RDD.scala:306) at org.apache.spark.rdd.RDD.collect(RDD.scala:904) at un.api.resolver.CompanyResolverSparkTest$.main(CompanyResolverSparkTest.scala:287) at un.api.resolver.CompanyResolverSparkTest.main(CompanyResolverSparkTest.scala) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at org.apache.spark.deploy.yarn.ApplicationMaster$$anon$2.run(ApplicationMaster.scala:525) 17/03/01 04:14:00 ERROR LzoCodec: Cannot load native-lzo without native-hadoop 17/03/01 04:14:00 INFO FileInputFormat: Total input paths to process : 1 17/03/01 04:14:00 INFO SparkContext: Starting job: collect at CompanyResolverSparkTest.scala:287 17/03/01 04:14:00 INFO DAGScheduler: Got job 5 (collect at CompanyResolverSparkTest.scala:287) with 2 output partitions 17/03/01 04:14:00 INFO DAGScheduler: Final stage: ResultStage 6(collect at CompanyResolverSparkTest.scala:287) 17/03/01 04:14:00 INFO DAGScheduler: Parents of final stage: List() 17/03/01 04:14:00 INFO DAGScheduler: Missing parents: List() 17/03/01 04:14:00 INFO DAGScheduler: Submitting ResultStage 6 (MapPartitionsRDD[499] at textFile at CompanyResolverSparkTest.scala:287), which has no missing parents 17/03/01 04:14:00 INFO MemoryStore: ensureFreeSpace(3176) called with curMem=15594954, maxMem=20615905935 17/03/01 04:14:00 INFO MemoryStore: Block broadcast_130 stored as values in memory (estimated size 3.1 KB, free 19.2 GB) 17/03/01 04:14:00 INFO MemoryStore: ensureFreeSpace(1829) called with curMem=15598130, maxMem=20615905935 17/03/01 04:14:00 INFO MemoryStore: Block broadcast_130_piece0 stored as bytes in memory (estimated size 1829.0 B, free 19.2 GB) 17/03/01 04:14:00 INFO BlockManagerInfo: Added broadcast_130_piece0 in memory on ipaddress:43498 (size: 1829.0 B, free: 19.2 GB) 17/03/01 04:14:00 INFO SparkContext: Created broadcast 130 from broadcast at DAGScheduler.scala:861 17/03/01 04:14:00 INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 6 (MapPartitionsRDD[499] at textFile at CompanyResolverSparkTest.scala:287) 17/03/01 04:14:00 INFO YarnClusterScheduler: Adding task set 6.0 with 2 tasks 17/03/01 04:14:00 INFO TaskSetManager: Starting task 0.0 in stage 6.0 (TID 242, hostName, partition 0,NODE_LOCAL, 2169 bytes) 17/03/01 04:14:00 INFO TaskSetManager: Starting task 1.0 in stage 6.0 (TID 243, hostName, partition 1,NODE_LOCAL, 2169 bytes) 17/03/01 04:14:00 INFO BlockManagerInfo: Added broadcast_130_piece0 in memory on hostName:57052 (size: 1829.0 B, free: 7.8 GB) 17/03/01 04:14:00 INFO BlockManagerInfo: Added broadcast_130_piece0 in memory on hostName:56293 (size: 1829.0 B, free: 7.8 GB) 17/03/01 04:14:00 INFO BlockManagerInfo: Added broadcast_129_piece0 in memory on hostName:57052 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:14:00 INFO BlockManagerInfo: Added broadcast_129_piece0 in memory on hostName:56293 (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:14:00 INFO TaskSetManager: Finished task 1.0 in stage 6.0 (TID 243) in 187 ms on hostName (1/2) 17/03/01 04:14:00 INFO TaskSetManager: Finished task 0.0 in stage 6.0 (TID 242) in 250 ms on hostName (2/2) 17/03/01 04:14:00 INFO DAGScheduler: ResultStage 6 (collect at CompanyResolverSparkTest.scala:287) finished in 0.252 s 17/03/01 04:14:00 INFO YarnClusterScheduler: Removed TaskSet 6.0, whose tasks have all completed, from pool 17/03/01 04:14:00 INFO DAGScheduler: Job 5 finished: collect at CompanyResolverSparkTest.scala:287, took 0.259909 s 17/03/01 04:14:00 INFO SparkContext: Starting job: count at CompanyResolverSparkTest.scala:292 17/03/01 04:14:00 INFO DAGScheduler: Got job 6 (count at CompanyResolverSparkTest.scala:292) with 40 output partitions 17/03/01 04:14:00 INFO DAGScheduler: Final stage: ResultStage 7(count at CompanyResolverSparkTest.scala:292) 17/03/01 04:14:00 INFO DAGScheduler: Parents of final stage: List() 17/03/01 04:14:00 INFO DAGScheduler: Missing parents: List() 17/03/01 04:14:00 INFO DAGScheduler: Submitting ResultStage 7 (MapPartitionsRDD[501] at map at CompanyResolverSparkTest.scala:289), which has no missing parents 17/03/01 04:14:00 INFO MemoryStore: ensureFreeSpace(7352) called with curMem=15599959, maxMem=20615905935 17/03/01 04:14:00 INFO MemoryStore: Block broadcast_131 stored as values in memory (estimated size 7.2 KB, free 19.2 GB) 17/03/01 04:14:00 INFO MemoryStore: ensureFreeSpace(2732) called with curMem=15607311, maxMem=20615905935 17/03/01 04:14:00 INFO MemoryStore: Block broadcast_131_piece0 stored as bytes in memory (estimated size 2.7 KB, free 19.2 GB) 17/03/01 04:14:00 INFO BlockManagerInfo: Added broadcast_131_piece0 in memory on ipaddress:43498 (size: 2.7 KB, free: 19.2 GB) 17/03/01 04:14:00 INFO SparkContext: Created broadcast 131 from broadcast at DAGScheduler.scala:861 17/03/01 04:14:00 INFO DAGScheduler: Submitting 40 missing tasks from ResultStage 7 (MapPartitionsRDD[501] at map at CompanyResolverSparkTest.scala:289) 17/03/01 04:14:00 INFO YarnClusterScheduler: Adding task set 7.0 with 40 tasks 17/03/01 04:14:00 INFO TaskSetManager: Starting task 0.0 in stage 7.0 (TID 244, hostName, partition 0,PROCESS_LOCAL, 2511 bytes) 17/03/01 04:14:00 INFO TaskSetManager: Starting task 1.0 in stage 7.0 (TID 245, hostName, partition 1,PROCESS_LOCAL, 2498 bytes) 17/03/01 04:14:00 INFO TaskSetManager: Starting task 2.0 in stage 7.0 (TID 246, hostName, partition 2,PROCESS_LOCAL, 2506 bytes) 17/03/01 04:14:00 INFO TaskSetManager: Starting task 3.0 in stage 7.0 (TID 247, hostName, partition 3,PROCESS_LOCAL, 2506 bytes) 17/03/01 04:14:00 INFO TaskSetManager: Starting task 4.0 in stage 7.0 (TID 248, hostName, partition 4,PROCESS_LOCAL, 2501 bytes) 17/03/01 04:14:00 INFO TaskSetManager: Starting task 5.0 in stage 7.0 (TID 249, hostName, partition 5,PROCESS_LOCAL, 2503 bytes) 17/03/01 04:14:00 INFO TaskSetManager: Starting task 6.0 in stage 7.0 (TID 250, hostName, partition 6,PROCESS_LOCAL, 2509 bytes) 17/03/01 04:14:00 INFO TaskSetManager: Starting task 7.0 in stage 7.0 (TID 251, hostName, partition 7,PROCESS_LOCAL, 2506 bytes) 17/03/01 04:14:00 INFO TaskSetManager: Starting task 8.0 in stage 7.0 (TID 252, hostName, partition 8,PROCESS_LOCAL, 2505 bytes) 17/03/01 04:14:00 INFO TaskSetManager: Starting task 9.0 in stage 7.0 (TID 253, hostName, partition 9,PROCESS_LOCAL, 2506 bytes) 17/03/01 04:14:00 INFO TaskSetManager: Starting task 10.0 in stage 7.0 (TID 254, hostName, partition 10,PROCESS_LOCAL, 2508 bytes) 17/03/01 04:14:00 INFO TaskSetManager: Starting task 11.0 in stage 7.0 (TID 255, hostName, partition 11,PROCESS_LOCAL, 2506 bytes) 17/03/01 04:14:00 INFO TaskSetManager: Starting task 12.0 in stage 7.0 (TID 256, hostName, partition 12,PROCESS_LOCAL, 2495 bytes) 17/03/01 04:14:00 INFO TaskSetManager: Starting task 13.0 in stage 7.0 (TID 257, hostName, partition 13,PROCESS_LOCAL, 2508 bytes) 17/03/01 04:14:00 INFO TaskSetManager: Starting task 14.0 in stage 7.0 (TID 258, hostName, partition 14,PROCESS_LOCAL, 2506 bytes) 17/03/01 04:14:00 INFO TaskSetManager: Starting task 15.0 in stage 7.0 (TID 259, hostName, partition 15,PROCESS_LOCAL, 2506 bytes) 17/03/01 04:14:00 INFO TaskSetManager: Starting task 16.0 in stage 7.0 (TID 260, hostName, partition 16,PROCESS_LOCAL, 2506 bytes) 17/03/01 04:14:00 INFO TaskSetManager: Starting task 17.0 in stage 7.0 (TID 261, hostName, partition 17,PROCESS_LOCAL, 2506 bytes) 17/03/01 04:14:00 INFO TaskSetManager: Starting task 18.0 in stage 7.0 (TID 262, hostName, partition 18,PROCESS_LOCAL, 2508 bytes) 17/03/01 04:14:00 INFO TaskSetManager: Starting task 19.0 in stage 7.0 (TID 263, hostName, partition 19,PROCESS_LOCAL, 2498 bytes) 17/03/01 04:14:00 INFO TaskSetManager: Starting task 20.0 in stage 7.0 (TID 264, hostName, partition 20,PROCESS_LOCAL, 2501 bytes) 17/03/01 04:14:00 INFO TaskSetManager: Starting task 21.0 in stage 7.0 (TID 265, hostName, partition 21,PROCESS_LOCAL, 2511 bytes) 17/03/01 04:14:00 INFO TaskSetManager: Starting task 22.0 in stage 7.0 (TID 266, hostName, partition 22,PROCESS_LOCAL, 2506 bytes) 17/03/01 04:14:00 INFO TaskSetManager: Starting task 23.0 in stage 7.0 (TID 267, hostName, partition 23,PROCESS_LOCAL, 2498 bytes) 17/03/01 04:14:00 INFO TaskSetManager: Starting task 24.0 in stage 7.0 (TID 268, hostName, partition 24,PROCESS_LOCAL, 2509 bytes) 17/03/01 04:14:00 INFO TaskSetManager: Starting task 25.0 in stage 7.0 (TID 269, hostName, partition 25,PROCESS_LOCAL, 2501 bytes) 17/03/01 04:14:00 INFO TaskSetManager: Starting task 26.0 in stage 7.0 (TID 270, hostName, partition 26,PROCESS_LOCAL, 2511 bytes) 17/03/01 04:14:00 INFO TaskSetManager: Starting task 27.0 in stage 7.0 (TID 271, hostName, partition 27,PROCESS_LOCAL, 2501 bytes) 17/03/01 04:14:00 INFO TaskSetManager: Starting task 28.0 in stage 7.0 (TID 272, hostName, partition 28,PROCESS_LOCAL, 2506 bytes) 17/03/01 04:14:00 INFO TaskSetManager: Starting task 29.0 in stage 7.0 (TID 273, hostName, partition 29,PROCESS_LOCAL, 2511 bytes) 17/03/01 04:14:00 INFO TaskSetManager: Starting task 30.0 in stage 7.0 (TID 274, hostName, partition 30,PROCESS_LOCAL, 2498 bytes) 17/03/01 04:14:00 INFO TaskSetManager: Starting task 31.0 in stage 7.0 (TID 275, hostName, partition 31,PROCESS_LOCAL, 2506 bytes) 17/03/01 04:14:00 INFO TaskSetManager: Starting task 32.0 in stage 7.0 (TID 276, hostName, partition 32,PROCESS_LOCAL, 2506 bytes) 17/03/01 04:14:00 INFO TaskSetManager: Starting task 33.0 in stage 7.0 (TID 277, hostName, partition 33,PROCESS_LOCAL, 2501 bytes) 17/03/01 04:14:00 INFO TaskSetManager: Starting task 34.0 in stage 7.0 (TID 278, hostName, partition 34,PROCESS_LOCAL, 2503 bytes) 17/03/01 04:14:00 INFO TaskSetManager: Starting task 35.0 in stage 7.0 (TID 279, hostName, partition 35,PROCESS_LOCAL, 2501 bytes) 17/03/01 04:14:00 INFO TaskSetManager: Starting task 36.0 in stage 7.0 (TID 280, hostName, partition 36,PROCESS_LOCAL, 2503 bytes) 17/03/01 04:14:00 INFO TaskSetManager: Starting task 37.0 in stage 7.0 (TID 281, hostName, partition 37,PROCESS_LOCAL, 2506 bytes) 17/03/01 04:14:00 INFO TaskSetManager: Starting task 38.0 in stage 7.0 (TID 282, hostName, partition 38,PROCESS_LOCAL, 2501 bytes) 17/03/01 04:14:00 INFO TaskSetManager: Starting task 39.0 in stage 7.0 (TID 283, hostName, partition 39,PROCESS_LOCAL, 2501 bytes) 17/03/01 04:14:00 INFO BlockManagerInfo: Added broadcast_131_piece0 in memory on hostName:37357 (size: 2.7 KB, free: 7.8 GB) 17/03/01 04:14:00 INFO BlockManagerInfo: Added broadcast_131_piece0 in memory on hostName:57052 (size: 2.7 KB, free: 7.8 GB) 17/03/01 04:14:00 INFO BlockManagerInfo: Added broadcast_131_piece0 in memory on hostName:41809 (size: 2.7 KB, free: 7.8 GB) 17/03/01 04:14:00 INFO BlockManagerInfo: Added broadcast_131_piece0 in memory on hostName:32912 (size: 2.7 KB, free: 7.8 GB) 17/03/01 04:14:00 INFO BlockManagerInfo: Added broadcast_131_piece0 in memory on hostName:46376 (size: 2.7 KB, free: 7.8 GB) 17/03/01 04:14:00 INFO BlockManagerInfo: Added broadcast_131_piece0 in memory on hostName:45520 (size: 2.7 KB, free: 7.8 GB) 17/03/01 04:14:00 INFO BlockManagerInfo: Added broadcast_131_piece0 in memory on hostName:35569 (size: 2.7 KB, free: 7.8 GB) 17/03/01 04:14:00 INFO BlockManagerInfo: Added broadcast_131_piece0 in memory on hostName:41443 (size: 2.7 KB, free: 7.8 GB) 17/03/01 04:14:00 INFO BlockManagerInfo: Added broadcast_131_piece0 in memory on hostName:48144 (size: 2.7 KB, free: 7.8 GB) 17/03/01 04:14:00 INFO BlockManagerInfo: Added broadcast_131_piece0 in memory on hostName:50848 (size: 2.7 KB, free: 7.8 GB) 17/03/01 04:14:00 INFO BlockManagerInfo: Added broadcast_131_piece0 in memory on hostName:45617 (size: 2.7 KB, free: 7.8 GB) 17/03/01 04:14:00 INFO BlockManagerInfo: Added broadcast_131_piece0 in memory on hostName:51137 (size: 2.7 KB, free: 7.8 GB) 17/03/01 04:14:00 INFO BlockManagerInfo: Added broadcast_131_piece0 in memory on hostName:51382 (size: 2.7 KB, free: 7.8 GB) 17/03/01 04:14:00 INFO BlockManagerInfo: Added broadcast_131_piece0 in memory on hostName:52284 (size: 2.7 KB, free: 7.8 GB) 17/03/01 04:14:00 INFO BlockManagerInfo: Added broadcast_131_piece0 in memory on hostName:35888 (size: 2.7 KB, free: 7.8 GB) 17/03/01 04:14:00 INFO BlockManagerInfo: Added broadcast_131_piece0 in memory on hostName:50154 (size: 2.7 KB, free: 7.8 GB) 17/03/01 04:14:00 INFO BlockManagerInfo: Added broadcast_131_piece0 in memory on hostName:38204 (size: 2.7 KB, free: 7.8 GB) 17/03/01 04:14:00 INFO BlockManagerInfo: Added broadcast_131_piece0 in memory on hostName:43477 (size: 2.7 KB, free: 7.8 GB) 17/03/01 04:14:00 INFO BlockManagerInfo: Added broadcast_131_piece0 in memory on hostName:43142 (size: 2.7 KB, free: 7.8 GB) 17/03/01 04:14:00 INFO BlockManagerInfo: Added broadcast_131_piece0 in memory on hostName:34517 (size: 2.7 KB, free: 7.8 GB) 17/03/01 04:14:00 INFO BlockManagerInfo: Added broadcast_131_piece0 in memory on hostName:55987 (size: 2.7 KB, free: 7.8 GB) 17/03/01 04:14:00 INFO BlockManagerInfo: Added broadcast_131_piece0 in memory on hostName:56472 (size: 2.7 KB, free: 7.8 GB) 17/03/01 04:14:00 INFO BlockManagerInfo: Added broadcast_131_piece0 in memory on hostName:42418 (size: 2.7 KB, free: 7.8 GB) 17/03/01 04:14:00 INFO BlockManagerInfo: Added broadcast_131_piece0 in memory on hostName:41952 (size: 2.7 KB, free: 7.8 GB) 17/03/01 04:14:00 INFO BlockManagerInfo: Added broadcast_131_piece0 in memory on hostName:58857 (size: 2.7 KB, free: 7.8 GB) 17/03/01 04:14:00 INFO BlockManagerInfo: Added broadcast_131_piece0 in memory on hostName:49788 (size: 2.7 KB, free: 7.8 GB) 17/03/01 04:14:00 INFO BlockManagerInfo: Added broadcast_131_piece0 in memory on hostName:46027 (size: 2.7 KB, free: 7.8 GB) 17/03/01 04:14:00 INFO BlockManagerInfo: Added broadcast_131_piece0 in memory on hostName:56727 (size: 2.7 KB, free: 7.8 GB) 17/03/01 04:14:00 INFO BlockManagerInfo: Added broadcast_131_piece0 in memory on hostName:48862 (size: 2.7 KB, free: 7.8 GB) 17/03/01 04:14:00 INFO BlockManagerInfo: Added broadcast_131_piece0 in memory on hostName:44583 (size: 2.7 KB, free: 7.8 GB) 17/03/01 04:14:00 INFO BlockManagerInfo: Added broadcast_131_piece0 in memory on hostName:51773 (size: 2.7 KB, free: 7.8 GB) 17/03/01 04:14:00 INFO BlockManagerInfo: Added broadcast_131_piece0 in memory on hostName:40903 (size: 2.7 KB, free: 7.8 GB) 17/03/01 04:14:00 INFO BlockManagerInfo: Added broadcast_131_piece0 in memory on hostName:56293 (size: 2.7 KB, free: 7.8 GB) 17/03/01 04:14:00 INFO BlockManagerInfo: Added broadcast_131_piece0 in memory on hostName:33016 (size: 2.7 KB, free: 7.8 GB) 17/03/01 04:14:00 INFO BlockManagerInfo: Added broadcast_131_piece0 in memory on hostName:49289 (size: 2.7 KB, free: 7.8 GB) 17/03/01 04:14:00 INFO BlockManagerInfo: Added broadcast_131_piece0 in memory on hostName:36400 (size: 2.7 KB, free: 7.8 GB) 17/03/01 04:14:00 INFO BlockManagerInfo: Added broadcast_131_piece0 in memory on hostName:60209 (size: 2.7 KB, free: 7.8 GB) 17/03/01 04:14:00 INFO BlockManagerInfo: Added broadcast_131_piece0 in memory on hostName:44721 (size: 2.7 KB, free: 7.8 GB) 17/03/01 04:14:00 INFO BlockManagerInfo: Added broadcast_131_piece0 in memory on hostName:46180 (size: 2.7 KB, free: 7.8 GB) 17/03/01 04:14:00 INFO BlockManagerInfo: Added broadcast_131_piece0 in memory on hostName:56606 (size: 2.7 KB, free: 7.8 GB) 17/03/01 04:14:02 INFO BlockManagerInfo: Removed broadcast_130_piece0 on ipaddress:43498 in memory (size: 1829.0 B, free: 19.2 GB) 17/03/01 04:14:02 INFO BlockManagerInfo: Removed broadcast_130_piece0 on hostName:57052 in memory (size: 1829.0 B, free: 7.8 GB) 17/03/01 04:14:02 INFO BlockManagerInfo: Removed broadcast_130_piece0 on hostName:56293 in memory (size: 1829.0 B, free: 7.8 GB) 17/03/01 04:14:02 INFO ContextCleaner: Cleaned accumulator 12 17/03/01 04:14:02 INFO BlockManagerInfo: Removed broadcast_129_piece0 on ipaddress:43498 in memory (size: 24.1 KB, free: 19.2 GB) 17/03/01 04:14:02 INFO BlockManagerInfo: Removed broadcast_129_piece0 on hostName:56293 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:14:02 INFO BlockManagerInfo: Removed broadcast_129_piece0 on hostName:57052 in memory (size: 24.1 KB, free: 7.8 GB) 17/03/01 04:14:04 INFO IgniteKernal%WCA: Metrics for local node (to disable set 'metricsLogFrequency' to 0) ^-- Node [id=6172ee3a, name=WCA, uptime=00:03:00:030] ^-- H/N/C [hosts=41, nodes=41, CPUs=1664] ^-- CPU [cur=7.1%, avg=1.09%, GC=0.23%] ^-- Heap [used=2322MB, free=93.62%, comm=5942MB] ^-- Non heap [used=144MB, free=-1%, comm=147MB] ^-- Public thread pool [active=0, idle=0, qSize=0] ^-- System thread pool [active=27, idle=60, qSize=0] ^-- Outbound messages queue [size=0] 17/03/01 04:14:09 WARN ThrowableSerializationWrapper: Task exception could not be deserialized java.lang.ClassNotFoundException: javax.cache.CacheException at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:348) at org.apache.spark.serializer.JavaDeserializationStream$$anon$1.resolveClass(JavaSerializer.scala:67) at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1613) at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1518) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1774) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.ThrowableSerializationWrapper.readObject(TaskEndReason.scala:167) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1017) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1900) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.serializer.JavaDeserializationStream.readObject(JavaSerializer.scala:72) at org.apache.spark.serializer.JavaSerializerInstance.deserialize(JavaSerializer.scala:98) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply$mcV$sp(TaskResultGetter.scala:108) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.util.Utils$.logUncaughtExceptions(Utils.scala:1698) at org.apache.spark.scheduler.TaskResultGetter$$anon$3.run(TaskResultGetter.scala:105) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 17/03/01 04:14:09 ERROR TaskResultGetter: Could not deserialize TaskEndReason: ClassNotFound with classloader org.apache.spark.util.MutableURLClassLoader@71f67a79 17/03/01 04:14:09 WARN TaskSetManager: Lost task 7.0 in stage 7.0 (TID 251, hostName): UnknownReason 17/03/01 04:14:09 INFO TaskSetManager: Starting task 7.1 in stage 7.0 (TID 284, hostName, partition 7,PROCESS_LOCAL, 2506 bytes) 17/03/01 04:14:10 WARN ThrowableSerializationWrapper: Task exception could not be deserialized java.lang.ClassNotFoundException: javax.cache.CacheException at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:348) at org.apache.spark.serializer.JavaDeserializationStream$$anon$1.resolveClass(JavaSerializer.scala:67) at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1613) at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1518) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1774) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.ThrowableSerializationWrapper.readObject(TaskEndReason.scala:167) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1017) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1900) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.serializer.JavaDeserializationStream.readObject(JavaSerializer.scala:72) at org.apache.spark.serializer.JavaSerializerInstance.deserialize(JavaSerializer.scala:98) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply$mcV$sp(TaskResultGetter.scala:108) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.util.Utils$.logUncaughtExceptions(Utils.scala:1698) at org.apache.spark.scheduler.TaskResultGetter$$anon$3.run(TaskResultGetter.scala:105) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 17/03/01 04:14:10 ERROR TaskResultGetter: Could not deserialize TaskEndReason: ClassNotFound with classloader org.apache.spark.util.MutableURLClassLoader@71f67a79 17/03/01 04:14:10 WARN TaskSetManager: Lost task 34.0 in stage 7.0 (TID 278, hostName): UnknownReason 17/03/01 04:14:10 INFO TaskSetManager: Starting task 34.1 in stage 7.0 (TID 285, hostName, partition 34,PROCESS_LOCAL, 2503 bytes) 17/03/01 04:14:10 WARN ThrowableSerializationWrapper: Task exception could not be deserialized java.lang.ClassNotFoundException: javax.cache.CacheException at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:348) at org.apache.spark.serializer.JavaDeserializationStream$$anon$1.resolveClass(JavaSerializer.scala:67) at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1613) at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1518) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1774) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.ThrowableSerializationWrapper.readObject(TaskEndReason.scala:167) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1017) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1900) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.serializer.JavaDeserializationStream.readObject(JavaSerializer.scala:72) at org.apache.spark.serializer.JavaSerializerInstance.deserialize(JavaSerializer.scala:98) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply$mcV$sp(TaskResultGetter.scala:108) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.util.Utils$.logUncaughtExceptions(Utils.scala:1698) at org.apache.spark.scheduler.TaskResultGetter$$anon$3.run(TaskResultGetter.scala:105) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 17/03/01 04:14:10 ERROR TaskResultGetter: Could not deserialize TaskEndReason: ClassNotFound with classloader org.apache.spark.util.MutableURLClassLoader@71f67a79 17/03/01 04:14:10 WARN TaskSetManager: Lost task 20.0 in stage 7.0 (TID 264, hostName): UnknownReason 17/03/01 04:14:10 INFO TaskSetManager: Starting task 20.1 in stage 7.0 (TID 286, hostName, partition 20,PROCESS_LOCAL, 2501 bytes) 17/03/01 04:14:10 WARN ThrowableSerializationWrapper: Task exception could not be deserialized java.lang.ClassNotFoundException: javax.cache.CacheException at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:348) at org.apache.spark.serializer.JavaDeserializationStream$$anon$1.resolveClass(JavaSerializer.scala:67) at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1613) at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1518) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1774) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.ThrowableSerializationWrapper.readObject(TaskEndReason.scala:167) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1017) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1900) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.serializer.JavaDeserializationStream.readObject(JavaSerializer.scala:72) at org.apache.spark.serializer.JavaSerializerInstance.deserialize(JavaSerializer.scala:98) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply$mcV$sp(TaskResultGetter.scala:108) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.util.Utils$.logUncaughtExceptions(Utils.scala:1698) at org.apache.spark.scheduler.TaskResultGetter$$anon$3.run(TaskResultGetter.scala:105) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 17/03/01 04:14:10 ERROR TaskResultGetter: Could not deserialize TaskEndReason: ClassNotFound with classloader org.apache.spark.util.MutableURLClassLoader@71f67a79 17/03/01 04:14:10 WARN TaskSetManager: Lost task 12.0 in stage 7.0 (TID 256, hostName): UnknownReason 17/03/01 04:14:10 INFO TaskSetManager: Starting task 12.1 in stage 7.0 (TID 287, hostName, partition 12,PROCESS_LOCAL, 2495 bytes) 17/03/01 04:14:10 WARN ThrowableSerializationWrapper: Task exception could not be deserialized java.lang.ClassNotFoundException: javax.cache.CacheException at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:348) at org.apache.spark.serializer.JavaDeserializationStream$$anon$1.resolveClass(JavaSerializer.scala:67) at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1613) at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1518) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1774) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.ThrowableSerializationWrapper.readObject(TaskEndReason.scala:167) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1017) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1900) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.serializer.JavaDeserializationStream.readObject(JavaSerializer.scala:72) at org.apache.spark.serializer.JavaSerializerInstance.deserialize(JavaSerializer.scala:98) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply$mcV$sp(TaskResultGetter.scala:108) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.util.Utils$.logUncaughtExceptions(Utils.scala:1698) at org.apache.spark.scheduler.TaskResultGetter$$anon$3.run(TaskResultGetter.scala:105) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 17/03/01 04:14:10 ERROR TaskResultGetter: Could not deserialize TaskEndReason: ClassNotFound with classloader org.apache.spark.util.MutableURLClassLoader@71f67a79 17/03/01 04:14:10 WARN TaskSetManager: Lost task 0.0 in stage 7.0 (TID 244, hostName): UnknownReason 17/03/01 04:14:10 INFO TaskSetManager: Starting task 0.1 in stage 7.0 (TID 288, hostName, partition 0,PROCESS_LOCAL, 2511 bytes) 17/03/01 04:14:10 WARN ThrowableSerializationWrapper: Task exception could not be deserialized java.lang.ClassNotFoundException: javax.cache.CacheException at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:348) at org.apache.spark.serializer.JavaDeserializationStream$$anon$1.resolveClass(JavaSerializer.scala:67) at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1613) at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1518) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1774) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.ThrowableSerializationWrapper.readObject(TaskEndReason.scala:167) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1017) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1900) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.serializer.JavaDeserializationStream.readObject(JavaSerializer.scala:72) at org.apache.spark.serializer.JavaSerializerInstance.deserialize(JavaSerializer.scala:98) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply$mcV$sp(TaskResultGetter.scala:108) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.util.Utils$.logUncaughtExceptions(Utils.scala:1698) at org.apache.spark.scheduler.TaskResultGetter$$anon$3.run(TaskResultGetter.scala:105) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 17/03/01 04:14:10 ERROR TaskResultGetter: Could not deserialize TaskEndReason: ClassNotFound with classloader org.apache.spark.util.MutableURLClassLoader@71f67a79 17/03/01 04:14:10 WARN TaskSetManager: Lost task 31.0 in stage 7.0 (TID 275, hostName): UnknownReason 17/03/01 04:14:10 INFO TaskSetManager: Starting task 31.1 in stage 7.0 (TID 289, hostName, partition 31,PROCESS_LOCAL, 2506 bytes) 17/03/01 04:14:11 WARN ThrowableSerializationWrapper: Task exception could not be deserialized java.lang.ClassNotFoundException: javax.cache.CacheException at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:348) at org.apache.spark.serializer.JavaDeserializationStream$$anon$1.resolveClass(JavaSerializer.scala:67) at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1613) at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1518) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1774) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.ThrowableSerializationWrapper.readObject(TaskEndReason.scala:167) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1017) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1900) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.serializer.JavaDeserializationStream.readObject(JavaSerializer.scala:72) at org.apache.spark.serializer.JavaSerializerInstance.deserialize(JavaSerializer.scala:98) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply$mcV$sp(TaskResultGetter.scala:108) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.util.Utils$.logUncaughtExceptions(Utils.scala:1698) at org.apache.spark.scheduler.TaskResultGetter$$anon$3.run(TaskResultGetter.scala:105) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 17/03/01 04:14:11 ERROR TaskResultGetter: Could not deserialize TaskEndReason: ClassNotFound with classloader org.apache.spark.util.MutableURLClassLoader@71f67a79 17/03/01 04:14:11 WARN TaskSetManager: Lost task 22.0 in stage 7.0 (TID 266, hostName): UnknownReason 17/03/01 04:14:11 INFO TaskSetManager: Starting task 22.1 in stage 7.0 (TID 290, hostName, partition 22,PROCESS_LOCAL, 2506 bytes) 17/03/01 04:14:11 WARN ThrowableSerializationWrapper: Task exception could not be deserialized java.lang.ClassNotFoundException: javax.cache.CacheException at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:348) at org.apache.spark.serializer.JavaDeserializationStream$$anon$1.resolveClass(JavaSerializer.scala:67) at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1613) at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1518) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1774) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.ThrowableSerializationWrapper.readObject(TaskEndReason.scala:167) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1017) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1900) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.serializer.JavaDeserializationStream.readObject(JavaSerializer.scala:72) at org.apache.spark.serializer.JavaSerializerInstance.deserialize(JavaSerializer.scala:98) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply$mcV$sp(TaskResultGetter.scala:108) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.util.Utils$.logUncaughtExceptions(Utils.scala:1698) at org.apache.spark.scheduler.TaskResultGetter$$anon$3.run(TaskResultGetter.scala:105) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 17/03/01 04:14:11 ERROR TaskResultGetter: Could not deserialize TaskEndReason: ClassNotFound with classloader org.apache.spark.util.MutableURLClassLoader@71f67a79 17/03/01 04:14:11 WARN TaskSetManager: Lost task 38.0 in stage 7.0 (TID 282, hostName): UnknownReason 17/03/01 04:14:11 INFO TaskSetManager: Starting task 38.1 in stage 7.0 (TID 291, hostName, partition 38,PROCESS_LOCAL, 2501 bytes) 17/03/01 04:14:11 WARN ThrowableSerializationWrapper: Task exception could not be deserialized java.lang.ClassNotFoundException: javax.cache.CacheException at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:348) at org.apache.spark.serializer.JavaDeserializationStream$$anon$1.resolveClass(JavaSerializer.scala:67) at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1613) at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1518) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1774) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.ThrowableSerializationWrapper.readObject(TaskEndReason.scala:167) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1017) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1900) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.serializer.JavaDeserializationStream.readObject(JavaSerializer.scala:72) at org.apache.spark.serializer.JavaSerializerInstance.deserialize(JavaSerializer.scala:98) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply$mcV$sp(TaskResultGetter.scala:108) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.util.Utils$.logUncaughtExceptions(Utils.scala:1698) at org.apache.spark.scheduler.TaskResultGetter$$anon$3.run(TaskResultGetter.scala:105) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 17/03/01 04:14:11 ERROR TaskResultGetter: Could not deserialize TaskEndReason: ClassNotFound with classloader org.apache.spark.util.MutableURLClassLoader@71f67a79 17/03/01 04:14:11 WARN TaskSetManager: Lost task 14.0 in stage 7.0 (TID 258, hostName): UnknownReason 17/03/01 04:14:11 INFO TaskSetManager: Starting task 14.1 in stage 7.0 (TID 292, hostName, partition 14,PROCESS_LOCAL, 2506 bytes) 17/03/01 04:14:11 WARN ThrowableSerializationWrapper: Task exception could not be deserialized java.lang.ClassNotFoundException: javax.cache.CacheException at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:348) at org.apache.spark.serializer.JavaDeserializationStream$$anon$1.resolveClass(JavaSerializer.scala:67) at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1613) at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1518) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1774) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.ThrowableSerializationWrapper.readObject(TaskEndReason.scala:167) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1017) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1900) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.serializer.JavaDeserializationStream.readObject(JavaSerializer.scala:72) at org.apache.spark.serializer.JavaSerializerInstance.deserialize(JavaSerializer.scala:98) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply$mcV$sp(TaskResultGetter.scala:108) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.util.Utils$.logUncaughtExceptions(Utils.scala:1698) at org.apache.spark.scheduler.TaskResultGetter$$anon$3.run(TaskResultGetter.scala:105) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 17/03/01 04:14:11 ERROR TaskResultGetter: Could not deserialize TaskEndReason: ClassNotFound with classloader org.apache.spark.util.MutableURLClassLoader@71f67a79 17/03/01 04:14:11 WARN TaskSetManager: Lost task 9.0 in stage 7.0 (TID 253, hostName): UnknownReason 17/03/01 04:14:11 INFO TaskSetManager: Starting task 9.1 in stage 7.0 (TID 293, hostName, partition 9,PROCESS_LOCAL, 2506 bytes) 17/03/01 04:14:11 WARN ThrowableSerializationWrapper: Task exception could not be deserialized java.lang.ClassNotFoundException: javax.cache.CacheException at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:348) at org.apache.spark.serializer.JavaDeserializationStream$$anon$1.resolveClass(JavaSerializer.scala:67) at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1613) at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1518) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1774) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.ThrowableSerializationWrapper.readObject(TaskEndReason.scala:167) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1017) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1900) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.serializer.JavaDeserializationStream.readObject(JavaSerializer.scala:72) at org.apache.spark.serializer.JavaSerializerInstance.deserialize(JavaSerializer.scala:98) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply$mcV$sp(TaskResultGetter.scala:108) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.util.Utils$.logUncaughtExceptions(Utils.scala:1698) at org.apache.spark.scheduler.TaskResultGetter$$anon$3.run(TaskResultGetter.scala:105) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 17/03/01 04:14:11 ERROR TaskResultGetter: Could not deserialize TaskEndReason: ClassNotFound with classloader org.apache.spark.util.MutableURLClassLoader@71f67a79 17/03/01 04:14:11 WARN TaskSetManager: Lost task 30.0 in stage 7.0 (TID 274, hostName): UnknownReason 17/03/01 04:14:11 INFO TaskSetManager: Starting task 30.1 in stage 7.0 (TID 294, hostName, partition 30,PROCESS_LOCAL, 2498 bytes) 17/03/01 04:14:11 WARN ThrowableSerializationWrapper: Task exception could not be deserialized java.lang.ClassNotFoundException: javax.cache.CacheException at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:348) at org.apache.spark.serializer.JavaDeserializationStream$$anon$1.resolveClass(JavaSerializer.scala:67) at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1613) at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1518) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1774) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.ThrowableSerializationWrapper.readObject(TaskEndReason.scala:167) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1017) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1900) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.serializer.JavaDeserializationStream.readObject(JavaSerializer.scala:72) at org.apache.spark.serializer.JavaSerializerInstance.deserialize(JavaSerializer.scala:98) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply$mcV$sp(TaskResultGetter.scala:108) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.util.Utils$.logUncaughtExceptions(Utils.scala:1698) at org.apache.spark.scheduler.TaskResultGetter$$anon$3.run(TaskResultGetter.scala:105) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 17/03/01 04:14:11 ERROR TaskResultGetter: Could not deserialize TaskEndReason: ClassNotFound with classloader org.apache.spark.util.MutableURLClassLoader@71f67a79 17/03/01 04:14:11 WARN TaskSetManager: Lost task 27.0 in stage 7.0 (TID 271, hostName): UnknownReason 17/03/01 04:14:11 INFO TaskSetManager: Starting task 27.1 in stage 7.0 (TID 295, hostName, partition 27,PROCESS_LOCAL, 2501 bytes) 17/03/01 04:14:11 WARN ThrowableSerializationWrapper: Task exception could not be deserialized java.lang.ClassNotFoundException: javax.cache.CacheException at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:348) at org.apache.spark.serializer.JavaDeserializationStream$$anon$1.resolveClass(JavaSerializer.scala:67) at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1613) at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1518) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1774) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.ThrowableSerializationWrapper.readObject(TaskEndReason.scala:167) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1017) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1900) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.serializer.JavaDeserializationStream.readObject(JavaSerializer.scala:72) at org.apache.spark.serializer.JavaSerializerInstance.deserialize(JavaSerializer.scala:98) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply$mcV$sp(TaskResultGetter.scala:108) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.util.Utils$.logUncaughtExceptions(Utils.scala:1698) at org.apache.spark.scheduler.TaskResultGetter$$anon$3.run(TaskResultGetter.scala:105) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 17/03/01 04:14:11 ERROR TaskResultGetter: Could not deserialize TaskEndReason: ClassNotFound with classloader org.apache.spark.util.MutableURLClassLoader@71f67a79 17/03/01 04:14:11 WARN TaskSetManager: Lost task 16.0 in stage 7.0 (TID 260, hostName): UnknownReason 17/03/01 04:14:11 INFO TaskSetManager: Starting task 16.1 in stage 7.0 (TID 296, hostName, partition 16,PROCESS_LOCAL, 2506 bytes) 17/03/01 04:14:11 WARN ThrowableSerializationWrapper: Task exception could not be deserialized java.lang.ClassNotFoundException: javax.cache.CacheException at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:348) at org.apache.spark.serializer.JavaDeserializationStream$$anon$1.resolveClass(JavaSerializer.scala:67) at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1613) at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1518) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1774) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.ThrowableSerializationWrapper.readObject(TaskEndReason.scala:167) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1017) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1900) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.serializer.JavaDeserializationStream.readObject(JavaSerializer.scala:72) at org.apache.spark.serializer.JavaSerializerInstance.deserialize(JavaSerializer.scala:98) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply$mcV$sp(TaskResultGetter.scala:108) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.util.Utils$.logUncaughtExceptions(Utils.scala:1698) at org.apache.spark.scheduler.TaskResultGetter$$anon$3.run(TaskResultGetter.scala:105) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 17/03/01 04:14:11 ERROR TaskResultGetter: Could not deserialize TaskEndReason: ClassNotFound with classloader org.apache.spark.util.MutableURLClassLoader@71f67a79 17/03/01 04:14:11 WARN TaskSetManager: Lost task 26.0 in stage 7.0 (TID 270, hostName): UnknownReason 17/03/01 04:14:11 INFO TaskSetManager: Starting task 26.1 in stage 7.0 (TID 297, hostName, partition 26,PROCESS_LOCAL, 2511 bytes) 17/03/01 04:14:11 WARN ThrowableSerializationWrapper: Task exception could not be deserialized java.lang.ClassNotFoundException: javax.cache.CacheException at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:348) at org.apache.spark.serializer.JavaDeserializationStream$$anon$1.resolveClass(JavaSerializer.scala:67) at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1613) at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1518) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1774) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.ThrowableSerializationWrapper.readObject(TaskEndReason.scala:167) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1017) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1900) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.serializer.JavaDeserializationStream.readObject(JavaSerializer.scala:72) at org.apache.spark.serializer.JavaSerializerInstance.deserialize(JavaSerializer.scala:98) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply$mcV$sp(TaskResultGetter.scala:108) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.util.Utils$.logUncaughtExceptions(Utils.scala:1698) at org.apache.spark.scheduler.TaskResultGetter$$anon$3.run(TaskResultGetter.scala:105) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 17/03/01 04:14:11 ERROR TaskResultGetter: Could not deserialize TaskEndReason: ClassNotFound with classloader org.apache.spark.util.MutableURLClassLoader@71f67a79 17/03/01 04:14:11 WARN TaskSetManager: Lost task 18.0 in stage 7.0 (TID 262, hostName): UnknownReason 17/03/01 04:14:11 INFO TaskSetManager: Starting task 18.1 in stage 7.0 (TID 298, hostName, partition 18,PROCESS_LOCAL, 2508 bytes) 17/03/01 04:14:11 WARN ThrowableSerializationWrapper: Task exception could not be deserialized java.lang.ClassNotFoundException: javax.cache.CacheException at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:348) at org.apache.spark.serializer.JavaDeserializationStream$$anon$1.resolveClass(JavaSerializer.scala:67) at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1613) at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1518) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1774) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.ThrowableSerializationWrapper.readObject(TaskEndReason.scala:167) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1017) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1900) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.serializer.JavaDeserializationStream.readObject(JavaSerializer.scala:72) at org.apache.spark.serializer.JavaSerializerInstance.deserialize(JavaSerializer.scala:98) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply$mcV$sp(TaskResultGetter.scala:108) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.util.Utils$.logUncaughtExceptions(Utils.scala:1698) at org.apache.spark.scheduler.TaskResultGetter$$anon$3.run(TaskResultGetter.scala:105) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 17/03/01 04:14:11 ERROR TaskResultGetter: Could not deserialize TaskEndReason: ClassNotFound with classloader org.apache.spark.util.MutableURLClassLoader@71f67a79 17/03/01 04:14:11 WARN TaskSetManager: Lost task 6.0 in stage 7.0 (TID 250, hostName): UnknownReason 17/03/01 04:14:11 INFO TaskSetManager: Starting task 6.1 in stage 7.0 (TID 299, hostName, partition 6,PROCESS_LOCAL, 2509 bytes) 17/03/01 04:14:11 WARN ThrowableSerializationWrapper: Task exception could not be deserialized java.lang.ClassNotFoundException: javax.cache.CacheException at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:348) at org.apache.spark.serializer.JavaDeserializationStream$$anon$1.resolveClass(JavaSerializer.scala:67) at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1613) at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1518) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1774) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.ThrowableSerializationWrapper.readObject(TaskEndReason.scala:167) at sun.reflect.GeneratedMethodAccessor443.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1017) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1900) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.serializer.JavaDeserializationStream.readObject(JavaSerializer.scala:72) at org.apache.spark.serializer.JavaSerializerInstance.deserialize(JavaSerializer.scala:98) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply$mcV$sp(TaskResultGetter.scala:108) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.util.Utils$.logUncaughtExceptions(Utils.scala:1698) at org.apache.spark.scheduler.TaskResultGetter$$anon$3.run(TaskResultGetter.scala:105) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 17/03/01 04:14:11 ERROR TaskResultGetter: Could not deserialize TaskEndReason: ClassNotFound with classloader org.apache.spark.util.MutableURLClassLoader@71f67a79 17/03/01 04:14:11 WARN TaskSetManager: Lost task 25.0 in stage 7.0 (TID 269, hostName): UnknownReason 17/03/01 04:14:11 INFO TaskSetManager: Starting task 25.1 in stage 7.0 (TID 300, hostName, partition 25,PROCESS_LOCAL, 2501 bytes) 17/03/01 04:14:11 WARN ThrowableSerializationWrapper: Task exception could not be deserialized java.lang.ClassNotFoundException: javax.cache.CacheException at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:348) at org.apache.spark.serializer.JavaDeserializationStream$$anon$1.resolveClass(JavaSerializer.scala:67) at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1613) at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1518) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1774) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.ThrowableSerializationWrapper.readObject(TaskEndReason.scala:167) at sun.reflect.GeneratedMethodAccessor443.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1017) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1900) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.serializer.JavaDeserializationStream.readObject(JavaSerializer.scala:72) at org.apache.spark.serializer.JavaSerializerInstance.deserialize(JavaSerializer.scala:98) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply$mcV$sp(TaskResultGetter.scala:108) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.util.Utils$.logUncaughtExceptions(Utils.scala:1698) at org.apache.spark.scheduler.TaskResultGetter$$anon$3.run(TaskResultGetter.scala:105) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 17/03/01 04:14:11 ERROR TaskResultGetter: Could not deserialize TaskEndReason: ClassNotFound with classloader org.apache.spark.util.MutableURLClassLoader@71f67a79 17/03/01 04:14:11 WARN TaskSetManager: Lost task 5.0 in stage 7.0 (TID 249, hostName): UnknownReason 17/03/01 04:14:11 INFO TaskSetManager: Starting task 5.1 in stage 7.0 (TID 301, hostName, partition 5,PROCESS_LOCAL, 2503 bytes) 17/03/01 04:14:11 WARN ThrowableSerializationWrapper: Task exception could not be deserialized java.lang.ClassNotFoundException: javax.cache.CacheException at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:348) at org.apache.spark.serializer.JavaDeserializationStream$$anon$1.resolveClass(JavaSerializer.scala:67) at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1613) at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1518) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1774) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.ThrowableSerializationWrapper.readObject(TaskEndReason.scala:167) at sun.reflect.GeneratedMethodAccessor443.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1017) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1900) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.serializer.JavaDeserializationStream.readObject(JavaSerializer.scala:72) at org.apache.spark.serializer.JavaSerializerInstance.deserialize(JavaSerializer.scala:98) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply$mcV$sp(TaskResultGetter.scala:108) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.util.Utils$.logUncaughtExceptions(Utils.scala:1698) at org.apache.spark.scheduler.TaskResultGetter$$anon$3.run(TaskResultGetter.scala:105) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 17/03/01 04:14:11 ERROR TaskResultGetter: Could not deserialize TaskEndReason: ClassNotFound with classloader org.apache.spark.util.MutableURLClassLoader@71f67a79 17/03/01 04:14:11 WARN TaskSetManager: Lost task 13.0 in stage 7.0 (TID 257, hostName): UnknownReason 17/03/01 04:14:11 INFO TaskSetManager: Starting task 13.1 in stage 7.0 (TID 302, hostName, partition 13,PROCESS_LOCAL, 2508 bytes) 17/03/01 04:14:11 WARN ThrowableSerializationWrapper: Task exception could not be deserialized java.lang.ClassNotFoundException: javax.cache.CacheException at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:348) at org.apache.spark.serializer.JavaDeserializationStream$$anon$1.resolveClass(JavaSerializer.scala:67) at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1613) at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1518) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1774) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.ThrowableSerializationWrapper.readObject(TaskEndReason.scala:167) at sun.reflect.GeneratedMethodAccessor443.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1017) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1900) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.serializer.JavaDeserializationStream.readObject(JavaSerializer.scala:72) at org.apache.spark.serializer.JavaSerializerInstance.deserialize(JavaSerializer.scala:98) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply$mcV$sp(TaskResultGetter.scala:108) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.util.Utils$.logUncaughtExceptions(Utils.scala:1698) at org.apache.spark.scheduler.TaskResultGetter$$anon$3.run(TaskResultGetter.scala:105) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 17/03/01 04:14:11 ERROR TaskResultGetter: Could not deserialize TaskEndReason: ClassNotFound with classloader org.apache.spark.util.MutableURLClassLoader@71f67a79 17/03/01 04:14:11 WARN TaskSetManager: Lost task 23.0 in stage 7.0 (TID 267, hostName): UnknownReason 17/03/01 04:14:11 INFO TaskSetManager: Starting task 23.1 in stage 7.0 (TID 303, hostName, partition 23,PROCESS_LOCAL, 2498 bytes) 17/03/01 04:14:11 WARN ThrowableSerializationWrapper: Task exception could not be deserialized java.lang.ClassNotFoundException: javax.cache.CacheException at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:348) at org.apache.spark.serializer.JavaDeserializationStream$$anon$1.resolveClass(JavaSerializer.scala:67) at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1613) at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1518) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1774) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.ThrowableSerializationWrapper.readObject(TaskEndReason.scala:167) at sun.reflect.GeneratedMethodAccessor443.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1017) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1900) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.serializer.JavaDeserializationStream.readObject(JavaSerializer.scala:72) at org.apache.spark.serializer.JavaSerializerInstance.deserialize(JavaSerializer.scala:98) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply$mcV$sp(TaskResultGetter.scala:108) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.util.Utils$.logUncaughtExceptions(Utils.scala:1698) at org.apache.spark.scheduler.TaskResultGetter$$anon$3.run(TaskResultGetter.scala:105) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 17/03/01 04:14:11 ERROR TaskResultGetter: Could not deserialize TaskEndReason: ClassNotFound with classloader org.apache.spark.util.MutableURLClassLoader@71f67a79 17/03/01 04:14:11 WARN TaskSetManager: Lost task 17.0 in stage 7.0 (TID 261, hostName): UnknownReason 17/03/01 04:14:11 INFO TaskSetManager: Starting task 17.1 in stage 7.0 (TID 304, hostName, partition 17,PROCESS_LOCAL, 2506 bytes) 17/03/01 04:14:11 WARN ThrowableSerializationWrapper: Task exception could not be deserialized java.lang.ClassNotFoundException: javax.cache.CacheException at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:348) at org.apache.spark.serializer.JavaDeserializationStream$$anon$1.resolveClass(JavaSerializer.scala:67) at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1613) at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1518) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1774) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.ThrowableSerializationWrapper.readObject(TaskEndReason.scala:167) at sun.reflect.GeneratedMethodAccessor443.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1017) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1900) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.serializer.JavaDeserializationStream.readObject(JavaSerializer.scala:72) at org.apache.spark.serializer.JavaSerializerInstance.deserialize(JavaSerializer.scala:98) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply$mcV$sp(TaskResultGetter.scala:108) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.util.Utils$.logUncaughtExceptions(Utils.scala:1698) at org.apache.spark.scheduler.TaskResultGetter$$anon$3.run(TaskResultGetter.scala:105) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 17/03/01 04:14:11 ERROR TaskResultGetter: Could not deserialize TaskEndReason: ClassNotFound with classloader org.apache.spark.util.MutableURLClassLoader@71f67a79 17/03/01 04:14:11 WARN TaskSetManager: Lost task 33.0 in stage 7.0 (TID 277, hostName): UnknownReason 17/03/01 04:14:11 INFO TaskSetManager: Starting task 33.1 in stage 7.0 (TID 305, hostName, partition 33,PROCESS_LOCAL, 2501 bytes) 17/03/01 04:14:11 WARN ThrowableSerializationWrapper: Task exception could not be deserialized java.lang.ClassNotFoundException: javax.cache.CacheException at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:348) at org.apache.spark.serializer.JavaDeserializationStream$$anon$1.resolveClass(JavaSerializer.scala:67) at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1613) at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1518) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1774) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.ThrowableSerializationWrapper.readObject(TaskEndReason.scala:167) at sun.reflect.GeneratedMethodAccessor443.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1017) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1900) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.serializer.JavaDeserializationStream.readObject(JavaSerializer.scala:72) at org.apache.spark.serializer.JavaSerializerInstance.deserialize(JavaSerializer.scala:98) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply$mcV$sp(TaskResultGetter.scala:108) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.util.Utils$.logUncaughtExceptions(Utils.scala:1698) at org.apache.spark.scheduler.TaskResultGetter$$anon$3.run(TaskResultGetter.scala:105) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 17/03/01 04:14:11 ERROR TaskResultGetter: Could not deserialize TaskEndReason: ClassNotFound with classloader org.apache.spark.util.MutableURLClassLoader@71f67a79 17/03/01 04:14:11 WARN TaskSetManager: Lost task 1.0 in stage 7.0 (TID 245, hostName): UnknownReason 17/03/01 04:14:11 WARN ThrowableSerializationWrapper: Task exception could not be deserialized java.lang.ClassNotFoundException: javax.cache.CacheException at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:348) at org.apache.spark.serializer.JavaDeserializationStream$$anon$1.resolveClass(JavaSerializer.scala:67) at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1613) at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1518) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1774) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.ThrowableSerializationWrapper.readObject(TaskEndReason.scala:167) at sun.reflect.GeneratedMethodAccessor443.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1017) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1900) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.serializer.JavaDeserializationStream.readObject(JavaSerializer.scala:72) at org.apache.spark.serializer.JavaSerializerInstance.deserialize(JavaSerializer.scala:98) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply$mcV$sp(TaskResultGetter.scala:108) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.util.Utils$.logUncaughtExceptions(Utils.scala:1698) at org.apache.spark.scheduler.TaskResultGetter$$anon$3.run(TaskResultGetter.scala:105) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 17/03/01 04:14:11 ERROR TaskResultGetter: Could not deserialize TaskEndReason: ClassNotFound with classloader org.apache.spark.util.MutableURLClassLoader@71f67a79 17/03/01 04:14:11 INFO TaskSetManager: Starting task 1.1 in stage 7.0 (TID 306, hostName, partition 1,PROCESS_LOCAL, 2498 bytes) 17/03/01 04:14:11 WARN TaskSetManager: Lost task 36.0 in stage 7.0 (TID 280, hostName): UnknownReason 17/03/01 04:14:11 INFO TaskSetManager: Starting task 36.1 in stage 7.0 (TID 307, hostName, partition 36,PROCESS_LOCAL, 2503 bytes) 17/03/01 04:14:11 WARN ThrowableSerializationWrapper: Task exception could not be deserialized java.lang.ClassNotFoundException: javax.cache.CacheException at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:348) at org.apache.spark.serializer.JavaDeserializationStream$$anon$1.resolveClass(JavaSerializer.scala:67) at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1613) at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1518) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1774) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.ThrowableSerializationWrapper.readObject(TaskEndReason.scala:167) at sun.reflect.GeneratedMethodAccessor443.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1017) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1900) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.serializer.JavaDeserializationStream.readObject(JavaSerializer.scala:72) at org.apache.spark.serializer.JavaSerializerInstance.deserialize(JavaSerializer.scala:98) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply$mcV$sp(TaskResultGetter.scala:108) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.util.Utils$.logUncaughtExceptions(Utils.scala:1698) at org.apache.spark.scheduler.TaskResultGetter$$anon$3.run(TaskResultGetter.scala:105) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 17/03/01 04:14:11 ERROR TaskResultGetter: Could not deserialize TaskEndReason: ClassNotFound with classloader org.apache.spark.util.MutableURLClassLoader@71f67a79 17/03/01 04:14:11 WARN TaskSetManager: Lost task 2.0 in stage 7.0 (TID 246, hostName): UnknownReason 17/03/01 04:14:11 INFO TaskSetManager: Starting task 2.1 in stage 7.0 (TID 308, hostName, partition 2,PROCESS_LOCAL, 2506 bytes) 17/03/01 04:14:12 WARN ThrowableSerializationWrapper: Task exception could not be deserialized java.lang.ClassNotFoundException: javax.cache.CacheException at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:348) at org.apache.spark.serializer.JavaDeserializationStream$$anon$1.resolveClass(JavaSerializer.scala:67) at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1613) at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1518) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1774) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.ThrowableSerializationWrapper.readObject(TaskEndReason.scala:167) at sun.reflect.GeneratedMethodAccessor443.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1017) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1900) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.serializer.JavaDeserializationStream.readObject(JavaSerializer.scala:72) at org.apache.spark.serializer.JavaSerializerInstance.deserialize(JavaSerializer.scala:98) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply$mcV$sp(TaskResultGetter.scala:108) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.util.Utils$.logUncaughtExceptions(Utils.scala:1698) at org.apache.spark.scheduler.TaskResultGetter$$anon$3.run(TaskResultGetter.scala:105) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 17/03/01 04:14:12 ERROR TaskResultGetter: Could not deserialize TaskEndReason: ClassNotFound with classloader org.apache.spark.util.MutableURLClassLoader@71f67a79 17/03/01 04:14:12 WARN TaskSetManager: Lost task 8.0 in stage 7.0 (TID 252, hostName): UnknownReason 17/03/01 04:14:12 INFO TaskSetManager: Starting task 8.1 in stage 7.0 (TID 309, hostName, partition 8,PROCESS_LOCAL, 2505 bytes) 17/03/01 04:14:12 WARN ThrowableSerializationWrapper: Task exception could not be deserialized java.lang.ClassNotFoundException: javax.cache.CacheException at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:348) at org.apache.spark.serializer.JavaDeserializationStream$$anon$1.resolveClass(JavaSerializer.scala:67) at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1613) at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1518) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1774) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.ThrowableSerializationWrapper.readObject(TaskEndReason.scala:167) at sun.reflect.GeneratedMethodAccessor443.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1017) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1900) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.serializer.JavaDeserializationStream.readObject(JavaSerializer.scala:72) at org.apache.spark.serializer.JavaSerializerInstance.deserialize(JavaSerializer.scala:98) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply$mcV$sp(TaskResultGetter.scala:108) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.util.Utils$.logUncaughtExceptions(Utils.scala:1698) at org.apache.spark.scheduler.TaskResultGetter$$anon$3.run(TaskResultGetter.scala:105) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 17/03/01 04:14:12 ERROR TaskResultGetter: Could not deserialize TaskEndReason: ClassNotFound with classloader org.apache.spark.util.MutableURLClassLoader@71f67a79 17/03/01 04:14:12 WARN TaskSetManager: Lost task 37.0 in stage 7.0 (TID 281, hostName): UnknownReason 17/03/01 04:14:12 INFO TaskSetManager: Starting task 37.1 in stage 7.0 (TID 310, hostName, partition 37,PROCESS_LOCAL, 2506 bytes) 17/03/01 04:14:12 WARN ThrowableSerializationWrapper: Task exception could not be deserialized java.lang.ClassNotFoundException: javax.cache.CacheException at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:348) at org.apache.spark.serializer.JavaDeserializationStream$$anon$1.resolveClass(JavaSerializer.scala:67) at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1613) at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1518) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1774) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.ThrowableSerializationWrapper.readObject(TaskEndReason.scala:167) at sun.reflect.GeneratedMethodAccessor443.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1017) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1900) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.serializer.JavaDeserializationStream.readObject(JavaSerializer.scala:72) at org.apache.spark.serializer.JavaSerializerInstance.deserialize(JavaSerializer.scala:98) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply$mcV$sp(TaskResultGetter.scala:108) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.util.Utils$.logUncaughtExceptions(Utils.scala:1698) at org.apache.spark.scheduler.TaskResultGetter$$anon$3.run(TaskResultGetter.scala:105) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 17/03/01 04:14:12 ERROR TaskResultGetter: Could not deserialize TaskEndReason: ClassNotFound with classloader org.apache.spark.util.MutableURLClassLoader@71f67a79 17/03/01 04:14:12 WARN TaskSetManager: Lost task 32.0 in stage 7.0 (TID 276, hostName): UnknownReason 17/03/01 04:14:12 INFO TaskSetManager: Starting task 32.1 in stage 7.0 (TID 311, hostName, partition 32,PROCESS_LOCAL, 2506 bytes) 17/03/01 04:14:12 WARN ThrowableSerializationWrapper: Task exception could not be deserialized java.lang.ClassNotFoundException: javax.cache.CacheException at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:348) at org.apache.spark.serializer.JavaDeserializationStream$$anon$1.resolveClass(JavaSerializer.scala:67) at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1613) at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1518) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1774) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.ThrowableSerializationWrapper.readObject(TaskEndReason.scala:167) at sun.reflect.GeneratedMethodAccessor443.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1017) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1900) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.serializer.JavaDeserializationStream.readObject(JavaSerializer.scala:72) at org.apache.spark.serializer.JavaSerializerInstance.deserialize(JavaSerializer.scala:98) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply$mcV$sp(TaskResultGetter.scala:108) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$2.apply(TaskResultGetter.scala:105) at org.apache.spark.util.Utils$.logUncaughtExceptions(Utils.scala:1698) at org.apache.spark.scheduler.TaskResultGetter$$anon$3.run(TaskResultGetter.scala:105) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 17/03/01 04:14:12 ERROR TaskResultGetter: Could not deserialize TaskEndReason: ClassNotFound with classloader org.apache.spark.util.MutableURLClassLoader@71f67a79 17/03/01 04:14:12 WARN TaskSetManager: Lost task 3.0 in stage 7.0 (TID 247, hostName): UnknownReason 17/03/01 04:14:12 INFO TaskSetManager: Starting task 3.1 in stage 7.0 (TID 312, hostName, partition 3,PROCESS_LOCAL, 2506 bytes) 17/03/01 04:14:13 INFO TaskSetManager: Finished task 29.0 in stage 7.0 (TID 273) in 12794 ms on hostName (1/40) 17/03/01 04:14:15 INFO TaskSetManager: Finished task 39.0 in stage 7.0 (TID 283) in 15070 ms on hostName (2/40) 17/03/01 04:14:16 INFO TaskSetManager: Finished task 19.0 in stage 7.0 (TID 263) in 15739 ms on hostName (3/40) 17/03/01 04:14:17 INFO TaskSetManager: Finished task 12.1 in stage 7.0 (TID 287) in 6369 ms on hostName (4/40) 17/03/01 04:14:17 INFO TaskSetManager: Finished task 35.0 in stage 7.0 (TID 279) in 17163 ms on hostName (5/40) 17/03/01 04:14:17 INFO TaskSetManager: Finished task 30.1 in stage 7.0 (TID 294) in 6563 ms on hostName (6/40) 17/03/01 04:14:17 INFO TaskSetManager: Finished task 22.1 in stage 7.0 (TID 290) in 6696 ms on hostName (7/40) 17/03/01 04:14:19 INFO TaskSetManager: Finished task 14.1 in stage 7.0 (TID 292) in 8083 ms on hostName (8/40) 17/03/01 04:14:20 INFO TaskSetManager: Finished task 33.1 in stage 7.0 (TID 305) in 8453 ms on hostName (9/40) 17/03/01 04:14:20 INFO TaskSetManager: Finished task 38.1 in stage 7.0 (TID 291) in 9065 ms on hostName (10/40) 17/03/01 04:14:20 INFO TaskSetManager: Finished task 31.1 in stage 7.0 (TID 289) in 9203 ms on hostName (11/40) 17/03/01 04:14:20 INFO TaskSetManager: Finished task 24.0 in stage 7.0 (TID 268) in 19631 ms on hostName (12/40) 17/03/01 04:14:20 INFO TaskSetManager: Finished task 26.1 in stage 7.0 (TID 297) in 9365 ms on hostName (13/40) 17/03/01 04:14:20 INFO TaskSetManager: Finished task 9.1 in stage 7.0 (TID 293) in 9590 ms on hostName (14/40) 17/03/01 04:14:21 INFO TaskSetManager: Finished task 0.1 in stage 7.0 (TID 288) in 10728 ms on hostName (15/40) 17/03/01 04:14:22 INFO TaskSetManager: Finished task 28.0 in stage 7.0 (TID 272) in 21818 ms on hostName (16/40) 17/03/01 04:14:22 INFO TaskSetManager: Finished task 25.1 in stage 7.0 (TID 300) in 11005 ms on hostName (17/40) 17/03/01 04:14:22 INFO TaskSetManager: Finished task 27.1 in stage 7.0 (TID 295) in 11713 ms on hostName (18/40) 17/03/01 04:14:22 INFO TaskSetManager: Finished task 10.0 in stage 7.0 (TID 254) in 22381 ms on hostName (19/40) 17/03/01 04:14:23 INFO TaskSetManager: Finished task 37.1 in stage 7.0 (TID 310) in 10865 ms on hostName (20/40) 17/03/01 04:14:23 INFO TaskSetManager: Finished task 5.1 in stage 7.0 (TID 301) in 11941 ms on hostName (21/40) 17/03/01 04:14:23 INFO TaskSetManager: Finished task 34.1 in stage 7.0 (TID 285) in 13528 ms on hostName (22/40) 17/03/01 04:14:23 INFO TaskSetManager: Finished task 1.1 in stage 7.0 (TID 306) in 12322 ms on hostName (23/40) 17/03/01 04:14:23 INFO TaskSetManager: Finished task 21.0 in stage 7.0 (TID 265) in 23404 ms on hostName (24/40) 17/03/01 04:14:24 INFO TaskSetManager: Finished task 23.1 in stage 7.0 (TID 303) in 12861 ms on hostName (25/40) 17/03/01 04:14:25 INFO TaskSetManager: Finished task 7.1 in stage 7.0 (TID 284) in 16035 ms on hostName (26/40) 17/03/01 04:14:25 INFO TaskSetManager: Finished task 6.1 in stage 7.0 (TID 299) in 14645 ms on hostName (27/40) 17/03/01 04:14:25 INFO TaskSetManager: Finished task 3.1 in stage 7.0 (TID 312) in 13112 ms on hostName (28/40) 17/03/01 04:14:26 INFO TaskSetManager: Finished task 4.0 in stage 7.0 (TID 248) in 26057 ms on hostName (29/40) 17/03/01 04:14:27 INFO TaskSetManager: Finished task 11.0 in stage 7.0 (TID 255) in 26532 ms on hostName (30/40) 17/03/01 04:14:27 INFO TaskSetManager: Finished task 16.1 in stage 7.0 (TID 296) in 15861 ms on hostName (31/40) 17/03/01 04:14:27 INFO TaskSetManager: Finished task 15.0 in stage 7.0 (TID 259) in 26579 ms on hostName (32/40) 17/03/01 04:14:28 INFO TaskSetManager: Finished task 20.1 in stage 7.0 (TID 286) in 17788 ms on hostName (33/40) 17/03/01 04:14:28 INFO TaskSetManager: Finished task 13.1 in stage 7.0 (TID 302) in 16956 ms on hostName (34/40) 17/03/01 04:14:28 INFO TaskSetManager: Finished task 18.1 in stage 7.0 (TID 298) in 17347 ms on hostName (35/40) 17/03/01 04:14:28 INFO TaskSetManager: Finished task 8.1 in stage 7.0 (TID 309) in 16423 ms on hostName (36/40) 17/03/01 04:14:30 INFO TaskSetManager: Finished task 36.1 in stage 7.0 (TID 307) in 18493 ms on hostName (37/40) 17/03/01 04:14:30 INFO TaskSetManager: Finished task 32.1 in stage 7.0 (TID 311) in 17651 ms on hostName (38/40) 17/03/01 04:14:31 INFO TaskSetManager: Finished task 2.1 in stage 7.0 (TID 308) in 20202 ms on hostName (39/40) 17/03/01 04:14:49 INFO TaskSetManager: Finished task 17.1 in stage 7.0 (TID 304) in 38175 ms on hostName (40/40) 17/03/01 04:14:49 INFO DAGScheduler: ResultStage 7 (count at CompanyResolverSparkTest.scala:292) finished in 49.074 s 17/03/01 04:14:49 INFO YarnClusterScheduler: Removed TaskSet 7.0, whose tasks have all completed, from pool 17/03/01 04:14:49 INFO DAGScheduler: Job 6 finished: count at CompanyResolverSparkTest.scala:292, took 49.085361 s 17/03/01 04:14:49 INFO CompanyResolverSparkTest: Will stop Ignite nodes on 40 workers 17/03/01 04:14:49 INFO SparkContext: Starting job: foreachPartition at CompanyResolverSparkTest.scala:305 17/03/01 04:14:49 INFO DAGScheduler: Got job 7 (foreachPartition at CompanyResolverSparkTest.scala:305) with 40 output partitions 17/03/01 04:14:49 INFO DAGScheduler: Final stage: ResultStage 8(foreachPartition at CompanyResolverSparkTest.scala:305) 17/03/01 04:14:49 INFO DAGScheduler: Parents of final stage: List() 17/03/01 04:14:49 INFO DAGScheduler: Missing parents: List() 17/03/01 04:14:49 INFO DAGScheduler: Submitting ResultStage 8 (ParallelCollectionRDD[502] at parallelize at CompanyResolverSparkTest.scala:305), which has no missing parents 17/03/01 04:14:49 INFO MemoryStore: ensureFreeSpace(1232) called with curMem=15225539, maxMem=20615905935 17/03/01 04:14:49 INFO MemoryStore: Block broadcast_132 stored as values in memory (estimated size 1232.0 B, free 19.2 GB) 17/03/01 04:14:49 INFO MemoryStore: ensureFreeSpace(887) called with curMem=15226771, maxMem=20615905935 17/03/01 04:14:49 INFO MemoryStore: Block broadcast_132_piece0 stored as bytes in memory (estimated size 887.0 B, free 19.2 GB) 17/03/01 04:14:49 INFO BlockManagerInfo: Added broadcast_132_piece0 in memory on ipaddress:43498 (size: 887.0 B, free: 19.2 GB) 17/03/01 04:14:49 INFO SparkContext: Created broadcast 132 from broadcast at DAGScheduler.scala:861 17/03/01 04:14:49 INFO DAGScheduler: Submitting 40 missing tasks from ResultStage 8 (ParallelCollectionRDD[502] at parallelize at CompanyResolverSparkTest.scala:305) 17/03/01 04:14:49 INFO YarnClusterScheduler: Adding task set 8.0 with 40 tasks 17/03/01 04:14:49 INFO TaskSetManager: Starting task 0.0 in stage 8.0 (TID 313, hostName, partition 0,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:14:49 INFO TaskSetManager: Starting task 1.0 in stage 8.0 (TID 314, hostName, partition 1,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:14:49 INFO TaskSetManager: Starting task 2.0 in stage 8.0 (TID 315, hostName, partition 2,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:14:49 INFO TaskSetManager: Starting task 3.0 in stage 8.0 (TID 316, hostName, partition 3,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:14:49 INFO TaskSetManager: Starting task 4.0 in stage 8.0 (TID 317, hostName, partition 4,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:14:49 INFO TaskSetManager: Starting task 5.0 in stage 8.0 (TID 318, hostName, partition 5,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:14:49 INFO TaskSetManager: Starting task 6.0 in stage 8.0 (TID 319, hostName, partition 6,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:14:49 INFO TaskSetManager: Starting task 7.0 in stage 8.0 (TID 320, hostName, partition 7,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:14:49 INFO TaskSetManager: Starting task 8.0 in stage 8.0 (TID 321, hostName, partition 8,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:14:49 INFO TaskSetManager: Starting task 9.0 in stage 8.0 (TID 322, hostName, partition 9,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:14:49 INFO TaskSetManager: Starting task 10.0 in stage 8.0 (TID 323, hostName, partition 10,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:14:49 INFO TaskSetManager: Starting task 11.0 in stage 8.0 (TID 324, hostName, partition 11,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:14:49 INFO TaskSetManager: Starting task 12.0 in stage 8.0 (TID 325, hostName, partition 12,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:14:49 INFO TaskSetManager: Starting task 13.0 in stage 8.0 (TID 326, hostName, partition 13,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:14:49 INFO TaskSetManager: Starting task 14.0 in stage 8.0 (TID 327, hostName, partition 14,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:14:49 INFO TaskSetManager: Starting task 15.0 in stage 8.0 (TID 328, hostName, partition 15,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:14:49 INFO TaskSetManager: Starting task 16.0 in stage 8.0 (TID 329, hostName, partition 16,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:14:49 INFO TaskSetManager: Starting task 17.0 in stage 8.0 (TID 330, hostName, partition 17,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:14:49 INFO TaskSetManager: Starting task 18.0 in stage 8.0 (TID 331, hostName, partition 18,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:14:49 INFO TaskSetManager: Starting task 19.0 in stage 8.0 (TID 332, hostName, partition 19,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:14:49 INFO TaskSetManager: Starting task 20.0 in stage 8.0 (TID 333, hostName, partition 20,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:14:49 INFO TaskSetManager: Starting task 21.0 in stage 8.0 (TID 334, hostName, partition 21,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:14:49 INFO TaskSetManager: Starting task 22.0 in stage 8.0 (TID 335, hostName, partition 22,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:14:49 INFO TaskSetManager: Starting task 23.0 in stage 8.0 (TID 336, hostName, partition 23,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:14:49 INFO TaskSetManager: Starting task 24.0 in stage 8.0 (TID 337, hostName, partition 24,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:14:49 INFO TaskSetManager: Starting task 25.0 in stage 8.0 (TID 338, hostName, partition 25,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:14:49 INFO TaskSetManager: Starting task 26.0 in stage 8.0 (TID 339, hostName, partition 26,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:14:49 INFO TaskSetManager: Starting task 27.0 in stage 8.0 (TID 340, hostName, partition 27,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:14:49 INFO TaskSetManager: Starting task 28.0 in stage 8.0 (TID 341, hostName, partition 28,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:14:49 INFO TaskSetManager: Starting task 29.0 in stage 8.0 (TID 342, hostName, partition 29,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:14:49 INFO TaskSetManager: Starting task 30.0 in stage 8.0 (TID 343, hostName, partition 30,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:14:49 INFO TaskSetManager: Starting task 31.0 in stage 8.0 (TID 344, hostName, partition 31,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:14:49 INFO TaskSetManager: Starting task 32.0 in stage 8.0 (TID 345, hostName, partition 32,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:14:49 INFO TaskSetManager: Starting task 33.0 in stage 8.0 (TID 346, hostName, partition 33,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:14:49 INFO TaskSetManager: Starting task 34.0 in stage 8.0 (TID 347, hostName, partition 34,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:14:49 INFO TaskSetManager: Starting task 35.0 in stage 8.0 (TID 348, hostName, partition 35,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:14:49 INFO TaskSetManager: Starting task 36.0 in stage 8.0 (TID 349, hostName, partition 36,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:14:49 INFO TaskSetManager: Starting task 37.0 in stage 8.0 (TID 350, hostName, partition 37,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:14:49 INFO TaskSetManager: Starting task 38.0 in stage 8.0 (TID 351, hostName, partition 38,PROCESS_LOCAL, 2085 bytes) 17/03/01 04:14:49 INFO TaskSetManager: Starting task 39.0 in stage 8.0 (TID 352, hostName, partition 39,PROCESS_LOCAL, 2142 bytes) 17/03/01 04:14:49 INFO BlockManagerInfo: Added broadcast_132_piece0 in memory on hostName:49289 (size: 887.0 B, free: 7.8 GB) 17/03/01 04:14:49 INFO BlockManagerInfo: Added broadcast_132_piece0 in memory on hostName:45617 (size: 887.0 B, free: 7.8 GB) 17/03/01 04:14:49 INFO BlockManagerInfo: Added broadcast_132_piece0 in memory on hostName:41443 (size: 887.0 B, free: 7.8 GB) 17/03/01 04:14:49 INFO BlockManagerInfo: Added broadcast_132_piece0 in memory on hostName:55987 (size: 887.0 B, free: 7.8 GB) 17/03/01 04:14:49 INFO BlockManagerInfo: Added broadcast_132_piece0 in memory on hostName:56606 (size: 887.0 B, free: 7.8 GB) 17/03/01 04:14:49 INFO BlockManagerInfo: Added broadcast_132_piece0 in memory on hostName:32912 (size: 887.0 B, free: 7.8 GB) 17/03/01 04:14:49 INFO BlockManagerInfo: Added broadcast_132_piece0 in memory on hostName:60209 (size: 887.0 B, free: 7.8 GB) 17/03/01 04:14:49 INFO BlockManagerInfo: Added broadcast_132_piece0 in memory on hostName:51137 (size: 887.0 B, free: 7.8 GB) 17/03/01 04:14:49 INFO BlockManagerInfo: Added broadcast_132_piece0 in memory on hostName:42418 (size: 887.0 B, free: 7.8 GB) 17/03/01 04:14:49 INFO BlockManagerInfo: Added broadcast_132_piece0 in memory on hostName:48862 (size: 887.0 B, free: 7.8 GB) 17/03/01 04:14:49 INFO BlockManagerInfo: Added broadcast_132_piece0 in memory on hostName:43477 (size: 887.0 B, free: 7.8 GB) 17/03/01 04:14:49 INFO BlockManagerInfo: Added broadcast_132_piece0 in memory on hostName:50154 (size: 887.0 B, free: 7.8 GB) 17/03/01 04:14:49 INFO BlockManagerInfo: Added broadcast_132_piece0 in memory on hostName:37357 (size: 887.0 B, free: 7.8 GB) 17/03/01 04:14:49 INFO BlockManagerInfo: Added broadcast_132_piece0 in memory on hostName:35569 (size: 887.0 B, free: 7.8 GB) 17/03/01 04:14:49 INFO BlockManagerInfo: Added broadcast_132_piece0 in memory on hostName:57052 (size: 887.0 B, free: 7.8 GB) 17/03/01 04:14:49 INFO BlockManagerInfo: Added broadcast_132_piece0 in memory on hostName:45520 (size: 887.0 B, free: 7.8 GB) 17/03/01 04:14:49 INFO BlockManagerInfo: Added broadcast_132_piece0 in memory on hostName:51773 (size: 887.0 B, free: 7.8 GB) 17/03/01 04:14:49 INFO BlockManagerInfo: Added broadcast_132_piece0 in memory on hostName:43142 (size: 887.0 B, free: 7.8 GB) 17/03/01 04:14:49 INFO BlockManagerInfo: Added broadcast_132_piece0 in memory on hostName:38204 (size: 887.0 B, free: 7.8 GB) 17/03/01 04:14:49 INFO BlockManagerInfo: Added broadcast_132_piece0 in memory on hostName:58857 (size: 887.0 B, free: 7.8 GB) 17/03/01 04:14:49 INFO BlockManagerInfo: Added broadcast_132_piece0 in memory on hostName:56727 (size: 887.0 B, free: 7.8 GB) 17/03/01 04:14:49 INFO BlockManagerInfo: Added broadcast_132_piece0 in memory on hostName:52284 (size: 887.0 B, free: 7.8 GB) 17/03/01 04:14:49 INFO BlockManagerInfo: Added broadcast_132_piece0 in memory on hostName:44721 (size: 887.0 B, free: 7.8 GB) 17/03/01 04:14:49 INFO BlockManagerInfo: Added broadcast_132_piece0 in memory on hostName:46180 (size: 887.0 B, free: 7.8 GB) 17/03/01 04:14:49 INFO BlockManagerInfo: Added broadcast_132_piece0 in memory on hostName:34517 (size: 887.0 B, free: 7.8 GB) 17/03/01 04:14:49 INFO BlockManagerInfo: Added broadcast_132_piece0 in memory on hostName:49788 (size: 887.0 B, free: 7.8 GB) 17/03/01 04:14:49 INFO BlockManagerInfo: Added broadcast_132_piece0 in memory on hostName:41809 (size: 887.0 B, free: 7.8 GB) 17/03/01 04:14:49 INFO BlockManagerInfo: Added broadcast_132_piece0 in memory on hostName:50848 (size: 887.0 B, free: 7.8 GB) 17/03/01 04:14:49 INFO BlockManagerInfo: Added broadcast_132_piece0 in memory on hostName:33016 (size: 887.0 B, free: 7.8 GB) 17/03/01 04:14:49 INFO BlockManagerInfo: Added broadcast_132_piece0 in memory on hostName:46376 (size: 887.0 B, free: 7.8 GB) 17/03/01 04:14:49 INFO BlockManagerInfo: Added broadcast_132_piece0 in memory on hostName:35888 (size: 887.0 B, free: 7.8 GB) 17/03/01 04:14:49 INFO BlockManagerInfo: Added broadcast_132_piece0 in memory on hostName:44583 (size: 887.0 B, free: 7.8 GB) 17/03/01 04:14:49 INFO BlockManagerInfo: Added broadcast_132_piece0 in memory on hostName:40903 (size: 887.0 B, free: 7.8 GB) 17/03/01 04:14:49 INFO GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=4136a0c9-14d5-42b3-9a60-81689c800438, addrs=[3, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/3:47500], discPort=47500, order=40, intOrder=40, lastExchangeTime=1488363162864, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:49 INFO GridDiscoveryManager: Topology snapshot [ver=42, servers=40, clients=0, CPUs=1624, heap=620.0GB] 17/03/01 04:14:49 INFO BlockManagerInfo: Added broadcast_132_piece0 in memory on hostName:41952 (size: 887.0 B, free: 7.8 GB) 17/03/01 04:14:49 INFO BlockManagerInfo: Added broadcast_132_piece0 in memory on hostName:46027 (size: 887.0 B, free: 7.8 GB) 17/03/01 04:14:49 INFO BlockManagerInfo: Added broadcast_132_piece0 in memory on hostName:36400 (size: 887.0 B, free: 7.8 GB) 17/03/01 04:14:49 INFO BlockManagerInfo: Added broadcast_132_piece0 in memory on hostName:51382 (size: 887.0 B, free: 7.8 GB) 17/03/01 04:14:49 INFO BlockManagerInfo: Added broadcast_132_piece0 in memory on hostName:56472 (size: 887.0 B, free: 7.8 GB) 17/03/01 04:14:49 INFO BlockManagerInfo: Added broadcast_132_piece0 in memory on hostName:48144 (size: 887.0 B, free: 7.8 GB) 17/03/01 04:14:49 INFO BlockManagerInfo: Added broadcast_132_piece0 in memory on hostName:56293 (size: 887.0 B, free: 7.8 GB) 17/03/01 04:14:49 WARN TcpDiscoverySpi: Failed to ping node (status check will be initiated): 23f61699-e2c9-4ff6-8731-2483934e84c4 17/03/01 04:14:49 INFO GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=cf4e6e83-207e-42da-a55c-5621bc20b891, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=38, intOrder=38, lastExchangeTime=1488363162632, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:49 INFO GridDiscoveryManager: Topology snapshot [ver=43, servers=39, clients=0, CPUs=1584, heap=610.0GB] 17/03/01 04:14:49 INFO GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=d8926a2c-2c00-4445-beb4-633c2d656c41, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=39, intOrder=39, lastExchangeTime=1488363162642, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:49 INFO GridDiscoveryManager: Topology snapshot [ver=44, servers=38, clients=0, CPUs=1552, heap=590.0GB] 17/03/01 04:14:49 INFO GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=e9e49d2d-5eeb-474f-8757-e447efc8ca8f, addrs=[6, 127.0.0.1], sockAddrs=[hostName/6:47500, /127.0.0.1:47500], discPort=47500, order=34, intOrder=34, lastExchangeTime=1488363161573, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:49 INFO GridDiscoveryManager: Topology snapshot [ver=45, servers=37, clients=0, CPUs=1512, heap=580.0GB] 17/03/01 04:14:50 WARN TcpDiscoverySpi: Failed to ping node (status check will be initiated): ddc47224-d030-4d1f-ba66-08f61368a395 17/03/01 04:14:50 WARN TcpDiscoverySpi: Failed to ping node (status check will be initiated): 0d675d57-b9b9-4cff-a994-77337d618bbe 17/03/01 04:14:50 WARN TcpDiscoverySpi: Failed to ping node (status check will be initiated): 57c09d88-a4dc-4179-98b4-1144fd97d8cc 17/03/01 04:14:50 WARN TcpDiscoverySpi: Failed to ping node (status check will be initiated): 40d089f0-7c80-4f1f-8659-350791f57a4c 17/03/01 04:14:50 WARN TcpDiscoverySpi: Failed to ping node (status check will be initiated): 9fb6e583-cea0-4f78-b403-b403a8bc9a0e 17/03/01 04:14:50 INFO TaskSetManager: Finished task 9.0 in stage 8.0 (TID 322) in 672 ms on hostName (1/40) 17/03/01 04:14:50 WARN TcpDiscoverySpi: Failed to ping node (status check will be initiated): a6343860-6e84-4d9c-9b87-84ffd76280cd 17/03/01 04:14:50 WARN TcpDiscoverySpi: Failed to ping node (status check will be initiated): 8be1bd05-d62c-4f1a-83f2-91dcb3f3b62a 17/03/01 04:14:50 WARN TcpDiscoverySpi: Failed to ping node (status check will be initiated): 3e101db5-8c5c-47b7-bbdb-a9a892c4bada 17/03/01 04:14:50 WARN TcpDiscoverySpi: Failed to ping node (status check will be initiated): 479b18e6-54af-4313-85f7-c7525f6229a4 17/03/01 04:14:50 WARN TcpDiscoverySpi: Failed to ping node (status check will be initiated): e87f12ce-5981-4418-8468-f6bfed0a0cd8 17/03/01 04:14:50 WARN TcpDiscoverySpi: Failed to ping node (status check will be initiated): 4b90e5a3-253a-435b-84ca-6b592610cf0c 17/03/01 04:14:50 WARN TcpDiscoverySpi: Failed to ping node (status check will be initiated): 4d5de2f3-d975-4b28-b593-0cc0481cdc74 17/03/01 04:14:50 WARN TcpDiscoverySpi: Failed to ping node (status check will be initiated): 20860cae-2881-4311-a3f5-edaa160ef37f 17/03/01 04:14:51 WARN TcpDiscoverySpi: Failed to ping node (status check will be initiated): daed0152-83fc-4828-ada6-64c74787b190 17/03/01 04:14:51 WARN TcpDiscoverySpi: Failed to ping node (status check will be initiated): c4f4f6bb-b71a-4a29-9575-afee2ddc1b2d 17/03/01 04:14:51 WARN TcpDiscoverySpi: Failed to ping node (status check will be initiated): ffe19475-7849-4027-8648-ce56598ff50f 17/03/01 04:14:51 WARN TcpDiscoverySpi: Failed to ping node (status check will be initiated): d7b45a02-0411-4028-acdf-f004e592f294 17/03/01 04:14:51 WARN TcpDiscoverySpi: Failed to ping node (status check will be initiated): 29716cf1-ed55-4550-82bd-cf980a0aee2c 17/03/01 04:14:51 WARN TcpDiscoverySpi: Failed to ping node (status check will be initiated): 133c388f-3399-4cc8-b2f1-7ae8ba971b03 17/03/01 04:14:51 INFO GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=57c09d88-a4dc-4179-98b4-1144fd97d8cc, addrs=[35, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/35:47500], discPort=47500, order=29, intOrder=29, lastExchangeTime=1488363160656, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO GridDiscoveryManager: Topology snapshot [ver=46, servers=36, clients=0, CPUs=1464, heap=560.0GB] 17/03/01 04:14:51 INFO GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=0d675d57-b9b9-4cff-a994-77337d618bbe, addrs=[4, 127.0.0.1], sockAddrs=[hostName/4:47500, /127.0.0.1:47500], discPort=47500, order=25, intOrder=25, lastExchangeTime=1488363160222, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO GridDiscoveryManager: Topology snapshot [ver=47, servers=35, clients=0, CPUs=1424, heap=550.0GB] 17/03/01 04:14:51 INFO GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=a6343860-6e84-4d9c-9b87-84ffd76280cd, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=26, intOrder=26, lastExchangeTime=1488363160222, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO GridDiscoveryManager: Topology snapshot [ver=48, servers=34, clients=0, CPUs=1384, heap=530.0GB] 17/03/01 04:14:51 INFO GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=9fb6e583-cea0-4f78-b403-b403a8bc9a0e, addrs=[7, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/7:47500], discPort=47500, order=23, intOrder=23, lastExchangeTime=1488363160212, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO GridDiscoveryManager: Topology snapshot [ver=49, servers=33, clients=0, CPUs=1344, heap=520.0GB] 17/03/01 04:14:51 INFO GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=23f61699-e2c9-4ff6-8731-2483934e84c4, addrs=[0, 127.0.0.1], sockAddrs=[hostName/0:47500, /127.0.0.1:47500], discPort=47500, order=14, intOrder=14, lastExchangeTime=1488363160010, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO GridDiscoveryManager: Topology snapshot [ver=50, servers=32, clients=0, CPUs=1304, heap=500.0GB] 17/03/01 04:14:51 INFO GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=ddc47224-d030-4d1f-ba66-08f61368a395, addrs=[4, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/4:47500], discPort=47500, order=17, intOrder=17, lastExchangeTime=1488363160020, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO GridDiscoveryManager: Topology snapshot [ver=51, servers=31, clients=0, CPUs=1264, heap=490.0GB] 17/03/01 04:14:51 INFO GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=e87f12ce-5981-4418-8468-f6bfed0a0cd8, addrs=[6, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/6:47500], discPort=47500, order=19, intOrder=19, lastExchangeTime=1488363160020, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO GridDiscoveryManager: Topology snapshot [ver=52, servers=30, clients=0, CPUs=1224, heap=470.0GB] 17/03/01 04:14:51 INFO GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=40d089f0-7c80-4f1f-8659-350791f57a4c, addrs=[37, 127.0.0.1], sockAddrs=[hostName/37:47500, /127.0.0.1:47500], discPort=47500, order=4, intOrder=4, lastExchangeTime=1488363159737, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO GridDiscoveryManager: Topology snapshot [ver=53, servers=29, clients=0, CPUs=1176, heap=460.0GB] 17/03/01 04:14:51 INFO GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=29716cf1-ed55-4550-82bd-cf980a0aee2c, addrs=[, 127.0.0.1], sockAddrs=[hostName/:47501, /127.0.0.1:47501], discPort=47501, order=9, intOrder=9, lastExchangeTime=1488363159940, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO GridDiscoveryManager: Topology snapshot [ver=54, servers=28, clients=0, CPUs=1136, heap=440.0GB] 17/03/01 04:14:51 WARN TcpDiscoverySpi: Failed to ping node (status check will be initiated): f9ce8dd7-2060-4c34-b597-d7bee86ebedb 17/03/01 04:14:51 INFO TaskSetManager: Finished task 4.0 in stage 8.0 (TID 317) in 1973 ms on hostName (2/40) 17/03/01 04:14:51 INFO TaskSetManager: Finished task 32.0 in stage 8.0 (TID 345) in 1976 ms on hostName (3/40) 17/03/01 04:14:51 INFO TaskSetManager: Finished task 16.0 in stage 8.0 (TID 329) in 1983 ms on hostName (4/40) 17/03/01 04:14:51 INFO TaskSetManager: Finished task 27.0 in stage 8.0 (TID 340) in 1988 ms on hostName (5/40) 17/03/01 04:14:51 INFO TaskSetManager: Finished task 38.0 in stage 8.0 (TID 351) in 1988 ms on hostName (6/40) 17/03/01 04:14:51 INFO GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=3e101db5-8c5c-47b7-bbdb-a9a892c4bada, addrs=[08, 127.0.0.1], sockAddrs=[hostName/08:47500, /127.0.0.1:47500], discPort=47500, order=3, intOrder=3, lastExchangeTime=1488363159606, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO GridDiscoveryManager: Topology snapshot [ver=55, servers=27, clients=0, CPUs=1088, heap=430.0GB] 17/03/01 04:14:51 WARN TcpDiscoverySpi: Failed to ping node (status check will be initiated): 694a80b8-02a3-44c9-a2dd-45bed7d20a50 17/03/01 04:14:51 INFO TaskSetManager: Finished task 14.0 in stage 8.0 (TID 327) in 2040 ms on hostName (7/40) 17/03/01 04:14:51 INFO GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=8fd4eea2-2a45-4563-ae87-1848fd388a98, addrs=[3, 127.0.0.1], sockAddrs=[hostName/3:47500, /127.0.0.1:47500], discPort=47500, order=36, intOrder=36, lastExchangeTime=1488363161573, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO GridDiscoveryManager: Topology snapshot [ver=56, servers=26, clients=0, CPUs=1048, heap=410.0GB] 17/03/01 04:14:51 INFO TaskSetManager: Finished task 39.0 in stage 8.0 (TID 352) in 2049 ms on hostName (8/40) 17/03/01 04:14:51 INFO TaskSetManager: Finished task 17.0 in stage 8.0 (TID 330) in 2053 ms on hostName (9/40) 17/03/01 04:14:51 INFO TaskSetManager: Finished task 19.0 in stage 8.0 (TID 332) in 2053 ms on hostName (10/40) 17/03/01 04:14:51 INFO TaskSetManager: Finished task 7.0 in stage 8.0 (TID 320) in 2060 ms on hostName (11/40) 17/03/01 04:14:51 INFO TaskSetManager: Finished task 24.0 in stage 8.0 (TID 337) in 2063 ms on hostName (12/40) 17/03/01 04:14:51 INFO TaskSetManager: Finished task 30.0 in stage 8.0 (TID 343) in 2080 ms on hostName (13/40) 17/03/01 04:14:51 INFO TaskSetManager: Finished task 18.0 in stage 8.0 (TID 331) in 2088 ms on hostName (14/40) 17/03/01 04:14:51 WARN TcpDiscoverySpi: Failed to ping node (status check will be initiated): 90532831-88fb-4eb8-adc9-db7a86744869 17/03/01 04:14:51 INFO GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=694a80b8-02a3-44c9-a2dd-45bed7d20a50, addrs=[1, 127.0.0.1], sockAddrs=[hostName/1:47500, /127.0.0.1:47500], discPort=47500, order=41, intOrder=41, lastExchangeTime=1488363162875, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO GridDiscoveryManager: Topology snapshot [ver=57, servers=25, clients=0, CPUs=1008, heap=400.0GB] 17/03/01 04:14:51 WARN TcpDiscoverySpi: Failed to ping node (status check will be initiated): 5bc51e21-1dcf-498a-b87e-6dd24f7e36ad 17/03/01 04:14:51 WARN TcpDiscoverySpi: Failed to ping node (status check will be initiated): fa09caab-f4dc-43b6-ac8b-4a4bae6e7da6 17/03/01 04:14:51 WARN TcpDiscoverySpi: Failed to ping node (status check will be initiated): af5837f0-25ec-4f3d-a1c1-90c09dc424cb 17/03/01 04:14:51 WARN TcpDiscoverySpi: Failed to ping node (status check will be initiated): 47c1a0d8-9d4d-4d0d-9b27-388bd7f49278 17/03/01 04:14:52 WARN TcpDiscoverySpi: Failed to ping node (status check will be initiated): 717de453-fc6b-4a46-91b2-b5c54ab8a4be 17/03/01 04:14:52 INFO GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=d7b45a02-0411-4028-acdf-f004e592f294, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=37, intOrder=37, lastExchangeTime=1488363161876, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:52 INFO GridDiscoveryManager: Topology snapshot [ver=58, servers=24, clients=0, CPUs=968, heap=380.0GB] 17/03/01 04:14:52 WARN TcpDiscoverySpi: Failed to ping node (status check will be initiated): 95f164b5-4b73-438f-804f-62854d615b5b 17/03/01 04:14:52 INFO TaskSetManager: Finished task 3.0 in stage 8.0 (TID 316) in 2533 ms on hostName (15/40) 17/03/01 04:14:52 INFO GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=4b90e5a3-253a-435b-84ca-6b592610cf0c, addrs=[4, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/4:47500], discPort=47500, order=35, intOrder=35, lastExchangeTime=1488363161573, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:52 INFO GridDiscoveryManager: Topology snapshot [ver=59, servers=23, clients=0, CPUs=936, heap=370.0GB] 17/03/01 04:14:52 INFO GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=af5837f0-25ec-4f3d-a1c1-90c09dc424cb, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=33, intOrder=33, lastExchangeTime=1488363161563, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:52 INFO GridDiscoveryManager: Topology snapshot [ver=60, servers=22, clients=0, CPUs=896, heap=350.0GB] 17/03/01 04:14:52 WARN TcpDiscoverySpi: Failed to ping node (status check will be initiated): 58298821-7aa9-4b58-ba15-e7f1ef2830fb 17/03/01 04:14:52 INFO TaskSetManager: Finished task 36.0 in stage 8.0 (TID 349) in 2640 ms on hostName (16/40) 17/03/01 04:14:52 INFO TaskSetManager: Finished task 21.0 in stage 8.0 (TID 334) in 2641 ms on hostName (17/40) 17/03/01 04:14:52 INFO GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=fa09caab-f4dc-43b6-ac8b-4a4bae6e7da6, addrs=[01, 127.0.0.1], sockAddrs=[hostName/01:47500, /127.0.0.1:47500], discPort=47500, order=32, intOrder=32, lastExchangeTime=1488363161432, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:52 INFO GridDiscoveryManager: Topology snapshot [ver=61, servers=21, clients=0, CPUs=856, heap=340.0GB] 17/03/01 04:14:52 WARN TcpDiscoverySpi: Failed to ping node (status check will be initiated): e2cba212-89dd-48dd-8d7e-821b5725fe03 17/03/01 04:14:52 INFO TaskSetManager: Finished task 34.0 in stage 8.0 (TID 347) in 2715 ms on hostName (18/40) 17/03/01 04:14:52 INFO TaskSetManager: Finished task 8.0 in stage 8.0 (TID 321) in 2718 ms on hostName (19/40) 17/03/01 04:14:52 INFO GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=4d5de2f3-d975-4b28-b593-0cc0481cdc74, addrs=[03, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/03:47500], discPort=47500, order=31, intOrder=31, lastExchangeTime=1488363160777, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:52 INFO GridDiscoveryManager: Topology snapshot [ver=62, servers=20, clients=0, CPUs=808, heap=320.0GB] 17/03/01 04:14:52 INFO TaskSetManager: Finished task 35.0 in stage 8.0 (TID 348) in 2784 ms on hostName (20/40) 17/03/01 04:14:52 WARN TcpDiscoverySpi: Failed to ping node (status check will be initiated): 058a99e8-3b65-4ec9-84b0-6f3502c2afce 17/03/01 04:14:52 INFO GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=058a99e8-3b65-4ec9-84b0-6f3502c2afce, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=28, intOrder=28, lastExchangeTime=1488363160605, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:52 INFO GridDiscoveryManager: Topology snapshot [ver=63, servers=19, clients=0, CPUs=768, heap=310.0GB] 17/03/01 04:14:52 INFO GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=58298821-7aa9-4b58-ba15-e7f1ef2830fb, addrs=[3, 127.0.0.1], sockAddrs=[hostName/3:47500, /127.0.0.1:47500], discPort=47500, order=30, intOrder=30, lastExchangeTime=1488363160656, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:52 INFO GridDiscoveryManager: Topology snapshot [ver=64, servers=18, clients=0, CPUs=728, heap=290.0GB] 17/03/01 04:14:52 WARN TcpDiscoverySpi: Failed to ping node (status check will be initiated): 6b1889dd-9de5-4f1b-8ec9-c123c7df8ea2 17/03/01 04:14:52 INFO TaskSetManager: Finished task 10.0 in stage 8.0 (TID 323) in 2970 ms on hostName (21/40) 17/03/01 04:14:52 INFO GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=20860cae-2881-4311-a3f5-edaa160ef37f, addrs=[7, 127.0.0.1], sockAddrs=[hostName/7:47500, /127.0.0.1:47500], discPort=47500, order=24, intOrder=24, lastExchangeTime=1488363160222, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:52 INFO GridDiscoveryManager: Topology snapshot [ver=65, servers=17, clients=0, CPUs=688, heap=280.0GB] 17/03/01 04:14:52 INFO GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=479b18e6-54af-4313-85f7-c7525f6229a4, addrs=[, 127.0.0.1], sockAddrs=[hostName/:47500, /127.0.0.1:47500], discPort=47500, order=27, intOrder=27, lastExchangeTime=1488363160313, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:52 INFO GridDiscoveryManager: Topology snapshot [ver=66, servers=16, clients=0, CPUs=640, heap=260.0GB] 17/03/01 04:14:52 INFO TaskSetManager: Finished task 37.0 in stage 8.0 (TID 350) in 3012 ms on hostName (22/40) 17/03/01 04:14:52 INFO GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=6b1889dd-9de5-4f1b-8ec9-c123c7df8ea2, addrs=[, 127.0.0.1], sockAddrs=[hostName/:47500, /127.0.0.1:47500], discPort=47500, order=22, intOrder=22, lastExchangeTime=1488363160212, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:52 INFO GridDiscoveryManager: Topology snapshot [ver=67, servers=15, clients=0, CPUs=600, heap=250.0GB] 17/03/01 04:14:52 INFO TaskSetManager: Finished task 1.0 in stage 8.0 (TID 314) in 3083 ms on hostName (23/40) 17/03/01 04:14:52 INFO TaskSetManager: Finished task 20.0 in stage 8.0 (TID 333) in 3092 ms on hostName (24/40) 17/03/01 04:14:52 INFO GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=f9ce8dd7-2060-4c34-b597-d7bee86ebedb, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=21, intOrder=21, lastExchangeTime=1488363160141, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:52 INFO GridDiscoveryManager: Topology snapshot [ver=68, servers=14, clients=0, CPUs=560, heap=230.0GB] 17/03/01 04:14:52 INFO GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=c4f4f6bb-b71a-4a29-9575-afee2ddc1b2d, addrs=[6, 127.0.0.1], sockAddrs=[hostName/6:47500, /127.0.0.1:47500], discPort=47500, order=16, intOrder=16, lastExchangeTime=1488363160010, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:52 INFO GridDiscoveryManager: Topology snapshot [ver=69, servers=13, clients=0, CPUs=520, heap=220.0GB] 17/03/01 04:14:52 INFO GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=e2cba212-89dd-48dd-8d7e-821b5725fe03, addrs=[8, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/8:47500], discPort=47500, order=20, intOrder=20, lastExchangeTime=1488363160121, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:52 INFO GridDiscoveryManager: Topology snapshot [ver=70, servers=12, clients=0, CPUs=488, heap=200.0GB] 17/03/01 04:14:52 INFO GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=47c1a0d8-9d4d-4d0d-9b27-388bd7f49278, addrs=[1, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/1:47500], discPort=47500, order=18, intOrder=18, lastExchangeTime=1488363160020, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:52 INFO GridDiscoveryManager: Topology snapshot [ver=71, servers=11, clients=0, CPUs=448, heap=190.0GB] 17/03/01 04:14:52 INFO TaskSetManager: Finished task 31.0 in stage 8.0 (TID 344) in 3167 ms on hostName (25/40) 17/03/01 04:14:52 INFO GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=95f164b5-4b73-438f-804f-62854d615b5b, addrs=[9, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/9:47500], discPort=47500, order=15, intOrder=15, lastExchangeTime=1488363160010, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:52 INFO GridDiscoveryManager: Topology snapshot [ver=72, servers=10, clients=0, CPUs=408, heap=170.0GB] 17/03/01 04:14:52 INFO TaskSetManager: Finished task 15.0 in stage 8.0 (TID 328) in 3204 ms on hostName (26/40) 17/03/01 04:14:52 INFO TaskSetManager: Finished task 6.0 in stage 8.0 (TID 319) in 3207 ms on hostName (27/40) 17/03/01 04:14:52 INFO TaskSetManager: Finished task 13.0 in stage 8.0 (TID 326) in 3212 ms on hostName (28/40) 17/03/01 04:14:52 INFO TaskSetManager: Finished task 25.0 in stage 8.0 (TID 338) in 3234 ms on hostName (29/40) 17/03/01 04:14:52 INFO TaskSetManager: Finished task 26.0 in stage 8.0 (TID 339) in 3267 ms on hostName (30/40) 17/03/01 04:14:52 INFO TaskSetManager: Finished task 5.0 in stage 8.0 (TID 318) in 3270 ms on hostName (31/40) 17/03/01 04:14:52 INFO GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=8be1bd05-d62c-4f1a-83f2-91dcb3f3b62a, addrs=[07, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/07:47500], discPort=47500, order=12, intOrder=12, lastExchangeTime=1488363159960, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:52 INFO GridDiscoveryManager: Topology snapshot [ver=73, servers=9, clients=0, CPUs=376, heap=160.0GB] 17/03/01 04:14:52 INFO GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=133c388f-3399-4cc8-b2f1-7ae8ba971b03, addrs=[7, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/7:47500], discPort=47500, order=13, intOrder=13, lastExchangeTime=1488363160000, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:52 INFO GridDiscoveryManager: Topology snapshot [ver=74, servers=8, clients=0, CPUs=336, heap=140.0GB] 17/03/01 04:14:52 INFO GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=717de453-fc6b-4a46-91b2-b5c54ab8a4be, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=10, intOrder=10, lastExchangeTime=1488363159950, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:52 INFO GridDiscoveryManager: Topology snapshot [ver=75, servers=7, clients=0, CPUs=296, heap=130.0GB] 17/03/01 04:14:52 INFO GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=daed0152-83fc-4828-ada6-64c74787b190, addrs=[, 127.0.0.1], sockAddrs=[hostName/:47500, /127.0.0.1:47500], discPort=47500, order=8, intOrder=8, lastExchangeTime=1488363159909, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:52 INFO GridDiscoveryManager: Topology snapshot [ver=76, servers=6, clients=0, CPUs=256, heap=110.0GB] 17/03/01 04:14:52 INFO GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=ffe19475-7849-4027-8648-ce56598ff50f, addrs=[7, 127.0.0.1], sockAddrs=[/127.0.0.1:47501, hostName/7:47501], discPort=47501, order=11, intOrder=11, lastExchangeTime=1488363159960, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:52 INFO GridDiscoveryManager: Topology snapshot [ver=77, servers=5, clients=0, CPUs=216, heap=96.0GB] 17/03/01 04:14:52 INFO TaskSetManager: Finished task 22.0 in stage 8.0 (TID 335) in 3341 ms on hostName (32/40) 17/03/01 04:14:52 INFO GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=d4a9fe7f-de19-4df7-874c-a084da78562f, addrs=[4, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/4:47500], discPort=47500, order=6, intOrder=6, lastExchangeTime=1488363159748, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:52 INFO GridDiscoveryManager: Topology snapshot [ver=78, servers=4, clients=0, CPUs=176, heap=81.0GB] 17/03/01 04:14:52 INFO GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=90532831-88fb-4eb8-adc9-db7a86744869, addrs=[0, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/0:47500], discPort=47500, order=5, intOrder=5, lastExchangeTime=1488363159748, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:52 INFO GridDiscoveryManager: Topology snapshot [ver=79, servers=3, clients=0, CPUs=136, heap=66.0GB] 17/03/01 04:14:52 INFO GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=90db2cab-26f6-463d-9755-d03d059a8723, addrs=[69, 127.0.0.1], sockAddrs=[hostName/69:47500, /127.0.0.1:47500], discPort=47500, order=2, intOrder=2, lastExchangeTime=1488363159586, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:52 INFO GridDiscoveryManager: Topology snapshot [ver=80, servers=2, clients=0, CPUs=88, heap=51.0GB] 17/03/01 04:14:52 INFO GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=5bc51e21-1dcf-498a-b87e-6dd24f7e36ad, addrs=[8, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/8:47500], discPort=47500, order=7, intOrder=7, lastExchangeTime=1488363159899, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:52 INFO GridDiscoveryManager: Topology snapshot [ver=81, servers=1, clients=0, CPUs=48, heap=36.0GB] 17/03/01 04:14:52 INFO TaskSetManager: Finished task 28.0 in stage 8.0 (TID 341) in 3395 ms on hostName (33/40) 17/03/01 04:14:53 INFO GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=42, minorTopVer=0], evt=NODE_LEFT, node=4136a0c9-14d5-42b3-9a60-81689c800438] 17/03/01 04:14:53 INFO TaskSetManager: Finished task 0.0 in stage 8.0 (TID 313) in 3422 ms on hostName (34/40) 17/03/01 04:14:53 INFO TaskSetManager: Finished task 11.0 in stage 8.0 (TID 324) in 3429 ms on hostName (35/40) 17/03/01 04:14:53 INFO TaskSetManager: Finished task 29.0 in stage 8.0 (TID 342) in 3429 ms on hostName (36/40) 17/03/01 04:14:53 INFO TaskSetManager: Finished task 33.0 in stage 8.0 (TID 346) in 3447 ms on hostName (37/40) 17/03/01 04:14:53 INFO TaskSetManager: Finished task 23.0 in stage 8.0 (TID 336) in 3447 ms on hostName (38/40) 17/03/01 04:14:53 INFO TaskSetManager: Finished task 12.0 in stage 8.0 (TID 325) in 3469 ms on hostName (39/40) 17/03/01 04:14:53 INFO TaskSetManager: Finished task 2.0 in stage 8.0 (TID 315) in 3495 ms on hostName (40/40) 17/03/01 04:14:53 INFO DAGScheduler: ResultStage 8 (foreachPartition at CompanyResolverSparkTest.scala:305) finished in 3.495 s 17/03/01 04:14:53 INFO YarnClusterScheduler: Removed TaskSet 8.0, whose tasks have all completed, from pool 17/03/01 04:14:53 INFO DAGScheduler: Job 7 finished: foreachPartition at CompanyResolverSparkTest.scala:305, took 3.499298 s 17/03/01 04:14:53 INFO ApplicationMaster: Final app status: SUCCEEDED, exitCode: 0 17/03/01 04:14:53 INFO SparkContext: Invoking stop() from shutdown hook 17/03/01 04:14:53 INFO SparkUI: Stopped Spark web UI at http://ipaddress:52424 17/03/01 04:14:53 INFO DAGScheduler: Stopping DAGScheduler 17/03/01 04:14:53 INFO YarnClusterSchedulerBackend: Shutting down all executors 17/03/01 04:14:53 INFO YarnClusterSchedulerBackend: Asking each executor to shut down 17/03/01 04:14:53 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:43658 17/03/01 04:14:53 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:39522 17/03/01 04:14:53 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:47300 17/03/01 04:14:53 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:48294 17/03/01 04:14:53 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:59017 17/03/01 04:14:53 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:48531 17/03/01 04:14:53 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:44482 17/03/01 04:14:53 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:43543 17/03/01 04:14:53 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:57567 17/03/01 04:14:53 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:58154 17/03/01 04:14:53 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:38383 17/03/01 04:14:53 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:40325 17/03/01 04:14:53 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:43841 17/03/01 04:14:53 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:43109 17/03/01 04:14:53 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:46551 17/03/01 04:14:53 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:51613 17/03/01 04:14:53 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:50529 17/03/01 04:14:53 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:39907 17/03/01 04:14:53 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:55967 17/03/01 04:14:53 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:59799 17/03/01 04:14:53 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:49066 17/03/01 04:14:53 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:52031 17/03/01 04:14:53 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:58923 17/03/01 04:14:53 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:42726 17/03/01 04:14:53 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:44729 17/03/01 04:14:53 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:53843 17/03/01 04:14:53 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:51641 17/03/01 04:14:53 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:51348 17/03/01 04:14:53 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:36607 17/03/01 04:14:53 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped! 17/03/01 04:14:53 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:34871 17/03/01 04:14:53 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:38731 17/03/01 04:14:53 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:49975 17/03/01 04:14:53 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:42437 17/03/01 04:14:53 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:52829 17/03/01 04:14:53 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:56752 17/03/01 04:14:53 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:42353 17/03/01 04:14:53 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:50995 17/03/01 04:14:53 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:55692 17/03/01 04:14:53 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:51177 17/03/01 04:14:53 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:51249 17/03/01 04:14:53 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:42353 17/03/01 04:14:53 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:42353 17/03/01 04:14:53 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:42353 17/03/01 04:14:53 INFO MemoryStore: MemoryStore cleared 17/03/01 04:14:53 INFO ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hostName:42353 17/03/01 04:14:53 INFO BlockManager: BlockManager stopped 17/03/01 04:14:53 INFO BlockManagerMaster: BlockManagerMaster stopped 17/03/01 04:14:53 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped! 17/03/01 04:14:53 INFO SparkContext: Successfully stopped SparkContext 17/03/01 04:14:53 INFO ApplicationMaster: Unregistering ApplicationMaster with SUCCEEDED 17/03/01 04:14:53 INFO RemoteActorRefProvider$RemotingTerminator: Shutting down remote daemon. 17/03/01 04:14:53 INFO RemoteActorRefProvider$RemotingTerminator: Remote daemon shut down; proceeding with flushing remote transports. 17/03/01 04:14:53 INFO AMRMClientImpl: Waiting for application to be successfully unregistered. 17/03/01 04:14:53 INFO Remoting: Remoting shut down 17/03/01 04:14:53 INFO RemoteActorRefProvider$RemotingTerminator: Remoting shut down. 17/03/01 04:14:53 INFO ApplicationMaster: Deleting staging directory .sparkStaging/application_1487862040010_131981 17/03/01 04:14:53 INFO ShutdownHookManager: Shutdown hook called 17/03/01 04:14:53 INFO ShutdownHookManager: Deleting directory /data/7/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/spark-18fa3a4b-912d-4d3a-9bd2-ebafe357ee9f 17/03/01 04:14:53 INFO ShutdownHookManager: Deleting directory /data/6/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/spark-13bbb069-2082-4504-8edd-c3f557f7106b 17/03/01 04:14:53 INFO ShutdownHookManager: Deleting directory /data/9/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/spark-ad15a5dc-9538-4f29-bd89-82493186c88f 17/03/01 04:14:53 INFO ShutdownHookManager: Deleting directory /data/5/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/spark-13a0d4c7-5d64-4a80-aefc-7482ee8d3b95 17/03/01 04:14:53 INFO ShutdownHookManager: Deleting directory /data/4/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/spark-b92c1860-1eca-4f25-9609-0a469be1fc53 17/03/01 04:14:53 INFO ShutdownHookManager: Deleting directory /data/10/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/spark-5de9fcb6-3678-4815-9d4d-ec77ab98fb6a 17/03/01 04:14:53 INFO ShutdownHookManager: Deleting directory /data/12/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/spark-1116dc3f-cc7e-4c6b-8ced-6ffc956192f1 17/03/01 04:14:53 INFO ShutdownHookManager: Deleting directory /data/1/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/spark-cd64fe1d-3c10-47a1-887b-6b0be8854b62 17/03/01 04:14:53 INFO ShutdownHookManager: Deleting directory /data/3/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/spark-3fb7179f-61e1-4968-9dfb-b3a6c019028a 17/03/01 04:14:53 INFO ShutdownHookManager: Deleting directory /data/2/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/spark-e066ef4c-2a95-476a-ad0f-8ff22b7970db LogType:stdout Log Upload Time:Wed Mar 01 04:14:58 -0600 2017 LogLength:825502 Log Contents: rEnd of the programe - [04:11:03] __________ ________________ [04:11:03] / _/ ___/ |/ / _/_ __/ __/ [04:11:03] _/ // (7 7 // / / / / _/ [04:11:03] /___/\___/_/|_/___/ /_/ /___/ [04:11:03] [04:11:03] ver. 1.8.0#20161205-sha1:9ca40dbe [04:11:03] 2016 Copyright(C) Apache Software Foundation [04:11:03] [04:11:03] Ignite documentation: http://ignite.apache.org [04:11:03] [04:11:03] Quiet mode. [04:11:03] ^-- To see **FULL** console log here add -DIGNITE_QUIET=false or "-v" to ignite.{sh|bat} [04:11:03] [04:11:03] OS: Linux 2.6.32-431.5.1.el6.x86_64 amd64 [04:11:03] VM information: Java(TM) SE Runtime Environment 1.8.0_60-b27 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.60-b23 [04:11:03] Configured plugins: [04:11:03] ^-- None [04:11:03] [04:11:03] Security status [authentication=off, tls/ssl=off] [04:11:04] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [04:11:04] [04:11:04] Ignite node started OK (id=6172ee3a, grid=WCA) [04:11:04] Topology snapshot [ver=1, servers=1, clients=0, CPUs=48, heap=36.0GB] [04:12:39] Topology snapshot [ver=2, servers=2, clients=0, CPUs=96, heap=51.0GB] [04:12:39] Topology snapshot [ver=3, servers=3, clients=0, CPUs=144, heap=66.0GB] [04:12:39] Topology snapshot [ver=4, servers=4, clients=0, CPUs=192, heap=81.0GB] [04:12:39] Topology snapshot [ver=5, servers=5, clients=0, CPUs=232, heap=96.0GB] [04:12:40] Topology snapshot [ver=6, servers=6, clients=0, CPUs=272, heap=110.0GB] [04:12:40] Topology snapshot [ver=7, servers=7, clients=0, CPUs=312, heap=130.0GB] [04:12:40] Topology snapshot [ver=8, servers=8, clients=0, CPUs=352, heap=140.0GB] [04:12:40] Topology snapshot [ver=9, servers=9, clients=0, CPUs=392, heap=160.0GB] [04:12:40] Topology snapshot [ver=10, servers=10, clients=0, CPUs=432, heap=170.0GB] [04:12:40] Topology snapshot [ver=11, servers=11, clients=0, CPUs=472, heap=190.0GB] [04:12:40] Topology snapshot [ver=12, servers=12, clients=0, CPUs=504, heap=200.0GB] [04:12:40] Topology snapshot [ver=13, servers=13, clients=0, CPUs=544, heap=220.0GB] [04:12:40] Topology snapshot [ver=14, servers=14, clients=0, CPUs=584, heap=230.0GB] [04:12:41] Topology snapshot [ver=15, servers=15, clients=0, CPUs=624, heap=250.0GB] [04:12:41] Topology snapshot [ver=16, servers=16, clients=0, CPUs=664, heap=260.0GB] [04:12:41] Topology snapshot [ver=17, servers=17, clients=0, CPUs=704, heap=280.0GB] [04:12:41] Topology snapshot [ver=18, servers=18, clients=0, CPUs=744, heap=290.0GB] [04:12:41] Topology snapshot [ver=19, servers=19, clients=0, CPUs=784, heap=310.0GB] [04:12:41] Topology snapshot [ver=20, servers=20, clients=0, CPUs=816, heap=320.0GB] [04:12:41] Topology snapshot [ver=21, servers=21, clients=0, CPUs=856, heap=340.0GB] [04:12:42] Topology snapshot [ver=22, servers=22, clients=0, CPUs=896, heap=350.0GB] [04:12:42] Topology snapshot [ver=23, servers=23, clients=0, CPUs=936, heap=370.0GB] [04:12:42] Topology snapshot [ver=24, servers=24, clients=0, CPUs=976, heap=380.0GB] [04:12:42] Topology snapshot [ver=25, servers=25, clients=0, CPUs=1016, heap=400.0GB] [04:12:42] Topology snapshot [ver=26, servers=26, clients=0, CPUs=1056, heap=410.0GB] [04:12:42] Topology snapshot [ver=27, servers=27, clients=0, CPUs=1104, heap=430.0GB] [04:12:43] Topology snapshot [ver=28, servers=28, clients=0, CPUs=1144, heap=440.0GB] [04:12:43] Topology snapshot [ver=29, servers=29, clients=0, CPUs=1192, heap=460.0GB] [04:12:43] Topology snapshot [ver=30, servers=30, clients=0, CPUs=1232, heap=470.0GB] [04:12:43] Topology snapshot [ver=31, servers=31, clients=0, CPUs=1280, heap=490.0GB] [04:12:43] Topology snapshot [ver=32, servers=32, clients=0, CPUs=1320, heap=500.0GB] [04:12:43] Topology snapshot [ver=33, servers=33, clients=0, CPUs=1360, heap=520.0GB] [04:12:44] Topology snapshot [ver=34, servers=34, clients=0, CPUs=1400, heap=530.0GB] [04:12:44] Topology snapshot [ver=35, servers=35, clients=0, CPUs=1432, heap=550.0GB] [04:12:44] Topology snapshot [ver=36, servers=36, clients=0, CPUs=1472, heap=560.0GB] [04:12:44] Topology snapshot [ver=37, servers=37, clients=0, CPUs=1512, heap=580.0GB] [04:12:44] Topology snapshot [ver=38, servers=38, clients=0, CPUs=1552, heap=590.0GB] [04:12:45] Topology snapshot [ver=39, servers=39, clients=0, CPUs=1584, heap=610.0GB] [04:12:45] Topology snapshot [ver=40, servers=40, clients=0, CPUs=1624, heap=620.0GB] [04:12:45] Topology snapshot [ver=41, servers=41, clients=0, CPUs=1664, heap=640.0GB] [04:14:49] Topology snapshot [ver=42, servers=40, clients=0, CPUs=1624, heap=620.0GB] [04:14:49] Topology snapshot [ver=43, servers=39, clients=0, CPUs=1584, heap=610.0GB] [04:14:49] Topology snapshot [ver=44, servers=38, clients=0, CPUs=1552, heap=590.0GB] [04:14:49] Topology snapshot [ver=45, servers=37, clients=0, CPUs=1512, heap=580.0GB] [04:14:51] Topology snapshot [ver=46, servers=36, clients=0, CPUs=1464, heap=560.0GB] [04:14:51] Topology snapshot [ver=47, servers=35, clients=0, CPUs=1424, heap=550.0GB] [04:14:51] Topology snapshot [ver=48, servers=34, clients=0, CPUs=1384, heap=530.0GB] [04:14:51] Topology snapshot [ver=49, servers=33, clients=0, CPUs=1344, heap=520.0GB] [04:14:51] Topology snapshot [ver=50, servers=32, clients=0, CPUs=1304, heap=500.0GB] [04:14:51] Topology snapshot [ver=51, servers=31, clients=0, CPUs=1264, heap=490.0GB] [04:14:51] Topology snapshot [ver=52, servers=30, clients=0, CPUs=1224, heap=470.0GB] [04:14:51] Topology snapshot [ver=53, servers=29, clients=0, CPUs=1176, heap=460.0GB] [04:14:51] Topology snapshot [ver=54, servers=28, clients=0, CPUs=1136, heap=440.0GB] [04:14:51] Topology snapshot [ver=55, servers=27, clients=0, CPUs=1088, heap=430.0GB] [04:14:51] Topology snapshot [ver=56, servers=26, clients=0, CPUs=1048, heap=410.0GB] [04:14:51] Topology snapshot [ver=57, servers=25, clients=0, CPUs=1008, heap=400.0GB] [04:14:52] Topology snapshot [ver=58, servers=24, clients=0, CPUs=968, heap=380.0GB] [04:14:52] Topology snapshot [ver=59, servers=23, clients=0, CPUs=936, heap=370.0GB] [04:14:52] Topology snapshot [ver=60, servers=22, clients=0, CPUs=896, heap=350.0GB] [04:14:52] Topology snapshot [ver=61, servers=21, clients=0, CPUs=856, heap=340.0GB] [04:14:52] Topology snapshot [ver=62, servers=20, clients=0, CPUs=808, heap=320.0GB] [04:14:52] Topology snapshot [ver=63, servers=19, clients=0, CPUs=768, heap=310.0GB] [04:14:52] Topology snapshot [ver=64, servers=18, clients=0, CPUs=728, heap=290.0GB] [04:14:52] Topology snapshot [ver=65, servers=17, clients=0, CPUs=688, heap=280.0GB] [04:14:52] Topology snapshot [ver=66, servers=16, clients=0, CPUs=640, heap=260.0GB] [04:14:52] Topology snapshot [ver=67, servers=15, clients=0, CPUs=600, heap=250.0GB] [04:14:52] Topology snapshot [ver=68, servers=14, clients=0, CPUs=560, heap=230.0GB] [04:14:52] Topology snapshot [ver=69, servers=13, clients=0, CPUs=520, heap=220.0GB] [04:14:52] Topology snapshot [ver=70, servers=12, clients=0, CPUs=488, heap=200.0GB] [04:14:52] Topology snapshot [ver=71, servers=11, clients=0, CPUs=448, heap=190.0GB] [04:14:52] Topology snapshot [ver=72, servers=10, clients=0, CPUs=408, heap=170.0GB] [04:14:52] Topology snapshot [ver=73, servers=9, clients=0, CPUs=376, heap=160.0GB] [04:14:52] Topology snapshot [ver=74, servers=8, clients=0, CPUs=336, heap=140.0GB] [04:14:52] Topology snapshot [ver=75, servers=7, clients=0, CPUs=296, heap=130.0GB] [04:14:52] Topology snapshot [ver=76, servers=6, clients=0, CPUs=256, heap=110.0GB] [04:14:52] Topology snapshot [ver=77, servers=5, clients=0, CPUs=216, heap=96.0GB] [04:14:52] Topology snapshot [ver=78, servers=4, clients=0, CPUs=176, heap=81.0GB] [04:14:52] Topology snapshot [ver=79, servers=3, clients=0, CPUs=136, heap=66.0GB] [04:14:52] Topology snapshot [ver=80, servers=2, clients=0, CPUs=88, heap=51.0GB] [04:14:52] Topology snapshot [ver=81, servers=1, clients=0, CPUs=48, heap=36.0GB] [04:14:53] Ignite node stopped OK [name=WCA, uptime=00:03:48:806] Container: container_e76_1487862040010_131981_01_000021 on hostName_8041 =========================================================================================== LogType:stderr Log Upload Time:Wed Mar 01 04:14:58 -0600 2017 LogLength:68693 Log Contents: 17/03/01 04:10:59 INFO executor.CoarseGrainedExecutorBackend: Registered signal handlers for [TERM, HUP, INT] 17/03/01 04:11:00 INFO spark.SecurityManager: Changing view acls to: userName 17/03/01 04:11:00 INFO spark.SecurityManager: Changing modify acls to: userName 17/03/01 04:11:00 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(userName); users with modify permissions: Set(userName) 17/03/01 04:11:01 INFO slf4j.Slf4jLogger: Slf4jLogger started 17/03/01 04:11:01 INFO Remoting: Starting remoting 17/03/01 04:11:01 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://driverPropsFetcher@hostName:35284] 17/03/01 04:11:01 INFO Remoting: Remoting now listens on addresses: [akka.tcp://driverPropsFetcher@hostName:35284] 17/03/01 04:11:01 INFO util.Utils: Successfully started service 'driverPropsFetcher' on port 35284. 17/03/01 04:11:01 INFO spark.SecurityManager: Changing view acls to: userName 17/03/01 04:11:01 INFO spark.SecurityManager: Changing modify acls to: userName 17/03/01 04:11:01 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(userName); users with modify permissions: Set(userName) 17/03/01 04:11:01 INFO remote.RemoteActorRefProvider$RemotingTerminator: Shutting down remote daemon. 17/03/01 04:11:01 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remote daemon shut down; proceeding with flushing remote transports. 17/03/01 04:11:01 INFO slf4j.Slf4jLogger: Slf4jLogger started 17/03/01 04:11:01 INFO Remoting: Remoting shut down 17/03/01 04:11:01 INFO Remoting: Starting remoting 17/03/01 04:11:01 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remoting shut down. 17/03/01 04:11:01 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://sparkExecutor@hostName:55967] 17/03/01 04:11:01 INFO Remoting: Remoting now listens on addresses: [akka.tcp://sparkExecutor@hostName:55967] 17/03/01 04:11:01 INFO util.Utils: Successfully started service 'sparkExecutor' on port 55967. 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/1/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-66e64f6d-26cb-49e2-87c3-0c500d76ce76 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/2/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-bec5f038-f500-4821-a7f6-44e730dd7bee 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/3/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-f6b3ad50-c791-489b-ac03-cbc48a5e2eb8 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/4/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-d6f3298e-71e2-47af-bdcd-d850040262ab 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/5/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-671b4905-6366-43d4-af03-c9cff0500660 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/6/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-4e049d87-1bd9-48ee-938f-1f1b31e1f6d0 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/7/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-fcd01f75-6c84-4c5f-a29a-21a45c9ae976 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/8/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-54962af5-9482-454f-8e64-bdf6fab224a0 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/9/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-9d1fa8e3-fc7b-4611-8cc3-7e13893a65b1 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/10/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-f7aed7d6-c421-4b9a-b07e-d686ed216b5d 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/11/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-192955f8-897d-4275-87fd-5a18cf0b05fe 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/12/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-238d087c-f093-4ad5-96d9-afb8c3972e55 17/03/01 04:11:01 INFO storage.MemoryStore: MemoryStore started with capacity 7.8 GB 17/03/01 04:11:01 INFO executor.CoarseGrainedExecutorBackend: Connecting to driver: akka.tcp://sparkDriver@ipaddress:38995/user/CoarseGrainedScheduler 17/03/01 04:11:01 INFO executor.CoarseGrainedExecutorBackend: Successfully registered with driver 17/03/01 04:11:01 INFO executor.Executor: Starting executor ID 18 on host hostName 17/03/01 04:11:01 INFO util.Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 32912. 17/03/01 04:11:01 INFO netty.NettyBlockTransferService: Server created on 32912 17/03/01 04:11:01 INFO storage.BlockManagerMaster: Trying to register BlockManager 17/03/01 04:11:01 INFO storage.BlockManagerMaster: Registered BlockManager 17/03/01 04:11:02 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 7 17/03/01 04:11:02 INFO executor.Executor: Running task 7.0 in stage 0.0 (TID 7) 17/03/01 04:11:02 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 0 17/03/01 04:11:02 INFO storage.MemoryStore: ensureFreeSpace(1310) called with curMem=0, maxMem=8334920908 17/03/01 04:11:02 INFO storage.MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 1310.0 B, free 7.8 GB) 17/03/01 04:11:02 INFO broadcast.TorrentBroadcast: Reading broadcast variable 0 took 237 ms 17/03/01 04:11:02 INFO storage.MemoryStore: ensureFreeSpace(2064) called with curMem=1310, maxMem=8334920908 17/03/01 04:11:02 INFO storage.MemoryStore: Block broadcast_0 stored as values in memory (estimated size 2.0 KB, free 7.8 GB) 17/03/01 04:11:02 INFO resolver.CompanyResolverSparkTest: Ranjit exec test 17/03/01 04:11:02 INFO executor.Executor: Finished task 7.0 in stage 0.0 (TID 7). 972 bytes result sent to driver 17/03/01 04:12:16 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 77 17/03/01 04:12:16 INFO executor.Executor: Running task 47.0 in stage 2.0 (TID 77) 17/03/01 04:12:16 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 84 17/03/01 04:12:17 INFO storage.MemoryStore: ensureFreeSpace(9240) called with curMem=3374, maxMem=8334920908 17/03/01 04:12:17 INFO storage.MemoryStore: Block broadcast_84_piece0 stored as bytes in memory (estimated size 9.0 KB, free 7.8 GB) 17/03/01 04:12:17 INFO broadcast.TorrentBroadcast: Reading broadcast variable 84 took 44 ms 17/03/01 04:12:17 INFO storage.MemoryStore: ensureFreeSpace(32704) called with curMem=12614, maxMem=8334920908 17/03/01 04:12:17 INFO storage.MemoryStore: Block broadcast_84 stored as values in memory (estimated size 31.9 KB, free 7.8 GB) 17/03/01 04:12:17 INFO codegen.GenerateMutableProjection: Code generated in 87.854431 ms 17/03/01 04:12:17 INFO codegen.GenerateUnsafeProjection: Code generated in 8.514669 ms 17/03/01 04:12:17 INFO codegen.GenerateMutableProjection: Code generated in 11.944224 ms 17/03/01 04:12:17 INFO codegen.GenerateUnsafeRowJoiner: Code generated in 7.092985 ms 17/03/01 04:12:17 INFO codegen.GenerateUnsafeProjection: Code generated in 6.922414 ms 17/03/01 04:12:17 INFO rdd.HadoopRDD: Input split: avro path/part-r-00010-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:101914535+101914535 17/03/01 04:12:17 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 67 17/03/01 04:12:17 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=45318, maxMem=8334920908 17/03/01 04:12:17 INFO storage.MemoryStore: Block broadcast_67_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:12:17 INFO broadcast.TorrentBroadcast: Reading broadcast variable 67 took 14 ms 17/03/01 04:12:17 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=69961, maxMem=8334920908 17/03/01 04:12:17 INFO storage.MemoryStore: Block broadcast_67 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:12:18 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 17/03/01 04:12:18 INFO Configuration.deprecation: mapred.tip.id is deprecated. Instead, use mapreduce.task.id 17/03/01 04:12:18 INFO Configuration.deprecation: mapred.task.id is deprecated. Instead, use mapreduce.task.attempt.id 17/03/01 04:12:18 INFO Configuration.deprecation: mapred.task.is.map is deprecated. Instead, use mapreduce.task.ismap 17/03/01 04:12:18 INFO Configuration.deprecation: mapred.task.partition is deprecated. Instead, use mapreduce.task.partition 17/03/01 04:12:18 INFO Configuration.deprecation: mapred.job.id is deprecated. Instead, use mapreduce.job.id 17/03/01 04:12:18 WARN security.UserGroupInformation: PriviledgedActionException as:userName (auth:SIMPLE) cause:org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:12:18 WARN ipc.Client: Exception encountered while connecting to the server : org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:12:18 WARN security.UserGroupInformation: PriviledgedActionException as:userName (auth:SIMPLE) cause:org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:12:23 INFO executor.Executor: Finished task 47.0 in stage 2.0 (TID 77). 2495 bytes result sent to driver 17/03/01 04:12:31 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 117 17/03/01 04:12:31 INFO executor.Executor: Running task 11.0 in stage 2.0 (TID 117) 17/03/01 04:12:31 INFO rdd.HadoopRDD: Input split: avro path/part-r-00005-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:42826875+42826876 17/03/01 04:12:31 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 49 17/03/01 04:12:31 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=417033, maxMem=8334920908 17/03/01 04:12:31 INFO storage.MemoryStore: Block broadcast_49_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:12:31 INFO broadcast.TorrentBroadcast: Reading broadcast variable 49 took 9 ms 17/03/01 04:12:31 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=441676, maxMem=8334920908 17/03/01 04:12:31 INFO storage.MemoryStore: Block broadcast_49 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:12:33 INFO executor.Executor: Finished task 11.0 in stage 2.0 (TID 117). 2495 bytes result sent to driver 17/03/01 04:12:38 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 144 17/03/01 04:12:38 INFO executor.Executor: Running task 22.0 in stage 4.0 (TID 144) 17/03/01 04:12:38 INFO spark.MapOutputTrackerWorker: Updating epoch to 1 and clearing cache 17/03/01 04:12:38 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 86 17/03/01 04:12:38 INFO storage.MemoryStore: ensureFreeSpace(2290) called with curMem=788748, maxMem=8334920908 17/03/01 04:12:38 INFO storage.MemoryStore: Block broadcast_86_piece0 stored as bytes in memory (estimated size 2.2 KB, free 7.8 GB) 17/03/01 04:12:38 INFO broadcast.TorrentBroadcast: Reading broadcast variable 86 took 7 ms 17/03/01 04:12:38 INFO storage.MemoryStore: ensureFreeSpace(6544) called with curMem=791038, maxMem=8334920908 17/03/01 04:12:38 INFO storage.MemoryStore: Block broadcast_86 stored as values in memory (estimated size 6.4 KB, free 7.8 GB) 17/03/01 04:12:38 INFO resolver.CompanyResolverSparkTest: testing worker[ipaddress:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509] 17/03/01 04:12:38 ERROR : Failed to resolve default logging config file: config/java.util.logging.properties Console logging handler is not configured. 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: >>> __________ ________________ >>> / _/ ___/ |/ / _/_ __/ __/ >>> _/ // (7 7 // / / / / _/ >>> /___/\___/_/|_/___/ /_/ /___/ >>> >>> ver. 1.8.0#20161205-sha1:9ca40dbe >>> 2016 Copyright(C) Apache Software Foundation >>> >>> Ignite documentation: http://ignite.apache.org 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Config URL: n/a 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Daemon mode: off 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: OS: Linux 2.6.32-431.5.1.el6.x86_64 amd64 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: OS user: userName 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: PID: 23211 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Language runtime: Java Platform API Specification ver. 1.8 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM information: Java(TM) SE Runtime Environment 1.8.0_60-b27 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.60-b23 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM total memory: 14.0GB 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Remote Management [restart: off, REST: on, JMX (remote: off)] 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: IGNITE_HOME=null 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM arguments: [-XX:OnOutOfMemoryError=kill %p, -Xms15360m, -Xmx15360m, -Djava.io.tmpdir=/data/7/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/container_e76_1487862040010_131981_01_000021/tmp, -Dspark.driver.port=38995, -Dspark.ui.port=0, -Dspark.yarn.app.container.log.dir=/data/2/yarn/log/container/application_1487862040010_131981/container_e76_1487862040010_131981_01_000021] 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Configured caches ['ignite-marshaller-sys-cache', 'ignite-sys-cache', 'ignite-atomics-sys-cache'] 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: Configured plugins: 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: ^-- None 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: IPC shared memory server endpoint started [port=48100, tokDir=/data/7/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/container_e76_1487862040010_131981_01_000021/tmp/ignite/work/ipc/shmem/ddc47224-d030-4d1f-ba66-08f61368a395-23211] 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: Successfully bound shared memory communication to TCP port [port=48100, locHost=0.0.0.0/0.0.0.0] 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: Successfully bound to TCP port [port=47100, locHost=0.0.0.0/0.0.0.0] 17/03/01 04:12:38 WARN noop.NoopCheckpointSpi: Checkpoints are disabled (to enable configure any GridCheckpointSpi implementation) 17/03/01 04:12:38 WARN collision.GridCollisionManager: Collision resolution is disabled (all jobs will be activated upon arrival). 17/03/01 04:12:38 WARN noop.NoopSwapSpaceSpi: Swap space is disabled. To enable use FileSwapSpaceSpi. 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Security status [authentication=off, tls/ssl=off] 17/03/01 04:12:39 INFO tcp.GridTcpRestProtocol: Command protocol successfully started [name=TCP binary, host=0.0.0.0/0.0.0.0, port=11211] 17/03/01 04:12:39 INFO internal.IgniteKernal%WCA: Non-loopback local IPs: 4 17/03/01 04:12:39 INFO internal.IgniteKernal%WCA: Enabled local MACs: B083FEE1A8DB 17/03/01 04:12:39 INFO tcp.TcpDiscoverySpi: Successfully bound to TCP port [port=47500, localHost=0.0.0.0/0.0.0.0, locNodeId=ddc47224-d030-4d1f-ba66-08f61368a395] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=47c1a0d8-9d4d-4d0d-9b27-388bd7f49278, addrs=[1, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/1:47500], discPort=47500, order=18, intOrder=18, lastExchangeTime=1488363161241, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=18, servers=18, clients=0, CPUs=744, heap=290.0GB] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=e87f12ce-5981-4418-8468-f6bfed0a0cd8, addrs=[6, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/6:47500], discPort=47500, order=19, intOrder=19, lastExchangeTime=1488363161251, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=19, servers=19, clients=0, CPUs=784, heap=310.0GB] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=e2cba212-89dd-48dd-8d7e-821b5725fe03, addrs=[8, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/8:47500], discPort=47500, order=20, intOrder=20, lastExchangeTime=1488363161281, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=20, servers=20, clients=0, CPUs=816, heap=320.0GB] 17/03/01 04:12:41 INFO cache.GridCacheProcessor: Started cache [name=ignite-sys-cache, mode=REPLICATED] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=f9ce8dd7-2060-4c34-b597-d7bee86ebedb, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=21, intOrder=21, lastExchangeTime=1488363161291, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=21, servers=21, clients=0, CPUs=856, heap=340.0GB] 17/03/01 04:12:41 INFO cache.GridCacheProcessor: Started cache [name=ignite-atomics-sys-cache, mode=PARTITIONED] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=6b1889dd-9de5-4f1b-8ec9-c123c7df8ea2, addrs=[, 127.0.0.1], sockAddrs=[hostName/:47500, /127.0.0.1:47500], discPort=47500, order=22, intOrder=22, lastExchangeTime=1488363161301, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=22, servers=22, clients=0, CPUs=896, heap=350.0GB] 17/03/01 04:12:42 INFO cache.GridCacheProcessor: Started cache [name=WCAIgniteCache, mode=PARTITIONED] 17/03/01 04:12:42 INFO cache.GridCacheProcessor: Started cache [name=ignite-marshaller-sys-cache, mode=REPLICATED] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=9fb6e583-cea0-4f78-b403-b403a8bc9a0e, addrs=[7, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/7:47500], discPort=47500, order=23, intOrder=23, lastExchangeTime=1488363161301, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=23, servers=23, clients=0, CPUs=936, heap=370.0GB] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=20860cae-2881-4311-a3f5-edaa160ef37f, addrs=[7, 127.0.0.1], sockAddrs=[hostName/7:47500, /127.0.0.1:47500], discPort=47500, order=24, intOrder=24, lastExchangeTime=1488363161311, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=24, servers=24, clients=0, CPUs=976, heap=380.0GB] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=0d675d57-b9b9-4cff-a994-77337d618bbe, addrs=[4, 127.0.0.1], sockAddrs=[hostName/4:47500, /127.0.0.1:47500], discPort=47500, order=25, intOrder=25, lastExchangeTime=1488363161321, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=25, servers=25, clients=0, CPUs=1016, heap=400.0GB] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=17, minorTopVer=0], evt=NODE_JOINED, node=ddc47224-d030-4d1f-ba66-08f61368a395] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=a6343860-6e84-4d9c-9b87-84ffd76280cd, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=26, intOrder=26, lastExchangeTime=1488363161321, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=26, servers=26, clients=0, CPUs=1056, heap=410.0GB] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=18, minorTopVer=0], evt=NODE_JOINED, node=47c1a0d8-9d4d-4d0d-9b27-388bd7f49278] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=19, minorTopVer=0], evt=NODE_JOINED, node=e87f12ce-5981-4418-8468-f6bfed0a0cd8] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=479b18e6-54af-4313-85f7-c7525f6229a4, addrs=[, 127.0.0.1], sockAddrs=[hostName/:47500, /127.0.0.1:47500], discPort=47500, order=27, intOrder=27, lastExchangeTime=1488363161341, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=27, servers=27, clients=0, CPUs=1104, heap=430.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=20, minorTopVer=0], evt=NODE_JOINED, node=e2cba212-89dd-48dd-8d7e-821b5725fe03] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=058a99e8-3b65-4ec9-84b0-6f3502c2afce, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=28, intOrder=28, lastExchangeTime=1488363161361, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=28, servers=28, clients=0, CPUs=1144, heap=440.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=21, minorTopVer=0], evt=NODE_JOINED, node=f9ce8dd7-2060-4c34-b597-d7bee86ebedb] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=57c09d88-a4dc-4179-98b4-1144fd97d8cc, addrs=[35, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/35:47500], discPort=47500, order=29, intOrder=29, lastExchangeTime=1488363161361, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=29, servers=29, clients=0, CPUs=1192, heap=460.0GB] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=58298821-7aa9-4b58-ba15-e7f1ef2830fb, addrs=[3, 127.0.0.1], sockAddrs=[hostName/3:47500, /127.0.0.1:47500], discPort=47500, order=30, intOrder=30, lastExchangeTime=1488363161371, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=30, servers=30, clients=0, CPUs=1232, heap=470.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=22, minorTopVer=0], evt=NODE_JOINED, node=6b1889dd-9de5-4f1b-8ec9-c123c7df8ea2] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4d5de2f3-d975-4b28-b593-0cc0481cdc74, addrs=[03, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/03:47500], discPort=47500, order=31, intOrder=31, lastExchangeTime=1488363161382, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=31, servers=31, clients=0, CPUs=1280, heap=490.0GB] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=fa09caab-f4dc-43b6-ac8b-4a4bae6e7da6, addrs=[01, 127.0.0.1], sockAddrs=[hostName/01:47500, /127.0.0.1:47500], discPort=47500, order=32, intOrder=32, lastExchangeTime=1488363161523, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=32, servers=32, clients=0, CPUs=1320, heap=500.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=23, minorTopVer=0], evt=NODE_JOINED, node=9fb6e583-cea0-4f78-b403-b403a8bc9a0e] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=24, minorTopVer=0], evt=NODE_JOINED, node=20860cae-2881-4311-a3f5-edaa160ef37f] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=af5837f0-25ec-4f3d-a1c1-90c09dc424cb, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=33, intOrder=33, lastExchangeTime=1488363161655, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=33, servers=33, clients=0, CPUs=1360, heap=520.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=25, minorTopVer=0], evt=NODE_JOINED, node=0d675d57-b9b9-4cff-a994-77337d618bbe] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=e9e49d2d-5eeb-474f-8757-e447efc8ca8f, addrs=[6, 127.0.0.1], sockAddrs=[hostName/6:47500, /127.0.0.1:47500], discPort=47500, order=34, intOrder=34, lastExchangeTime=1488363161655, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=34, servers=34, clients=0, CPUs=1400, heap=530.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=26, minorTopVer=0], evt=NODE_JOINED, node=a6343860-6e84-4d9c-9b87-84ffd76280cd] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4b90e5a3-253a-435b-84ca-6b592610cf0c, addrs=[4, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/4:47500], discPort=47500, order=35, intOrder=35, lastExchangeTime=1488363161665, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=35, servers=35, clients=0, CPUs=1432, heap=550.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=27, minorTopVer=0], evt=NODE_JOINED, node=479b18e6-54af-4313-85f7-c7525f6229a4] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=8fd4eea2-2a45-4563-ae87-1848fd388a98, addrs=[3, 127.0.0.1], sockAddrs=[hostName/3:47500, /127.0.0.1:47500], discPort=47500, order=36, intOrder=36, lastExchangeTime=1488363161665, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=36, servers=36, clients=0, CPUs=1472, heap=560.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=28, minorTopVer=0], evt=NODE_JOINED, node=058a99e8-3b65-4ec9-84b0-6f3502c2afce] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=d7b45a02-0411-4028-acdf-f004e592f294, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=37, intOrder=37, lastExchangeTime=1488363161957, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=37, servers=37, clients=0, CPUs=1512, heap=580.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=29, minorTopVer=0], evt=NODE_JOINED, node=57c09d88-a4dc-4179-98b4-1144fd97d8cc] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=cf4e6e83-207e-42da-a55c-5621bc20b891, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=38, intOrder=38, lastExchangeTime=1488363162715, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=38, servers=38, clients=0, CPUs=1552, heap=590.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=30, minorTopVer=0], evt=NODE_JOINED, node=58298821-7aa9-4b58-ba15-e7f1ef2830fb] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=d8926a2c-2c00-4445-beb4-633c2d656c41, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=39, intOrder=39, lastExchangeTime=1488363162725, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=39, servers=39, clients=0, CPUs=1584, heap=610.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=31, minorTopVer=0], evt=NODE_JOINED, node=4d5de2f3-d975-4b28-b593-0cc0481cdc74] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4136a0c9-14d5-42b3-9a60-81689c800438, addrs=[3, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/3:47500], discPort=47500, order=40, intOrder=40, lastExchangeTime=1488363162937, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=40, servers=40, clients=0, CPUs=1624, heap=620.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=32, minorTopVer=0], evt=NODE_JOINED, node=fa09caab-f4dc-43b6-ac8b-4a4bae6e7da6] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=694a80b8-02a3-44c9-a2dd-45bed7d20a50, addrs=[1, 127.0.0.1], sockAddrs=[hostName/1:47500, /127.0.0.1:47500], discPort=47500, order=41, intOrder=41, lastExchangeTime=1488363162947, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=41, servers=41, clients=0, CPUs=1664, heap=640.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=33, minorTopVer=0], evt=NODE_JOINED, node=af5837f0-25ec-4f3d-a1c1-90c09dc424cb] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=34, minorTopVer=0], evt=NODE_JOINED, node=e9e49d2d-5eeb-474f-8757-e447efc8ca8f] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=35, minorTopVer=0], evt=NODE_JOINED, node=4b90e5a3-253a-435b-84ca-6b592610cf0c] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=36, minorTopVer=0], evt=NODE_JOINED, node=8fd4eea2-2a45-4563-ae87-1848fd388a98] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=37, minorTopVer=0], evt=NODE_JOINED, node=d7b45a02-0411-4028-acdf-f004e592f294] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=38, minorTopVer=0], evt=NODE_JOINED, node=cf4e6e83-207e-42da-a55c-5621bc20b891] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=39, minorTopVer=0], evt=NODE_JOINED, node=d8926a2c-2c00-4445-beb4-633c2d656c41] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=40, minorTopVer=0], evt=NODE_JOINED, node=4136a0c9-14d5-42b3-9a60-81689c800438] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-sys-cache, waitList=[]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-marshaller-sys-cache, waitList=[]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-atomics-sys-cache, waitList=[ignite-sys-cache, ignite-marshaller-sys-cache]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=WCAIgniteCache, waitList=[ignite-sys-cache, ignite-marshaller-sys-cache, ignite-atomics-sys-cache]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Rebalancing required [top=AffinityTopologyVersion [topVer=41, minorTopVer=0], evt=NODE_JOINED, node=694a80b8-02a3-44c9-a2dd-45bed7d20a50] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-marshaller-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=20, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=25] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=100, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=25] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-marshaller-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=20 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=30 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-atomics-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=23, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=25] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-atomics-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=0 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=WCAIgniteCache, mode=ASYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=23, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=25] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=WCAIgniteCache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=0 ms] 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: >>> +----------------------------------------------------------------------+ >>> Ignite ver. 1.8.0#20161205-sha1:9ca40dbeb7d559fcb299bdb6f5c90cdf8ce7e533 >>> +----------------------------------------------------------------------+ >>> OS name: Linux 2.6.32-431.5.1.el6.x86_64 amd64 >>> CPU(s): 40 >>> Heap: 15.0GB >>> VM name: 23211@hostName >>> Grid name: WCA >>> Local node [ID=DDC47224-D030-4D1F-BA66-08F61368A395, order=17, clientMode=false] >>> Local node addresses: [hostName/4, /127.0.0.1] >>> Local ports: TCP:11211 TCP:47100 TCP:47500 TCP:48100 17/03/01 04:12:47 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=17, servers=17, clients=0, CPUs=704, heap=280.0GB] 17/03/01 04:12:47 INFO resolver.CompanyResolverSparkTest: Started ignite node on executor 17/03/01 04:12:47 INFO executor.Executor: Finished task 22.0 in stage 4.0 (TID 144). 931 bytes result sent to driver 17/03/01 04:12:49 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=41, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, node=6172ee3a-eb33-4bf5-9080-c255f52caed8] 17/03/01 04:12:52 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 180 17/03/01 04:12:52 INFO executor.Executor: Running task 47.0 in stage 5.0 (TID 180) 17/03/01 04:12:52 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 128 17/03/01 04:12:52 INFO storage.MemoryStore: ensureFreeSpace(7311) called with curMem=0, maxMem=8334920908 17/03/01 04:12:52 INFO storage.MemoryStore: Block broadcast_128_piece0 stored as bytes in memory (estimated size 7.1 KB, free 7.8 GB) 17/03/01 04:12:52 INFO broadcast.TorrentBroadcast: Reading broadcast variable 128 took 9 ms 17/03/01 04:12:52 INFO storage.MemoryStore: ensureFreeSpace(28168) called with curMem=7311, maxMem=8334920908 17/03/01 04:12:52 INFO storage.MemoryStore: Block broadcast_128 stored as values in memory (estimated size 27.5 KB, free 7.8 GB) 17/03/01 04:12:52 INFO rdd.HadoopRDD: Input split: avro path/part-r-00010-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:101914535+101914535 17/03/01 04:12:52 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 111 17/03/01 04:12:52 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=35479, maxMem=8334920908 17/03/01 04:12:52 INFO storage.MemoryStore: Block broadcast_111_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:12:52 INFO broadcast.TorrentBroadcast: Reading broadcast variable 111 took 6 ms 17/03/01 04:12:52 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=60122, maxMem=8334920908 17/03/01 04:12:52 INFO storage.MemoryStore: Block broadcast_111 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:13:11 INFO executor.Executor: Finished task 47.0 in stage 5.0 (TID 180). 2098 bytes result sent to driver 17/03/01 04:13:33 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 235 17/03/01 04:13:33 INFO executor.Executor: Running task 11.0 in stage 5.0 (TID 235) 17/03/01 04:13:33 INFO rdd.HadoopRDD: Input split: avro path/part-r-00005-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:42826875+42826876 17/03/01 04:13:33 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 93 17/03/01 04:13:33 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=407194, maxMem=8334920908 17/03/01 04:13:33 INFO storage.MemoryStore: Block broadcast_93_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:13:33 INFO broadcast.TorrentBroadcast: Reading broadcast variable 93 took 22 ms 17/03/01 04:13:33 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=431837, maxMem=8334920908 17/03/01 04:13:33 INFO storage.MemoryStore: Block broadcast_93 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:13:43 INFO executor.Executor: Finished task 11.0 in stage 5.0 (TID 235). 2098 bytes result sent to driver 17/03/01 04:13:47 INFO internal.IgniteKernal%WCA: Metrics for local node (to disable set 'metricsLogFrequency' to 0) ^-- Node [id=ddc47224, name=WCA, uptime=00:01:00:020] ^-- H/N/C [hosts=41, nodes=41, CPUs=1664] ^-- CPU [cur=2.53%, avg=3.45%, GC=0%] ^-- Heap [used=4354MB, free=70.45%, comm=14736MB] ^-- Non heap [used=120MB, free=-1%, comm=122MB] ^-- Public thread pool [active=0, idle=0, qSize=0] ^-- System thread pool [active=1, idle=79, qSize=0] ^-- Outbound messages queue [size=0] 17/03/01 04:13:51 INFO cluster.GridUpdateNotifier: Update status is not available. 17/03/01 04:14:00 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 244 17/03/01 04:14:00 INFO executor.Executor: Running task 0.0 in stage 7.0 (TID 244) 17/03/01 04:14:00 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 131 17/03/01 04:14:00 INFO storage.MemoryStore: ensureFreeSpace(2732) called with curMem=778909, maxMem=8334920908 17/03/01 04:14:00 INFO storage.MemoryStore: Block broadcast_131_piece0 stored as bytes in memory (estimated size 2.7 KB, free 7.8 GB) 17/03/01 04:14:00 INFO broadcast.TorrentBroadcast: Reading broadcast variable 131 took 18 ms 17/03/01 04:14:00 INFO storage.MemoryStore: ensureFreeSpace(7336) called with curMem=781641, maxMem=8334920908 17/03/01 04:14:00 INFO storage.MemoryStore: Block broadcast_131 stored as values in memory (estimated size 7.2 KB, free 7.8 GB) 17/03/01 04:14:00 INFO dao.CompanyDAO: testing[ipaddress:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509] 17/03/01 04:14:00 INFO dao.CompanyDAO: input company name inside Contains searchAUSTIN TRINITY SCHOOL 17/03/01 04:14:10 ERROR executor.Executor: Exception in task 0.0 in stage 7.0 (TID 244) javax.cache.CacheException: class org.apache.ignite.IgniteCheckedException: Query execution failed: GridCacheQueryBean [qry=GridCacheQueryAdapter [type=TEXT, clsName=CompanyVO1, clause=AUSTIN TRINITY SCHOOL, filter=null, transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=true, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=ddc47224-d030-4d1f-ba66-08f61368a395, taskHash=0], rdc=null, trans=null] at org.apache.ignite.internal.processors.cache.GridCacheUtils.convertToCacheException(GridCacheUtils.java:1440) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.next(GridCacheQueryFutureAdapter.java:174) at org.apache.ignite.internal.processors.cache.IgniteCacheProxy$5.onHasNext(IgniteCacheProxy.java:600) at org.apache.ignite.internal.util.GridCloseableIteratorAdapter.hasNextX(GridCloseableIteratorAdapter.java:53) at org.apache.ignite.internal.util.lang.GridIteratorAdapter.hasNext(GridIteratorAdapter.java:45) at un.api.resolver.dao.CompanyDAO.getVarCompContains(CompanyDAO.scala:242) at un.api.resolver.accessor.CompanyAccessor.getVarCompContains(CompanyAccessor.scala:27) at un.api.resolver.CompanyResolverSparkTest$$anonfun$main$7.apply(CompanyResolverSparkTest.scala:291) at un.api.resolver.CompanyResolverSparkTest$$anonfun$main$7.apply(CompanyResolverSparkTest.scala:289) at scala.collection.Iterator$$anon$11.next(Iterator.scala:328) at org.apache.spark.util.Utils$.getIteratorSize(Utils.scala:1554) at org.apache.spark.rdd.RDD$$anonfun$count$1.apply(RDD.scala:1121) at org.apache.spark.rdd.RDD$$anonfun$count$1.apply(RDD.scala:1121) at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1850) at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1850) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:66) at org.apache.spark.scheduler.Task.run(Task.scala:88) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:214) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: class org.apache.ignite.IgniteCheckedException: Query execution failed: GridCacheQueryBean [qry=GridCacheQueryAdapter [type=TEXT, clsName=CompanyVO1, clause=AUSTIN TRINITY SCHOOL, filter=null, transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=true, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=ddc47224-d030-4d1f-ba66-08f61368a395, taskHash=0], rdc=null, trans=null] at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.checkError(GridCacheQueryFutureAdapter.java:260) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.internalIterator(GridCacheQueryFutureAdapter.java:318) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.next(GridCacheQueryFutureAdapter.java:164) ... 19 more Caused by: class org.apache.ignite.IgniteCheckedException: Failed to execute query on node [query=GridCacheQueryBean [qry=GridCacheQueryAdapter [type=TEXT, clsName=CompanyVO1, clause=AUSTIN TRINITY SCHOOL, filter=null, transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=true, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=ddc47224-d030-4d1f-ba66-08f61368a395, taskHash=0], rdc=null, trans=null], nodeId=90db2cab-26f6-463d-9755-d03d059a8723] at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.onPage(GridCacheQueryFutureAdapter.java:383) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.processQueryResponse(GridCacheDistributedQueryManager.java:398) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.access$000(GridCacheDistributedQueryManager.java:63) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$1.apply(GridCacheDistributedQueryManager.java:93) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$1.apply(GridCacheDistributedQueryManager.java:91) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.processMessage(GridCacheIoManager.java:827) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.onMessage0(GridCacheIoManager.java:369) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.access$400(GridCacheIoManager.java:95) at org.apache.ignite.internal.processors.cache.GridCacheIoManager$OrderedMessageListener.onMessage(GridCacheIoManager.java:1345) at org.apache.ignite.internal.managers.communication.GridIoManager.invokeListener(GridIoManager.java:1082) at org.apache.ignite.internal.managers.communication.GridIoManager.access$1600(GridIoManager.java:102) at org.apache.ignite.internal.managers.communication.GridIoManager$GridCommunicationMessageSet.unwind(GridIoManager.java:2332) at org.apache.ignite.internal.managers.communication.GridIoManager.unwindMessageSet(GridIoManager.java:1042) at org.apache.ignite.internal.managers.communication.GridIoManager.access$1900(GridIoManager.java:102) at org.apache.ignite.internal.managers.communication.GridIoManager$6.run(GridIoManager.java:1011) ... 3 more Caused by: java.lang.NullPointerException at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneFile.numBuffers(GridLuceneFile.java:109) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneInputStream.switchCurrentBuffer(GridLuceneInputStream.java:132) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneInputStream.seek(GridLuceneInputStream.java:224) at org.apache.lucene.index.CompoundFileReader$CSIndexInput.readInternal(CompoundFileReader.java:273) at org.apache.lucene.store.BufferedIndexInput.refill(BufferedIndexInput.java:229) at org.apache.lucene.store.BufferedIndexInput.readByte(BufferedIndexInput.java:39) at org.apache.lucene.store.DataInput.readInt(DataInput.java:84) at org.apache.lucene.store.BufferedIndexInput.readInt(BufferedIndexInput.java:169) at org.apache.lucene.store.DataInput.readLong(DataInput.java:126) at org.apache.lucene.store.BufferedIndexInput.readLong(BufferedIndexInput.java:182) at org.apache.lucene.index.FieldsReader.doc(FieldsReader.java:231) at org.apache.lucene.index.SegmentReader.document(SegmentReader.java:477) at org.apache.lucene.index.DirectoryReader.document(DirectoryReader.java:583) at org.apache.lucene.index.IndexReader.document(IndexReader.java:1115) at org.apache.lucene.search.IndexSearcher.doc(IndexSearcher.java:258) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneIndex$It.findNext(GridLuceneIndex.java:383) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneIndex$It.onNext(GridLuceneIndex.java:415) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneIndex$It.onNext(GridLuceneIndex.java:299) at org.apache.ignite.internal.util.GridCloseableIteratorAdapter.nextX(GridCloseableIteratorAdapter.java:41) at org.apache.ignite.internal.util.lang.GridIteratorAdapter.next(GridIteratorAdapter.java:35) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryManager.runQuery(GridCacheQueryManager.java:1512) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.processQueryRequest(GridCacheDistributedQueryManager.java:230) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$2.apply(GridCacheDistributedQueryManager.java:108) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$2.apply(GridCacheDistributedQueryManager.java:106) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.processMessage(GridCacheIoManager.java:827) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.onMessage0(GridCacheIoManager.java:369) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.handleMessage(GridCacheIoManager.java:293) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.access$000(GridCacheIoManager.java:95) at org.apache.ignite.internal.processors.cache.GridCacheIoManager$1.onMessage(GridCacheIoManager.java:238) at org.apache.ignite.internal.managers.communication.GridIoManager.invokeListener(GridIoManager.java:1082) at org.apache.ignite.internal.managers.communication.GridIoManager.processRegularMessage0(GridIoManager.java:710) at org.apache.ignite.internal.managers.communication.GridIoManager.access$1700(GridIoManager.java:102) at org.apache.ignite.internal.managers.communication.GridIoManager$5.run(GridIoManager.java:673) ... 3 more 17/03/01 04:14:10 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=e87f12ce-5981-4418-8468-f6bfed0a0cd8, res=GridCacheQueryResponse [finished=false, reqId=411, err=null, fields=false, metadata=null]] 17/03/01 04:14:10 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=40d089f0-7c80-4f1f-8659-350791f57a4c, res=GridCacheQueryResponse [finished=false, reqId=411, err=null, fields=false, metadata=null]] 17/03/01 04:14:10 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=479b18e6-54af-4313-85f7-c7525f6229a4, res=GridCacheQueryResponse [finished=false, reqId=411, err=null, fields=false, metadata=null]] 17/03/01 04:14:10 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=90532831-88fb-4eb8-adc9-db7a86744869, res=GridCacheQueryResponse [finished=false, reqId=411, err=null, fields=false, metadata=null]] 17/03/01 04:14:10 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=daed0152-83fc-4828-ada6-64c74787b190, res=GridCacheQueryResponse [finished=false, reqId=411, err=null, fields=false, metadata=null]] 17/03/01 04:14:10 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=c4f4f6bb-b71a-4a29-9575-afee2ddc1b2d, res=GridCacheQueryResponse [finished=false, reqId=411, err=null, fields=false, metadata=null]] 17/03/01 04:14:10 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=d7b45a02-0411-4028-acdf-f004e592f294, res=GridCacheQueryResponse [finished=false, reqId=411, err=null, fields=false, metadata=null]] 17/03/01 04:14:10 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 288 17/03/01 04:14:10 INFO executor.Executor: Running task 0.1 in stage 7.0 (TID 288) 17/03/01 04:14:21 INFO executor.Executor: Finished task 0.1 in stage 7.0 (TID 288). 969 bytes result sent to driver 17/03/01 04:14:47 INFO internal.IgniteKernal%WCA: Metrics for local node (to disable set 'metricsLogFrequency' to 0) ^-- Node [id=ddc47224, name=WCA, uptime=00:02:00:050] ^-- H/N/C [hosts=41, nodes=41, CPUs=1664] ^-- CPU [cur=0.3%, avg=2.4%, GC=0%] ^-- Heap [used=4027MB, free=71.64%, comm=14204MB] ^-- Non heap [used=124MB, free=-1%, comm=126MB] ^-- Public thread pool [active=0, idle=0, qSize=0] ^-- System thread pool [active=0, idle=80, qSize=0] ^-- Outbound messages queue [size=0] 17/03/01 04:14:49 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 320 17/03/01 04:14:49 INFO executor.Executor: Running task 7.0 in stage 8.0 (TID 320) 17/03/01 04:14:49 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 132 17/03/01 04:14:49 INFO storage.MemoryStore: ensureFreeSpace(887) called with curMem=788977, maxMem=8334920908 17/03/01 04:14:49 INFO storage.MemoryStore: Block broadcast_132_piece0 stored as bytes in memory (estimated size 887.0 B, free 7.8 GB) 17/03/01 04:14:49 INFO broadcast.TorrentBroadcast: Reading broadcast variable 132 took 14 ms 17/03/01 04:14:49 INFO storage.MemoryStore: ensureFreeSpace(1216) called with curMem=789864, maxMem=8334920908 17/03/01 04:14:49 INFO storage.MemoryStore: Block broadcast_132 stored as values in memory (estimated size 1216.0 B, free 7.8 GB) 17/03/01 04:14:49 INFO tcp.GridTcpRestProtocol: Command protocol successfully stopped: TCP binary 17/03/01 04:14:51 INFO cache.GridCacheProcessor: Stopped cache: ignite-marshaller-sys-cache 17/03/01 04:14:51 INFO cache.GridCacheProcessor: Stopped cache: ignite-sys-cache 17/03/01 04:14:51 INFO cache.GridCacheProcessor: Stopped cache: ignite-atomics-sys-cache 17/03/01 04:14:51 INFO cache.GridCacheProcessor: Stopped cache: WCAIgniteCache 17/03/01 04:14:51 INFO internal.IgniteKernal%WCA: >>> +---------------------------------------------------------------------------------+ >>> Ignite ver. 1.8.0#20161205-sha1:9ca40dbeb7d559fcb299bdb6f5c90cdf8ce7e533 stopped OK >>> +---------------------------------------------------------------------------------+ >>> Grid name: WCA >>> Grid uptime: 00:02:04:221 17/03/01 04:14:51 INFO executor.Executor: Finished task 7.0 in stage 8.0 (TID 320). 931 bytes result sent to driver 17/03/01 04:14:53 INFO executor.CoarseGrainedExecutorBackend: Driver commanded a shutdown 17/03/01 04:14:53 INFO storage.MemoryStore: MemoryStore cleared 17/03/01 04:14:53 INFO storage.BlockManager: BlockManager stopped 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Shutting down remote daemon. 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remote daemon shut down; proceeding with flushing remote transports. 17/03/01 04:14:53 INFO Remoting: Remoting shut down 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remoting shut down. 17/03/01 04:14:53 INFO util.ShutdownHookManager: Shutdown hook called LogType:stdout Log Upload Time:Wed Mar 01 04:14:58 -0600 2017 LogLength:3203 Log Contents: rEnd of the programe - [04:12:38] __________ ________________ [04:12:38] / _/ ___/ |/ / _/_ __/ __/ [04:12:38] _/ // (7 7 // / / / / _/ [04:12:38] /___/\___/_/|_/___/ /_/ /___/ [04:12:38] [04:12:38] ver. 1.8.0#20161205-sha1:9ca40dbe [04:12:38] 2016 Copyright(C) Apache Software Foundation [04:12:38] [04:12:38] Ignite documentation: http://ignite.apache.org [04:12:38] [04:12:38] Quiet mode. [04:12:38] ^-- To see **FULL** console log here add -DIGNITE_QUIET=false or "-v" to ignite.{sh|bat} [04:12:38] [04:12:38] OS: Linux 2.6.32-431.5.1.el6.x86_64 amd64 [04:12:38] VM information: Java(TM) SE Runtime Environment 1.8.0_60-b27 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.60-b23 [04:12:38] Configured plugins: [04:12:38] ^-- None [04:12:38] [04:12:38] Security status [authentication=off, tls/ssl=off] [04:12:41] Topology snapshot [ver=18, servers=18, clients=0, CPUs=744, heap=290.0GB] [04:12:41] Topology snapshot [ver=19, servers=19, clients=0, CPUs=784, heap=310.0GB] [04:12:41] Topology snapshot [ver=20, servers=20, clients=0, CPUs=816, heap=320.0GB] [04:12:41] Topology snapshot [ver=21, servers=21, clients=0, CPUs=856, heap=340.0GB] [04:12:42] Topology snapshot [ver=22, servers=22, clients=0, CPUs=896, heap=350.0GB] [04:12:42] Topology snapshot [ver=23, servers=23, clients=0, CPUs=936, heap=370.0GB] [04:12:42] Topology snapshot [ver=24, servers=24, clients=0, CPUs=976, heap=380.0GB] [04:12:42] Topology snapshot [ver=25, servers=25, clients=0, CPUs=1016, heap=400.0GB] [04:12:42] Topology snapshot [ver=26, servers=26, clients=0, CPUs=1056, heap=410.0GB] [04:12:42] Topology snapshot [ver=27, servers=27, clients=0, CPUs=1104, heap=430.0GB] [04:12:43] Topology snapshot [ver=28, servers=28, clients=0, CPUs=1144, heap=440.0GB] [04:12:43] Topology snapshot [ver=29, servers=29, clients=0, CPUs=1192, heap=460.0GB] [04:12:43] Topology snapshot [ver=30, servers=30, clients=0, CPUs=1232, heap=470.0GB] [04:12:43] Topology snapshot [ver=31, servers=31, clients=0, CPUs=1280, heap=490.0GB] [04:12:43] Topology snapshot [ver=32, servers=32, clients=0, CPUs=1320, heap=500.0GB] [04:12:43] Topology snapshot [ver=33, servers=33, clients=0, CPUs=1360, heap=520.0GB] [04:12:44] Topology snapshot [ver=34, servers=34, clients=0, CPUs=1400, heap=530.0GB] [04:12:44] Topology snapshot [ver=35, servers=35, clients=0, CPUs=1432, heap=550.0GB] [04:12:44] Topology snapshot [ver=36, servers=36, clients=0, CPUs=1472, heap=560.0GB] [04:12:44] Topology snapshot [ver=37, servers=37, clients=0, CPUs=1512, heap=580.0GB] [04:12:44] Topology snapshot [ver=38, servers=38, clients=0, CPUs=1552, heap=590.0GB] [04:12:45] Topology snapshot [ver=39, servers=39, clients=0, CPUs=1584, heap=610.0GB] [04:12:45] Topology snapshot [ver=40, servers=40, clients=0, CPUs=1624, heap=620.0GB] [04:12:45] Topology snapshot [ver=41, servers=41, clients=0, CPUs=1664, heap=640.0GB] [04:12:47] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [04:12:47] [04:12:47] Ignite node started OK (id=ddc47224, grid=WCA) [04:12:47] Topology snapshot [ver=17, servers=17, clients=0, CPUs=704, heap=280.0GB] [04:14:51] Ignite node stopped OK [name=WCA, uptime=00:02:04:221] Container: container_e76_1487862040010_131981_01_000030 on hostName_8041 =========================================================================================== LogType:stderr Log Upload Time:Wed Mar 01 04:14:55 -0600 2017 LogLength:47803 Log Contents: 17/03/01 04:10:59 INFO executor.CoarseGrainedExecutorBackend: Registered signal handlers for [TERM, HUP, INT] 17/03/01 04:11:00 INFO spark.SecurityManager: Changing view acls to: userName 17/03/01 04:11:00 INFO spark.SecurityManager: Changing modify acls to: userName 17/03/01 04:11:00 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(userName); users with modify permissions: Set(userName) 17/03/01 04:11:01 INFO slf4j.Slf4jLogger: Slf4jLogger started 17/03/01 04:11:01 INFO Remoting: Starting remoting 17/03/01 04:11:01 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://driverPropsFetcher@hostName:47341] 17/03/01 04:11:01 INFO Remoting: Remoting now listens on addresses: [akka.tcp://driverPropsFetcher@hostName:47341] 17/03/01 04:11:01 INFO util.Utils: Successfully started service 'driverPropsFetcher' on port 47341. 17/03/01 04:11:01 INFO spark.SecurityManager: Changing view acls to: userName 17/03/01 04:11:01 INFO spark.SecurityManager: Changing modify acls to: userName 17/03/01 04:11:01 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(userName); users with modify permissions: Set(userName) 17/03/01 04:11:01 INFO remote.RemoteActorRefProvider$RemotingTerminator: Shutting down remote daemon. 17/03/01 04:11:01 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remote daemon shut down; proceeding with flushing remote transports. 17/03/01 04:11:01 INFO slf4j.Slf4jLogger: Slf4jLogger started 17/03/01 04:11:01 INFO Remoting: Starting remoting 17/03/01 04:11:01 INFO Remoting: Remoting shut down 17/03/01 04:11:01 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remoting shut down. 17/03/01 04:11:01 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://sparkExecutor@hostName:56752] 17/03/01 04:11:01 INFO Remoting: Remoting now listens on addresses: [akka.tcp://sparkExecutor@hostName:56752] 17/03/01 04:11:01 INFO util.Utils: Successfully started service 'sparkExecutor' on port 56752. 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/1/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-fa4af875-f25a-4d8e-971a-5ed55bc8b4e9 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/2/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-02e18767-4837-4a04-82c4-4933e2008b89 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/3/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-87ecd4ea-4b0c-4003-9388-68fc559d575d 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/4/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-cb935dfe-5a19-4308-a4f0-06dd8fc6655b 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/5/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-4a8fd8a6-53ce-495a-8d8e-1e3d7374680f 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/6/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-daf2e18b-42fc-4409-a5ba-f4ab89e4ba41 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/7/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-a958a39c-29c2-447d-8ff5-d227ded7eabe 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/8/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-2a581164-1783-46d8-8972-1eda217aad8e 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/9/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-9aec6c5d-bc61-4f41-ac8a-a83cf42b9284 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/10/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-2b817404-c14a-4358-b15d-d044260ef420 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/11/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-a2272693-d3ad-48eb-b3c9-beb90bb0f028 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/12/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-24012a54-deb2-4fc4-8140-f0fe7cee2e4e 17/03/01 04:11:01 INFO storage.MemoryStore: MemoryStore started with capacity 7.8 GB 17/03/01 04:11:01 INFO executor.CoarseGrainedExecutorBackend: Connecting to driver: akka.tcp://sparkDriver@ipaddress:38995/user/CoarseGrainedScheduler 17/03/01 04:11:01 INFO executor.CoarseGrainedExecutorBackend: Successfully registered with driver 17/03/01 04:11:01 INFO executor.Executor: Starting executor ID 27 on host hostName 17/03/01 04:11:01 INFO util.Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 42418. 17/03/01 04:11:01 INFO netty.NettyBlockTransferService: Server created on 42418 17/03/01 04:11:01 INFO storage.BlockManagerMaster: Trying to register BlockManager 17/03/01 04:11:01 INFO storage.BlockManagerMaster: Registered BlockManager 17/03/01 04:11:02 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 33 17/03/01 04:11:02 INFO executor.Executor: Running task 33.0 in stage 0.0 (TID 33) 17/03/01 04:11:02 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 0 17/03/01 04:11:02 INFO storage.MemoryStore: ensureFreeSpace(1310) called with curMem=0, maxMem=8334920908 17/03/01 04:11:02 INFO storage.MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 1310.0 B, free 7.8 GB) 17/03/01 04:11:02 INFO broadcast.TorrentBroadcast: Reading broadcast variable 0 took 232 ms 17/03/01 04:11:02 INFO storage.MemoryStore: ensureFreeSpace(2064) called with curMem=1310, maxMem=8334920908 17/03/01 04:11:02 INFO storage.MemoryStore: Block broadcast_0 stored as values in memory (estimated size 2.0 KB, free 7.8 GB) 17/03/01 04:11:02 INFO resolver.CompanyResolverSparkTest: Ranjit exec test 17/03/01 04:11:02 INFO executor.Executor: Finished task 33.0 in stage 0.0 (TID 33). 972 bytes result sent to driver 17/03/01 04:12:03 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 52 17/03/01 04:12:03 INFO executor.Executor: Running task 59.0 in stage 2.0 (TID 52) 17/03/01 04:12:03 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 84 17/03/01 04:12:03 INFO storage.MemoryStore: ensureFreeSpace(9240) called with curMem=3374, maxMem=8334920908 17/03/01 04:12:03 INFO storage.MemoryStore: Block broadcast_84_piece0 stored as bytes in memory (estimated size 9.0 KB, free 7.8 GB) 17/03/01 04:12:03 INFO broadcast.TorrentBroadcast: Reading broadcast variable 84 took 10 ms 17/03/01 04:12:03 INFO storage.MemoryStore: ensureFreeSpace(32704) called with curMem=12614, maxMem=8334920908 17/03/01 04:12:03 INFO storage.MemoryStore: Block broadcast_84 stored as values in memory (estimated size 31.9 KB, free 7.8 GB) 17/03/01 04:12:04 INFO codegen.GenerateMutableProjection: Code generated in 93.212419 ms 17/03/01 04:12:04 INFO codegen.GenerateUnsafeProjection: Code generated in 9.591776 ms 17/03/01 04:12:04 INFO codegen.GenerateMutableProjection: Code generated in 12.567795 ms 17/03/01 04:12:04 INFO codegen.GenerateUnsafeRowJoiner: Code generated in 7.637525 ms 17/03/01 04:12:04 INFO codegen.GenerateUnsafeProjection: Code generated in 7.424233 ms 17/03/01 04:12:04 INFO rdd.HadoopRDD: Input split: avro path/part-r-00015-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:21430652+21430653 17/03/01 04:12:04 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 73 17/03/01 04:12:04 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=45318, maxMem=8334920908 17/03/01 04:12:04 INFO storage.MemoryStore: Block broadcast_73_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:12:04 INFO broadcast.TorrentBroadcast: Reading broadcast variable 73 took 9 ms 17/03/01 04:12:04 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=69961, maxMem=8334920908 17/03/01 04:12:04 INFO storage.MemoryStore: Block broadcast_73 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:12:04 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 17/03/01 04:12:04 INFO Configuration.deprecation: mapred.tip.id is deprecated. Instead, use mapreduce.task.id 17/03/01 04:12:04 INFO Configuration.deprecation: mapred.task.id is deprecated. Instead, use mapreduce.task.attempt.id 17/03/01 04:12:04 INFO Configuration.deprecation: mapred.task.is.map is deprecated. Instead, use mapreduce.task.ismap 17/03/01 04:12:04 INFO Configuration.deprecation: mapred.task.partition is deprecated. Instead, use mapreduce.task.partition 17/03/01 04:12:04 INFO Configuration.deprecation: mapred.job.id is deprecated. Instead, use mapreduce.job.id 17/03/01 04:12:04 WARN security.UserGroupInformation: PriviledgedActionException as:userName (auth:SIMPLE) cause:org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:12:04 WARN ipc.Client: Exception encountered while connecting to the server : org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:12:04 WARN security.UserGroupInformation: PriviledgedActionException as:userName (auth:SIMPLE) cause:org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:12:06 INFO executor.Executor: Finished task 59.0 in stage 2.0 (TID 52). 2495 bytes result sent to driver 17/03/01 04:12:38 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 133 17/03/01 04:12:38 INFO executor.Executor: Running task 11.0 in stage 4.0 (TID 133) 17/03/01 04:12:38 INFO spark.MapOutputTrackerWorker: Updating epoch to 1 and clearing cache 17/03/01 04:12:38 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 86 17/03/01 04:12:38 INFO storage.MemoryStore: ensureFreeSpace(2290) called with curMem=417033, maxMem=8334920908 17/03/01 04:12:38 INFO storage.MemoryStore: Block broadcast_86_piece0 stored as bytes in memory (estimated size 2.2 KB, free 7.8 GB) 17/03/01 04:12:38 INFO broadcast.TorrentBroadcast: Reading broadcast variable 86 took 8 ms 17/03/01 04:12:38 INFO storage.MemoryStore: ensureFreeSpace(6544) called with curMem=419323, maxMem=8334920908 17/03/01 04:12:38 INFO storage.MemoryStore: Block broadcast_86 stored as values in memory (estimated size 6.4 KB, free 7.8 GB) 17/03/01 04:12:38 INFO resolver.CompanyResolverSparkTest: testing worker[ipaddress:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509] 17/03/01 04:12:38 ERROR : Failed to resolve default logging config file: config/java.util.logging.properties Console logging handler is not configured. 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: >>> __________ ________________ >>> / _/ ___/ |/ / _/_ __/ __/ >>> _/ // (7 7 // / / / / _/ >>> /___/\___/_/|_/___/ /_/ /___/ >>> >>> ver. 1.8.0#20161205-sha1:9ca40dbe >>> 2016 Copyright(C) Apache Software Foundation >>> >>> Ignite documentation: http://ignite.apache.org 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Config URL: n/a 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Daemon mode: off 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: OS: Linux 2.6.32-431.5.1.el6.x86_64 amd64 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: OS user: userName 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: PID: 26561 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Language runtime: Java Platform API Specification ver. 1.8 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM information: Java(TM) SE Runtime Environment 1.8.0_60-b27 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.60-b23 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM total memory: 14.0GB 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Remote Management [restart: off, REST: on, JMX (remote: off)] 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: IGNITE_HOME=null 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM arguments: [-XX:OnOutOfMemoryError=kill %p, -Xms15360m, -Xmx15360m, -Djava.io.tmpdir=/data/1/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/container_e76_1487862040010_131981_01_000030/tmp, -Dspark.driver.port=38995, -Dspark.ui.port=0, -Dspark.yarn.app.container.log.dir=/data/1/yarn/log/container/application_1487862040010_131981/container_e76_1487862040010_131981_01_000030] 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Configured caches ['ignite-marshaller-sys-cache', 'ignite-sys-cache', 'ignite-atomics-sys-cache'] 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: Configured plugins: 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: ^-- None 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: IPC shared memory server endpoint started [port=48100, tokDir=/data/1/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/container_e76_1487862040010_131981_01_000030/tmp/ignite/work/ipc/shmem/4136a0c9-14d5-42b3-9a60-81689c800438-26561] 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: Successfully bound shared memory communication to TCP port [port=48100, locHost=0.0.0.0/0.0.0.0] 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: Successfully bound to TCP port [port=47100, locHost=0.0.0.0/0.0.0.0] 17/03/01 04:12:38 WARN noop.NoopCheckpointSpi: Checkpoints are disabled (to enable configure any GridCheckpointSpi implementation) 17/03/01 04:12:38 WARN collision.GridCollisionManager: Collision resolution is disabled (all jobs will be activated upon arrival). 17/03/01 04:12:38 WARN noop.NoopSwapSpaceSpi: Swap space is disabled. To enable use FileSwapSpaceSpi. 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Security status [authentication=off, tls/ssl=off] 17/03/01 04:12:39 INFO tcp.GridTcpRestProtocol: Command protocol successfully started [name=TCP binary, host=0.0.0.0/0.0.0.0, port=11211] 17/03/01 04:12:39 INFO internal.IgniteKernal%WCA: Non-loopback local IPs: 3 17/03/01 04:12:39 INFO internal.IgniteKernal%WCA: Enabled local MACs: 44A8420A54FC 17/03/01 04:12:39 INFO tcp.TcpDiscoverySpi: Successfully bound to TCP port [port=47500, localHost=0.0.0.0/0.0.0.0, locNodeId=4136a0c9-14d5-42b3-9a60-81689c800438] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=694a80b8-02a3-44c9-a2dd-45bed7d20a50, addrs=[1, 127.0.0.1], sockAddrs=[hostName/1:47500, /127.0.0.1:47500], discPort=47500, order=41, intOrder=41, lastExchangeTime=1488363165228, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=41, servers=41, clients=0, CPUs=1664, heap=640.0GB] 17/03/01 04:12:45 INFO cache.GridCacheProcessor: Started cache [name=ignite-sys-cache, mode=REPLICATED] 17/03/01 04:12:45 INFO cache.GridCacheProcessor: Started cache [name=ignite-atomics-sys-cache, mode=PARTITIONED] 17/03/01 04:12:46 INFO cache.GridCacheProcessor: Started cache [name=WCAIgniteCache, mode=PARTITIONED] 17/03/01 04:12:46 INFO cache.GridCacheProcessor: Started cache [name=ignite-marshaller-sys-cache, mode=REPLICATED] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=40, minorTopVer=0], evt=NODE_JOINED, node=4136a0c9-14d5-42b3-9a60-81689c800438] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-sys-cache, waitList=[]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-marshaller-sys-cache, waitList=[]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-atomics-sys-cache, waitList=[ignite-sys-cache, ignite-marshaller-sys-cache]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=WCAIgniteCache, waitList=[ignite-sys-cache, ignite-marshaller-sys-cache, ignite-atomics-sys-cache]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Rebalancing required [top=AffinityTopologyVersion [topVer=41, minorTopVer=0], evt=NODE_JOINED, node=694a80b8-02a3-44c9-a2dd-45bed7d20a50] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-marshaller-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=20, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=2] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=100, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=2] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-marshaller-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=10 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=10 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-atomics-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=27, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=2] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-atomics-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=10 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=WCAIgniteCache, mode=ASYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=27, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=2] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=WCAIgniteCache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=0 ms] 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: >>> +----------------------------------------------------------------------+ >>> Ignite ver. 1.8.0#20161205-sha1:9ca40dbeb7d559fcb299bdb6f5c90cdf8ce7e533 >>> +----------------------------------------------------------------------+ >>> OS name: Linux 2.6.32-431.5.1.el6.x86_64 amd64 >>> CPU(s): 40 >>> Heap: 15.0GB >>> VM name: 26561@hostName >>> Grid name: WCA >>> Local node [ID=4136A0C9-14D5-42B3-9A60-81689C800438, order=40, clientMode=false] >>> Local node addresses: [hostName/3, /127.0.0.1] >>> Local ports: TCP:11211 TCP:47100 TCP:47500 TCP:48100 17/03/01 04:12:47 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=40, servers=40, clients=0, CPUs=1624, heap=620.0GB] 17/03/01 04:12:47 INFO resolver.CompanyResolverSparkTest: Started ignite node on executor 17/03/01 04:12:47 INFO executor.Executor: Finished task 11.0 in stage 4.0 (TID 133). 931 bytes result sent to driver 17/03/01 04:12:49 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 164 17/03/01 04:12:49 INFO executor.Executor: Running task 58.0 in stage 5.0 (TID 164) 17/03/01 04:12:49 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 128 17/03/01 04:12:49 INFO storage.MemoryStore: ensureFreeSpace(7311) called with curMem=12208, maxMem=8334920908 17/03/01 04:12:49 INFO storage.MemoryStore: Block broadcast_128_piece0 stored as bytes in memory (estimated size 7.1 KB, free 7.8 GB) 17/03/01 04:12:49 INFO broadcast.TorrentBroadcast: Reading broadcast variable 128 took 7 ms 17/03/01 04:12:49 INFO storage.MemoryStore: ensureFreeSpace(28168) called with curMem=19519, maxMem=8334920908 17/03/01 04:12:49 INFO storage.MemoryStore: Block broadcast_128 stored as values in memory (estimated size 27.5 KB, free 7.8 GB) 17/03/01 04:12:49 INFO rdd.HadoopRDD: Input split: avro path/part-r-00015-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:0+21430652 17/03/01 04:12:49 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 117 17/03/01 04:12:49 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=47687, maxMem=8334920908 17/03/01 04:12:49 INFO storage.MemoryStore: Block broadcast_117_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:12:49 INFO broadcast.TorrentBroadcast: Reading broadcast variable 117 took 6 ms 17/03/01 04:12:49 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=72330, maxMem=8334920908 17/03/01 04:12:49 INFO storage.MemoryStore: Block broadcast_117 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:12:49 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=41, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, node=6172ee3a-eb33-4bf5-9080-c255f52caed8] 17/03/01 04:12:54 INFO executor.Executor: Finished task 58.0 in stage 5.0 (TID 164). 2098 bytes result sent to driver 17/03/01 04:13:47 INFO internal.IgniteKernal%WCA: Metrics for local node (to disable set 'metricsLogFrequency' to 0) ^-- Node [id=4136a0c9, name=WCA, uptime=00:01:00:008] ^-- H/N/C [hosts=41, nodes=41, CPUs=1664] ^-- CPU [cur=1.83%, avg=3.09%, GC=0%] ^-- Heap [used=4057MB, free=72.73%, comm=14879MB] ^-- Non heap [used=119MB, free=-1%, comm=121MB] ^-- Public thread pool [active=0, idle=0, qSize=0] ^-- System thread pool [active=0, idle=80, qSize=0] ^-- Outbound messages queue [size=0] 17/03/01 04:13:55 INFO cluster.GridUpdateNotifier: Update status is not available. 17/03/01 04:14:00 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 276 17/03/01 04:14:00 INFO executor.Executor: Running task 32.0 in stage 7.0 (TID 276) 17/03/01 04:14:00 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 131 17/03/01 04:14:00 INFO storage.MemoryStore: ensureFreeSpace(2732) called with curMem=407194, maxMem=8334920908 17/03/01 04:14:00 INFO storage.MemoryStore: Block broadcast_131_piece0 stored as bytes in memory (estimated size 2.7 KB, free 7.8 GB) 17/03/01 04:14:00 INFO broadcast.TorrentBroadcast: Reading broadcast variable 131 took 30 ms 17/03/01 04:14:00 INFO storage.MemoryStore: ensureFreeSpace(7336) called with curMem=409926, maxMem=8334920908 17/03/01 04:14:00 INFO storage.MemoryStore: Block broadcast_131 stored as values in memory (estimated size 7.2 KB, free 7.8 GB) 17/03/01 04:14:12 ERROR executor.Executor: Exception in task 32.0 in stage 7.0 (TID 276) javax.cache.CacheException: class org.apache.ignite.IgniteCheckedException: Query execution failed: GridCacheQueryBean [qry=GridCacheQueryAdapter [type=TEXT, clsName=CompanyVO1, clause=APWS MANAGEMENT, filter=null, transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=true, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=4136a0c9-14d5-42b3-9a60-81689c800438, taskHash=0], rdc=null, trans=null] at org.apache.ignite.internal.processors.cache.GridCacheUtils.convertToCacheException(GridCacheUtils.java:1440) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.next(GridCacheQueryFutureAdapter.java:174) at org.apache.ignite.internal.processors.cache.IgniteCacheProxy$5.onHasNext(IgniteCacheProxy.java:600) at org.apache.ignite.internal.util.GridCloseableIteratorAdapter.hasNextX(GridCloseableIteratorAdapter.java:53) at org.apache.ignite.internal.util.lang.GridIteratorAdapter.hasNext(GridIteratorAdapter.java:45) at un.api.resolver.dao.CompanyDAO.getVarCompContains(CompanyDAO.scala:242) at un.api.resolver.accessor.CompanyAccessor.getVarCompContains(CompanyAccessor.scala:27) at un.api.resolver.CompanyResolverSparkTest$$anonfun$main$7.apply(CompanyResolverSparkTest.scala:291) at un.api.resolver.CompanyResolverSparkTest$$anonfun$main$7.apply(CompanyResolverSparkTest.scala:289) at scala.collection.Iterator$$anon$11.next(Iterator.scala:328) at org.apache.spark.util.Utils$.getIteratorSize(Utils.scala:1554) at org.apache.spark.rdd.RDD$$anonfun$count$1.apply(RDD.scala:1121) at org.apache.spark.rdd.RDD$$anonfun$count$1.apply(RDD.scala:1121) at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1850) at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1850) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:66) at org.apache.spark.scheduler.Task.run(Task.scala:88) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:214) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: class org.apache.ignite.IgniteCheckedException: Query execution failed: GridCacheQueryBean [qry=GridCacheQueryAdapter [type=TEXT, clsName=CompanyVO1, clause=APWS MANAGEMENT, filter=null, transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=true, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=4136a0c9-14d5-42b3-9a60-81689c800438, taskHash=0], rdc=null, trans=null] at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.checkError(GridCacheQueryFutureAdapter.java:260) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.internalIterator(GridCacheQueryFutureAdapter.java:318) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.next(GridCacheQueryFutureAdapter.java:164) ... 19 more Caused by: class org.apache.ignite.IgniteCheckedException: Failed to execute query on node [query=GridCacheQueryBean [qry=GridCacheQueryAdapter [type=TEXT, clsName=CompanyVO1, clause=APWS MANAGEMENT, filter=null, transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=true, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=4136a0c9-14d5-42b3-9a60-81689c800438, taskHash=0], rdc=null, trans=null], nodeId=23f61699-e2c9-4ff6-8731-2483934e84c4] at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.onPage(GridCacheQueryFutureAdapter.java:383) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.processQueryResponse(GridCacheDistributedQueryManager.java:398) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.access$000(GridCacheDistributedQueryManager.java:63) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$1.apply(GridCacheDistributedQueryManager.java:93) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$1.apply(GridCacheDistributedQueryManager.java:91) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.processMessage(GridCacheIoManager.java:827) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.onMessage0(GridCacheIoManager.java:369) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.access$400(GridCacheIoManager.java:95) at org.apache.ignite.internal.processors.cache.GridCacheIoManager$OrderedMessageListener.onMessage(GridCacheIoManager.java:1345) at org.apache.ignite.internal.managers.communication.GridIoManager.invokeListener(GridIoManager.java:1082) at org.apache.ignite.internal.managers.communication.GridIoManager.access$1600(GridIoManager.java:102) at org.apache.ignite.internal.managers.communication.GridIoManager$GridCommunicationMessageSet.unwind(GridIoManager.java:2332) at org.apache.ignite.internal.managers.communication.GridIoManager.unwindMessageSet(GridIoManager.java:1042) at org.apache.ignite.internal.managers.communication.GridIoManager.access$1900(GridIoManager.java:102) at org.apache.ignite.internal.managers.communication.GridIoManager$6.run(GridIoManager.java:1011) ... 3 more Caused by: java.lang.NullPointerException 17/03/01 04:14:12 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=4d5de2f3-d975-4b28-b593-0cc0481cdc74, res=GridCacheQueryResponse [finished=false, reqId=345, err=null, fields=false, metadata=null]] 17/03/01 04:14:12 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=9fb6e583-cea0-4f78-b403-b403a8bc9a0e, res=GridCacheQueryResponse [finished=false, reqId=345, err=null, fields=false, metadata=null]] 17/03/01 04:14:12 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=479b18e6-54af-4313-85f7-c7525f6229a4, res=GridCacheQueryResponse [finished=false, reqId=345, err=null, fields=false, metadata=null]] 17/03/01 04:14:12 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=90db2cab-26f6-463d-9755-d03d059a8723, res=GridCacheQueryResponse [finished=false, reqId=345, err=null, fields=false, metadata=null]] 17/03/01 04:14:12 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=3e101db5-8c5c-47b7-bbdb-a9a892c4bada, res=GridCacheQueryResponse [finished=false, reqId=345, err=null, fields=false, metadata=null]] 17/03/01 04:14:12 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=ffe19475-7849-4027-8648-ce56598ff50f, res=GridCacheQueryResponse [finished=false, reqId=345, err=null, fields=false, metadata=null]] 17/03/01 04:14:12 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=c4f4f6bb-b71a-4a29-9575-afee2ddc1b2d, res=GridCacheQueryResponse [finished=false, reqId=345, err=null, fields=false, metadata=null]] 17/03/01 04:14:12 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=90532831-88fb-4eb8-adc9-db7a86744869, res=GridCacheQueryResponse [finished=false, reqId=345, err=null, fields=false, metadata=null]] 17/03/01 04:14:12 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=e2cba212-89dd-48dd-8d7e-821b5725fe03, res=GridCacheQueryResponse [finished=false, reqId=345, err=null, fields=false, metadata=null]] 17/03/01 04:14:12 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=e9e49d2d-5eeb-474f-8757-e447efc8ca8f, res=GridCacheQueryResponse [finished=false, reqId=345, err=null, fields=false, metadata=null]] 17/03/01 04:14:12 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=40d089f0-7c80-4f1f-8659-350791f57a4c, res=GridCacheQueryResponse [finished=false, reqId=345, err=null, fields=false, metadata=null]] 17/03/01 04:14:12 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=8fd4eea2-2a45-4563-ae87-1848fd388a98, res=GridCacheQueryResponse [finished=false, reqId=345, err=null, fields=false, metadata=null]] 17/03/01 04:14:12 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=ddc47224-d030-4d1f-ba66-08f61368a395, res=GridCacheQueryResponse [finished=false, reqId=345, err=null, fields=false, metadata=null]] 17/03/01 04:14:12 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=fa09caab-f4dc-43b6-ac8b-4a4bae6e7da6, res=GridCacheQueryResponse [finished=false, reqId=345, err=null, fields=false, metadata=null]] 17/03/01 04:14:12 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=8be1bd05-d62c-4f1a-83f2-91dcb3f3b62a, res=GridCacheQueryResponse [finished=false, reqId=345, err=null, fields=false, metadata=null]] 17/03/01 04:14:12 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 311 17/03/01 04:14:12 INFO executor.Executor: Running task 32.1 in stage 7.0 (TID 311) 17/03/01 04:14:30 INFO executor.Executor: Finished task 32.1 in stage 7.0 (TID 311). 969 bytes result sent to driver 17/03/01 04:14:47 INFO internal.IgniteKernal%WCA: Metrics for local node (to disable set 'metricsLogFrequency' to 0) ^-- Node [id=4136a0c9, name=WCA, uptime=00:02:00:025] ^-- H/N/C [hosts=41, nodes=41, CPUs=1664] ^-- CPU [cur=0.17%, avg=3.04%, GC=0%] ^-- Heap [used=2225MB, free=84.51%, comm=14367MB] ^-- Non heap [used=125MB, free=-1%, comm=127MB] ^-- Public thread pool [active=0, idle=0, qSize=0] ^-- System thread pool [active=0, idle=80, qSize=0] ^-- Outbound messages queue [size=0] 17/03/01 04:14:49 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 351 17/03/01 04:14:49 INFO executor.Executor: Running task 38.0 in stage 8.0 (TID 351) 17/03/01 04:14:49 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 132 17/03/01 04:14:49 INFO storage.MemoryStore: ensureFreeSpace(887) called with curMem=417262, maxMem=8334920908 17/03/01 04:14:49 INFO storage.MemoryStore: Block broadcast_132_piece0 stored as bytes in memory (estimated size 887.0 B, free 7.8 GB) 17/03/01 04:14:49 INFO broadcast.TorrentBroadcast: Reading broadcast variable 132 took 14 ms 17/03/01 04:14:49 INFO storage.MemoryStore: ensureFreeSpace(1216) called with curMem=418149, maxMem=8334920908 17/03/01 04:14:49 INFO storage.MemoryStore: Block broadcast_132 stored as values in memory (estimated size 1216.0 B, free 7.8 GB) 17/03/01 04:14:49 INFO tcp.GridTcpRestProtocol: Command protocol successfully stopped: TCP binary 17/03/01 04:14:51 INFO cache.GridCacheProcessor: Stopped cache: ignite-marshaller-sys-cache 17/03/01 04:14:51 INFO cache.GridCacheProcessor: Stopped cache: ignite-sys-cache 17/03/01 04:14:51 INFO cache.GridCacheProcessor: Stopped cache: ignite-atomics-sys-cache 17/03/01 04:14:51 INFO cache.GridCacheProcessor: Stopped cache: WCAIgniteCache 17/03/01 04:14:51 INFO internal.IgniteKernal%WCA: >>> +---------------------------------------------------------------------------------+ >>> Ignite ver. 1.8.0#20161205-sha1:9ca40dbeb7d559fcb299bdb6f5c90cdf8ce7e533 stopped OK >>> +---------------------------------------------------------------------------------+ >>> Grid name: WCA >>> Grid uptime: 00:02:04:104 17/03/01 04:14:51 INFO executor.Executor: Finished task 38.0 in stage 8.0 (TID 351). 931 bytes result sent to driver 17/03/01 04:14:53 INFO executor.CoarseGrainedExecutorBackend: Driver commanded a shutdown 17/03/01 04:14:53 INFO storage.MemoryStore: MemoryStore cleared 17/03/01 04:14:53 INFO storage.BlockManager: BlockManager stopped 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Shutting down remote daemon. 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remote daemon shut down; proceeding with flushing remote transports. 17/03/01 04:14:53 INFO Remoting: Remoting shut down 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remoting shut down. 17/03/01 04:14:53 INFO util.ShutdownHookManager: Shutdown hook called LogType:stdout Log Upload Time:Wed Mar 01 04:14:55 -0600 2017 LogLength:1233 Log Contents: rEnd of the programe - [04:12:38] __________ ________________ [04:12:38] / _/ ___/ |/ / _/_ __/ __/ [04:12:38] _/ // (7 7 // / / / / _/ [04:12:38] /___/\___/_/|_/___/ /_/ /___/ [04:12:38] [04:12:38] ver. 1.8.0#20161205-sha1:9ca40dbe [04:12:38] 2016 Copyright(C) Apache Software Foundation [04:12:38] [04:12:38] Ignite documentation: http://ignite.apache.org [04:12:38] [04:12:38] Quiet mode. [04:12:38] ^-- To see **FULL** console log here add -DIGNITE_QUIET=false or "-v" to ignite.{sh|bat} [04:12:38] [04:12:38] OS: Linux 2.6.32-431.5.1.el6.x86_64 amd64 [04:12:38] VM information: Java(TM) SE Runtime Environment 1.8.0_60-b27 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.60-b23 [04:12:38] Configured plugins: [04:12:38] ^-- None [04:12:38] [04:12:38] Security status [authentication=off, tls/ssl=off] [04:12:45] Topology snapshot [ver=41, servers=41, clients=0, CPUs=1664, heap=640.0GB] [04:12:47] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [04:12:47] [04:12:47] Ignite node started OK (id=4136a0c9, grid=WCA) [04:12:47] Topology snapshot [ver=40, servers=40, clients=0, CPUs=1624, heap=620.0GB] [04:14:51] Ignite node stopped OK [name=WCA, uptime=00:02:04:104] Container: container_e76_1487862040010_131981_01_000011 on hostName_8041 =========================================================================================== LogType:stderr Log Upload Time:Wed Mar 01 04:14:58 -0600 2017 LogLength:101853 Log Contents: 17/03/01 04:10:59 INFO executor.CoarseGrainedExecutorBackend: Registered signal handlers for [TERM, HUP, INT] 17/03/01 04:11:00 INFO spark.SecurityManager: Changing view acls to: userName 17/03/01 04:11:00 INFO spark.SecurityManager: Changing modify acls to: userName 17/03/01 04:11:00 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(userName); users with modify permissions: Set(userName) 17/03/01 04:11:00 INFO slf4j.Slf4jLogger: Slf4jLogger started 17/03/01 04:11:00 INFO Remoting: Starting remoting 17/03/01 04:11:01 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://driverPropsFetcher@hostName:55909] 17/03/01 04:11:01 INFO Remoting: Remoting now listens on addresses: [akka.tcp://driverPropsFetcher@hostName:55909] 17/03/01 04:11:01 INFO util.Utils: Successfully started service 'driverPropsFetcher' on port 55909. 17/03/01 04:11:01 INFO spark.SecurityManager: Changing view acls to: userName 17/03/01 04:11:01 INFO spark.SecurityManager: Changing modify acls to: userName 17/03/01 04:11:01 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(userName); users with modify permissions: Set(userName) 17/03/01 04:11:01 INFO remote.RemoteActorRefProvider$RemotingTerminator: Shutting down remote daemon. 17/03/01 04:11:01 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remote daemon shut down; proceeding with flushing remote transports. 17/03/01 04:11:01 INFO slf4j.Slf4jLogger: Slf4jLogger started 17/03/01 04:11:01 INFO Remoting: Starting remoting 17/03/01 04:11:01 INFO Remoting: Remoting shut down 17/03/01 04:11:01 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remoting shut down. 17/03/01 04:11:01 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://sparkExecutor@hostName:57567] 17/03/01 04:11:01 INFO Remoting: Remoting now listens on addresses: [akka.tcp://sparkExecutor@hostName:57567] 17/03/01 04:11:01 INFO util.Utils: Successfully started service 'sparkExecutor' on port 57567. 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/1/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-0019a662-efd7-4992-878c-a0d06ed4649a 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/2/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-ff8401e0-2f90-497c-87ff-21afdf9408e2 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/3/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-77addc42-e7c5-49b5-b3de-9600519c3b76 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/4/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-7093296b-e201-463a-921a-6febf49a7b34 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/5/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-b76be4cf-320d-45cf-9f34-68e89d5f5d7d 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/6/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-1cfaeb5c-9271-4850-81fe-309b34694dec 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/7/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-3356693d-f577-4a41-9970-7eb845fe87b4 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/8/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-d9ae8e35-b958-4992-9731-8a3c8ef69b9a 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/9/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-d3c1f647-0036-42a4-a849-8943db01bad8 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/10/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-411c3cb8-b44e-4197-a8e7-ac917291e955 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/11/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-af255b14-e95e-4128-a3de-947c7b8f3055 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/12/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-85257c1c-fdb8-4d75-a12c-4367d7751d78 17/03/01 04:11:01 INFO storage.MemoryStore: MemoryStore started with capacity 7.8 GB 17/03/01 04:11:01 INFO executor.CoarseGrainedExecutorBackend: Connecting to driver: akka.tcp://sparkDriver@ipaddress:38995/user/CoarseGrainedScheduler 17/03/01 04:11:01 INFO executor.CoarseGrainedExecutorBackend: Successfully registered with driver 17/03/01 04:11:01 INFO executor.Executor: Starting executor ID 8 on host hostName 17/03/01 04:11:01 INFO util.Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 35888. 17/03/01 04:11:01 INFO netty.NettyBlockTransferService: Server created on 35888 17/03/01 04:11:01 INFO storage.BlockManagerMaster: Trying to register BlockManager 17/03/01 04:11:01 INFO storage.BlockManagerMaster: Registered BlockManager 17/03/01 04:11:02 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 24 17/03/01 04:11:02 INFO executor.Executor: Running task 24.0 in stage 0.0 (TID 24) 17/03/01 04:11:02 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 0 17/03/01 04:11:02 INFO storage.MemoryStore: ensureFreeSpace(1310) called with curMem=0, maxMem=8334920908 17/03/01 04:11:02 INFO storage.MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 1310.0 B, free 7.8 GB) 17/03/01 04:11:02 INFO broadcast.TorrentBroadcast: Reading broadcast variable 0 took 234 ms 17/03/01 04:11:02 INFO storage.MemoryStore: ensureFreeSpace(2064) called with curMem=1310, maxMem=8334920908 17/03/01 04:11:02 INFO storage.MemoryStore: Block broadcast_0 stored as values in memory (estimated size 2.0 KB, free 7.8 GB) 17/03/01 04:11:02 INFO resolver.CompanyResolverSparkTest: Ranjit exec test 17/03/01 04:11:02 INFO executor.Executor: Finished task 24.0 in stage 0.0 (TID 24). 972 bytes result sent to driver 17/03/01 04:12:16 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 69 17/03/01 04:12:16 INFO executor.Executor: Running task 25.0 in stage 2.0 (TID 69) 17/03/01 04:12:16 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 84 17/03/01 04:12:16 INFO storage.MemoryStore: ensureFreeSpace(9240) called with curMem=3374, maxMem=8334920908 17/03/01 04:12:16 INFO storage.MemoryStore: Block broadcast_84_piece0 stored as bytes in memory (estimated size 9.0 KB, free 7.8 GB) 17/03/01 04:12:16 INFO broadcast.TorrentBroadcast: Reading broadcast variable 84 took 42 ms 17/03/01 04:12:16 INFO storage.MemoryStore: ensureFreeSpace(32704) called with curMem=12614, maxMem=8334920908 17/03/01 04:12:16 INFO storage.MemoryStore: Block broadcast_84 stored as values in memory (estimated size 31.9 KB, free 7.8 GB) 17/03/01 04:12:17 INFO codegen.GenerateMutableProjection: Code generated in 98.512119 ms 17/03/01 04:12:17 INFO codegen.GenerateUnsafeProjection: Code generated in 9.36336 ms 17/03/01 04:12:17 INFO codegen.GenerateMutableProjection: Code generated in 15.846717 ms 17/03/01 04:12:17 INFO codegen.GenerateUnsafeRowJoiner: Code generated in 7.843297 ms 17/03/01 04:12:17 INFO codegen.GenerateUnsafeProjection: Code generated in 7.438883 ms 17/03/01 04:12:17 INFO rdd.HadoopRDD: Input split: avro path/part-r-00002-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:112498680+112498681 17/03/01 04:12:17 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 56 17/03/01 04:12:17 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=45318, maxMem=8334920908 17/03/01 04:12:17 INFO storage.MemoryStore: Block broadcast_56_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:12:17 INFO broadcast.TorrentBroadcast: Reading broadcast variable 56 took 9 ms 17/03/01 04:12:17 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=69961, maxMem=8334920908 17/03/01 04:12:17 INFO storage.MemoryStore: Block broadcast_56 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:12:18 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 17/03/01 04:12:18 INFO Configuration.deprecation: mapred.tip.id is deprecated. Instead, use mapreduce.task.id 17/03/01 04:12:18 INFO Configuration.deprecation: mapred.task.id is deprecated. Instead, use mapreduce.task.attempt.id 17/03/01 04:12:18 INFO Configuration.deprecation: mapred.task.is.map is deprecated. Instead, use mapreduce.task.ismap 17/03/01 04:12:18 INFO Configuration.deprecation: mapred.task.partition is deprecated. Instead, use mapreduce.task.partition 17/03/01 04:12:18 INFO Configuration.deprecation: mapred.job.id is deprecated. Instead, use mapreduce.job.id 17/03/01 04:12:18 WARN security.UserGroupInformation: PriviledgedActionException as:userName (auth:SIMPLE) cause:org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:12:18 WARN ipc.Client: Exception encountered while connecting to the server : org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:12:18 WARN security.UserGroupInformation: PriviledgedActionException as:userName (auth:SIMPLE) cause:org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:12:23 INFO executor.Executor: Finished task 25.0 in stage 2.0 (TID 69). 2494 bytes result sent to driver 17/03/01 04:12:38 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 141 17/03/01 04:12:38 INFO executor.Executor: Running task 19.0 in stage 4.0 (TID 141) 17/03/01 04:12:38 INFO spark.MapOutputTrackerWorker: Updating epoch to 1 and clearing cache 17/03/01 04:12:38 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 86 17/03/01 04:12:38 INFO storage.MemoryStore: ensureFreeSpace(2290) called with curMem=417033, maxMem=8334920908 17/03/01 04:12:38 INFO storage.MemoryStore: Block broadcast_86_piece0 stored as bytes in memory (estimated size 2.2 KB, free 7.8 GB) 17/03/01 04:12:38 INFO broadcast.TorrentBroadcast: Reading broadcast variable 86 took 6 ms 17/03/01 04:12:38 INFO storage.MemoryStore: ensureFreeSpace(6544) called with curMem=419323, maxMem=8334920908 17/03/01 04:12:38 INFO storage.MemoryStore: Block broadcast_86 stored as values in memory (estimated size 6.4 KB, free 7.8 GB) 17/03/01 04:12:38 INFO resolver.CompanyResolverSparkTest: testing worker[ipaddress:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509] 17/03/01 04:12:38 ERROR : Failed to resolve default logging config file: config/java.util.logging.properties Console logging handler is not configured. 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: >>> __________ ________________ >>> / _/ ___/ |/ / _/_ __/ __/ >>> _/ // (7 7 // / / / / _/ >>> /___/\___/_/|_/___/ /_/ /___/ >>> >>> ver. 1.8.0#20161205-sha1:9ca40dbe >>> 2016 Copyright(C) Apache Software Foundation >>> >>> Ignite documentation: http://ignite.apache.org 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Config URL: n/a 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Daemon mode: off 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: OS: Linux 2.6.32-431.5.1.el6.x86_64 amd64 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: OS user: userName 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: PID: 23252 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Language runtime: Java Platform API Specification ver. 1.8 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM information: Java(TM) SE Runtime Environment 1.8.0_60-b27 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.60-b23 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM total memory: 14.0GB 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Remote Management [restart: off, REST: on, JMX (remote: off)] 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: IGNITE_HOME=null 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM arguments: [-XX:OnOutOfMemoryError=kill %p, -Xms15360m, -Xmx15360m, -Djava.io.tmpdir=/data/4/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/container_e76_1487862040010_131981_01_000011/tmp, -Dspark.driver.port=38995, -Dspark.ui.port=0, -Dspark.yarn.app.container.log.dir=/data/9/yarn/log/container/application_1487862040010_131981/container_e76_1487862040010_131981_01_000011] 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Configured caches ['ignite-marshaller-sys-cache', 'ignite-sys-cache', 'ignite-atomics-sys-cache'] 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: Configured plugins: 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: ^-- None 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: IPC shared memory server endpoint started [port=48100, tokDir=/data/4/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/container_e76_1487862040010_131981_01_000011/tmp/ignite/work/ipc/shmem/47c1a0d8-9d4d-4d0d-9b27-388bd7f49278-23252] 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: Successfully bound shared memory communication to TCP port [port=48100, locHost=0.0.0.0/0.0.0.0] 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: Successfully bound to TCP port [port=47100, locHost=0.0.0.0/0.0.0.0] 17/03/01 04:12:38 WARN noop.NoopCheckpointSpi: Checkpoints are disabled (to enable configure any GridCheckpointSpi implementation) 17/03/01 04:12:38 WARN collision.GridCollisionManager: Collision resolution is disabled (all jobs will be activated upon arrival). 17/03/01 04:12:39 WARN noop.NoopSwapSpaceSpi: Swap space is disabled. To enable use FileSwapSpaceSpi. 17/03/01 04:12:39 INFO internal.IgniteKernal%WCA: Security status [authentication=off, tls/ssl=off] 17/03/01 04:12:39 INFO tcp.GridTcpRestProtocol: Command protocol successfully started [name=TCP binary, host=0.0.0.0/0.0.0.0, port=11211] 17/03/01 04:12:39 INFO internal.IgniteKernal%WCA: Non-loopback local IPs: 1 17/03/01 04:12:39 INFO internal.IgniteKernal%WCA: Enabled local MACs: 44A84210AD8B 17/03/01 04:12:39 INFO tcp.TcpDiscoverySpi: Successfully bound to TCP port [port=47500, localHost=0.0.0.0/0.0.0.0, locNodeId=47c1a0d8-9d4d-4d0d-9b27-388bd7f49278] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=e87f12ce-5981-4418-8468-f6bfed0a0cd8, addrs=[6, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/6:47500], discPort=47500, order=19, intOrder=19, lastExchangeTime=1488363161383, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=19, servers=19, clients=0, CPUs=784, heap=310.0GB] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=e2cba212-89dd-48dd-8d7e-821b5725fe03, addrs=[8, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/8:47500], discPort=47500, order=20, intOrder=20, lastExchangeTime=1488363161403, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=20, servers=20, clients=0, CPUs=816, heap=320.0GB] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=f9ce8dd7-2060-4c34-b597-d7bee86ebedb, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=21, intOrder=21, lastExchangeTime=1488363161413, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=21, servers=21, clients=0, CPUs=856, heap=340.0GB] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=6b1889dd-9de5-4f1b-8ec9-c123c7df8ea2, addrs=[, 127.0.0.1], sockAddrs=[hostName/:47500, /127.0.0.1:47500], discPort=47500, order=22, intOrder=22, lastExchangeTime=1488363161413, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=22, servers=22, clients=0, CPUs=896, heap=350.0GB] 17/03/01 04:12:42 INFO cache.GridCacheProcessor: Started cache [name=ignite-sys-cache, mode=REPLICATED] 17/03/01 04:12:42 INFO cache.GridCacheProcessor: Started cache [name=ignite-atomics-sys-cache, mode=PARTITIONED] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=9fb6e583-cea0-4f78-b403-b403a8bc9a0e, addrs=[7, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/7:47500], discPort=47500, order=23, intOrder=23, lastExchangeTime=1488363161423, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=23, servers=23, clients=0, CPUs=936, heap=370.0GB] 17/03/01 04:12:42 INFO cache.GridCacheProcessor: Started cache [name=WCAIgniteCache, mode=PARTITIONED] 17/03/01 04:12:42 INFO cache.GridCacheProcessor: Started cache [name=ignite-marshaller-sys-cache, mode=REPLICATED] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=20860cae-2881-4311-a3f5-edaa160ef37f, addrs=[7, 127.0.0.1], sockAddrs=[hostName/7:47500, /127.0.0.1:47500], discPort=47500, order=24, intOrder=24, lastExchangeTime=1488363161423, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=24, servers=24, clients=0, CPUs=976, heap=380.0GB] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=0d675d57-b9b9-4cff-a994-77337d618bbe, addrs=[4, 127.0.0.1], sockAddrs=[hostName/4:47500, /127.0.0.1:47500], discPort=47500, order=25, intOrder=25, lastExchangeTime=1488363161433, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=25, servers=25, clients=0, CPUs=1016, heap=400.0GB] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=a6343860-6e84-4d9c-9b87-84ffd76280cd, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=26, intOrder=26, lastExchangeTime=1488363161433, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=26, servers=26, clients=0, CPUs=1056, heap=410.0GB] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=18, minorTopVer=0], evt=NODE_JOINED, node=47c1a0d8-9d4d-4d0d-9b27-388bd7f49278] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=19, minorTopVer=0], evt=NODE_JOINED, node=e87f12ce-5981-4418-8468-f6bfed0a0cd8] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=479b18e6-54af-4313-85f7-c7525f6229a4, addrs=[, 127.0.0.1], sockAddrs=[hostName/:47500, /127.0.0.1:47500], discPort=47500, order=27, intOrder=27, lastExchangeTime=1488363161443, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=27, servers=27, clients=0, CPUs=1104, heap=430.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=20, minorTopVer=0], evt=NODE_JOINED, node=e2cba212-89dd-48dd-8d7e-821b5725fe03] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=058a99e8-3b65-4ec9-84b0-6f3502c2afce, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=28, intOrder=28, lastExchangeTime=1488363161463, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=28, servers=28, clients=0, CPUs=1144, heap=440.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=21, minorTopVer=0], evt=NODE_JOINED, node=f9ce8dd7-2060-4c34-b597-d7bee86ebedb] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=57c09d88-a4dc-4179-98b4-1144fd97d8cc, addrs=[35, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/35:47500], discPort=47500, order=29, intOrder=29, lastExchangeTime=1488363161473, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=29, servers=29, clients=0, CPUs=1192, heap=460.0GB] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=58298821-7aa9-4b58-ba15-e7f1ef2830fb, addrs=[3, 127.0.0.1], sockAddrs=[hostName/3:47500, /127.0.0.1:47500], discPort=47500, order=30, intOrder=30, lastExchangeTime=1488363161483, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=30, servers=30, clients=0, CPUs=1232, heap=470.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=22, minorTopVer=0], evt=NODE_JOINED, node=6b1889dd-9de5-4f1b-8ec9-c123c7df8ea2] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4d5de2f3-d975-4b28-b593-0cc0481cdc74, addrs=[03, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/03:47500], discPort=47500, order=31, intOrder=31, lastExchangeTime=1488363161483, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=31, servers=31, clients=0, CPUs=1280, heap=490.0GB] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=fa09caab-f4dc-43b6-ac8b-4a4bae6e7da6, addrs=[01, 127.0.0.1], sockAddrs=[hostName/01:47500, /127.0.0.1:47500], discPort=47500, order=32, intOrder=32, lastExchangeTime=1488363161534, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=32, servers=32, clients=0, CPUs=1320, heap=500.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=23, minorTopVer=0], evt=NODE_JOINED, node=9fb6e583-cea0-4f78-b403-b403a8bc9a0e] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=24, minorTopVer=0], evt=NODE_JOINED, node=20860cae-2881-4311-a3f5-edaa160ef37f] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=af5837f0-25ec-4f3d-a1c1-90c09dc424cb, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=33, intOrder=33, lastExchangeTime=1488363161655, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=33, servers=33, clients=0, CPUs=1360, heap=520.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=25, minorTopVer=0], evt=NODE_JOINED, node=0d675d57-b9b9-4cff-a994-77337d618bbe] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=e9e49d2d-5eeb-474f-8757-e447efc8ca8f, addrs=[6, 127.0.0.1], sockAddrs=[hostName/6:47500, /127.0.0.1:47500], discPort=47500, order=34, intOrder=34, lastExchangeTime=1488363161665, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=34, servers=34, clients=0, CPUs=1400, heap=530.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=26, minorTopVer=0], evt=NODE_JOINED, node=a6343860-6e84-4d9c-9b87-84ffd76280cd] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4b90e5a3-253a-435b-84ca-6b592610cf0c, addrs=[4, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/4:47500], discPort=47500, order=35, intOrder=35, lastExchangeTime=1488363161665, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=35, servers=35, clients=0, CPUs=1432, heap=550.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=27, minorTopVer=0], evt=NODE_JOINED, node=479b18e6-54af-4313-85f7-c7525f6229a4] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=8fd4eea2-2a45-4563-ae87-1848fd388a98, addrs=[3, 127.0.0.1], sockAddrs=[hostName/3:47500, /127.0.0.1:47500], discPort=47500, order=36, intOrder=36, lastExchangeTime=1488363161675, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=36, servers=36, clients=0, CPUs=1472, heap=560.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=28, minorTopVer=0], evt=NODE_JOINED, node=058a99e8-3b65-4ec9-84b0-6f3502c2afce] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=d7b45a02-0411-4028-acdf-f004e592f294, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=37, intOrder=37, lastExchangeTime=1488363161967, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=37, servers=37, clients=0, CPUs=1512, heap=580.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=29, minorTopVer=0], evt=NODE_JOINED, node=57c09d88-a4dc-4179-98b4-1144fd97d8cc] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=cf4e6e83-207e-42da-a55c-5621bc20b891, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=38, intOrder=38, lastExchangeTime=1488363162723, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=38, servers=38, clients=0, CPUs=1552, heap=590.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=30, minorTopVer=0], evt=NODE_JOINED, node=58298821-7aa9-4b58-ba15-e7f1ef2830fb] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=d8926a2c-2c00-4445-beb4-633c2d656c41, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=39, intOrder=39, lastExchangeTime=1488363162733, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=39, servers=39, clients=0, CPUs=1584, heap=610.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=31, minorTopVer=0], evt=NODE_JOINED, node=4d5de2f3-d975-4b28-b593-0cc0481cdc74] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4136a0c9-14d5-42b3-9a60-81689c800438, addrs=[3, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/3:47500], discPort=47500, order=40, intOrder=40, lastExchangeTime=1488363162945, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=40, servers=40, clients=0, CPUs=1624, heap=620.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=32, minorTopVer=0], evt=NODE_JOINED, node=fa09caab-f4dc-43b6-ac8b-4a4bae6e7da6] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=694a80b8-02a3-44c9-a2dd-45bed7d20a50, addrs=[1, 127.0.0.1], sockAddrs=[hostName/1:47500, /127.0.0.1:47500], discPort=47500, order=41, intOrder=41, lastExchangeTime=1488363162955, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=41, servers=41, clients=0, CPUs=1664, heap=640.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=33, minorTopVer=0], evt=NODE_JOINED, node=af5837f0-25ec-4f3d-a1c1-90c09dc424cb] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=34, minorTopVer=0], evt=NODE_JOINED, node=e9e49d2d-5eeb-474f-8757-e447efc8ca8f] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=35, minorTopVer=0], evt=NODE_JOINED, node=4b90e5a3-253a-435b-84ca-6b592610cf0c] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=36, minorTopVer=0], evt=NODE_JOINED, node=8fd4eea2-2a45-4563-ae87-1848fd388a98] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=37, minorTopVer=0], evt=NODE_JOINED, node=d7b45a02-0411-4028-acdf-f004e592f294] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=38, minorTopVer=0], evt=NODE_JOINED, node=cf4e6e83-207e-42da-a55c-5621bc20b891] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=39, minorTopVer=0], evt=NODE_JOINED, node=d8926a2c-2c00-4445-beb4-633c2d656c41] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=40, minorTopVer=0], evt=NODE_JOINED, node=4136a0c9-14d5-42b3-9a60-81689c800438] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-sys-cache, waitList=[]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-marshaller-sys-cache, waitList=[]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-atomics-sys-cache, waitList=[ignite-sys-cache, ignite-marshaller-sys-cache]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=WCAIgniteCache, waitList=[ignite-sys-cache, ignite-marshaller-sys-cache, ignite-atomics-sys-cache]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Rebalancing required [top=AffinityTopologyVersion [topVer=41, minorTopVer=0], evt=NODE_JOINED, node=694a80b8-02a3-44c9-a2dd-45bed7d20a50] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-marshaller-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=20, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=24] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=100, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=24] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-marshaller-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=20 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=20 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-atomics-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=29, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=24] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-atomics-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=0 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=WCAIgniteCache, mode=ASYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=29, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=24] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=WCAIgniteCache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=11 ms] 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: >>> +----------------------------------------------------------------------+ >>> Ignite ver. 1.8.0#20161205-sha1:9ca40dbeb7d559fcb299bdb6f5c90cdf8ce7e533 >>> +----------------------------------------------------------------------+ >>> OS name: Linux 2.6.32-431.5.1.el6.x86_64 amd64 >>> CPU(s): 40 >>> Heap: 15.0GB >>> VM name: 23252@hostName >>> Grid name: WCA >>> Local node [ID=47C1A0D8-9D4D-4D0D-9B27-388BD7F49278, order=18, clientMode=false] >>> Local node addresses: [hostName/1, /127.0.0.1] >>> Local ports: TCP:11211 TCP:47100 TCP:47500 TCP:48100 17/03/01 04:12:47 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=18, servers=18, clients=0, CPUs=744, heap=290.0GB] 17/03/01 04:12:47 INFO resolver.CompanyResolverSparkTest: Started ignite node on executor 17/03/01 04:12:47 INFO executor.Executor: Finished task 19.0 in stage 4.0 (TID 141). 931 bytes result sent to driver 17/03/01 04:12:49 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=41, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, node=6172ee3a-eb33-4bf5-9080-c255f52caed8] 17/03/01 04:12:52 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 193 17/03/01 04:12:52 INFO executor.Executor: Running task 49.0 in stage 5.0 (TID 193) 17/03/01 04:12:52 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 128 17/03/01 04:12:52 INFO storage.MemoryStore: ensureFreeSpace(7311) called with curMem=0, maxMem=8334920908 17/03/01 04:12:52 INFO storage.MemoryStore: Block broadcast_128_piece0 stored as bytes in memory (estimated size 7.1 KB, free 7.8 GB) 17/03/01 04:12:52 INFO broadcast.TorrentBroadcast: Reading broadcast variable 128 took 10 ms 17/03/01 04:12:52 INFO storage.MemoryStore: ensureFreeSpace(28168) called with curMem=7311, maxMem=8334920908 17/03/01 04:12:52 INFO storage.MemoryStore: Block broadcast_128 stored as values in memory (estimated size 27.5 KB, free 7.8 GB) 17/03/01 04:12:52 INFO rdd.HadoopRDD: Input split: avro path/part-r-00036-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:117914948+117914948 17/03/01 04:12:52 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 112 17/03/01 04:12:52 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=35479, maxMem=8334920908 17/03/01 04:12:52 INFO storage.MemoryStore: Block broadcast_112_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:12:52 INFO broadcast.TorrentBroadcast: Reading broadcast variable 112 took 7 ms 17/03/01 04:12:52 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=60122, maxMem=8334920908 17/03/01 04:12:52 INFO storage.MemoryStore: Block broadcast_112 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:13:12 INFO executor.Executor: Finished task 49.0 in stage 5.0 (TID 193). 2098 bytes result sent to driver 17/03/01 04:13:47 INFO internal.IgniteKernal%WCA: Metrics for local node (to disable set 'metricsLogFrequency' to 0) ^-- Node [id=47c1a0d8, name=WCA, uptime=00:01:00:007] ^-- H/N/C [hosts=41, nodes=41, CPUs=1664] ^-- CPU [cur=1.9%, avg=4.74%, GC=0%] ^-- Heap [used=4059MB, free=71.94%, comm=14469MB] ^-- Non heap [used=119MB, free=-1%, comm=122MB] ^-- Public thread pool [active=0, idle=0, qSize=0] ^-- System thread pool [active=0, idle=80, qSize=0] ^-- Outbound messages queue [size=0] 17/03/01 04:13:51 INFO cluster.GridUpdateNotifier: Update status is not available. 17/03/01 04:14:00 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 278 17/03/01 04:14:00 INFO executor.Executor: Running task 34.0 in stage 7.0 (TID 278) 17/03/01 04:14:00 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 131 17/03/01 04:14:00 INFO storage.MemoryStore: ensureFreeSpace(2732) called with curMem=407194, maxMem=8334920908 17/03/01 04:14:00 INFO storage.MemoryStore: Block broadcast_131_piece0 stored as bytes in memory (estimated size 2.7 KB, free 7.8 GB) 17/03/01 04:14:00 INFO broadcast.TorrentBroadcast: Reading broadcast variable 131 took 21 ms 17/03/01 04:14:00 INFO storage.MemoryStore: ensureFreeSpace(7336) called with curMem=409926, maxMem=8334920908 17/03/01 04:14:00 INFO storage.MemoryStore: Block broadcast_131 stored as values in memory (estimated size 7.2 KB, free 7.8 GB) 17/03/01 04:14:00 INFO dao.CompanyDAO: testing[ipaddress:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509] 17/03/01 04:14:00 INFO dao.CompanyDAO: input company name inside Contains searchUNION MEAT 17/03/01 04:14:10 ERROR executor.Executor: Exception in task 34.0 in stage 7.0 (TID 278) javax.cache.CacheException: class org.apache.ignite.IgniteCheckedException: Query execution failed: GridCacheQueryBean [qry=GridCacheQueryAdapter [type=TEXT, clsName=CompanyVO1, clause=UNION MEAT, filter=null, transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=true, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=47c1a0d8-9d4d-4d0d-9b27-388bd7f49278, taskHash=0], rdc=null, trans=null] at org.apache.ignite.internal.processors.cache.GridCacheUtils.convertToCacheException(GridCacheUtils.java:1440) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.next(GridCacheQueryFutureAdapter.java:174) at org.apache.ignite.internal.processors.cache.IgniteCacheProxy$5.onHasNext(IgniteCacheProxy.java:600) at org.apache.ignite.internal.util.GridCloseableIteratorAdapter.hasNextX(GridCloseableIteratorAdapter.java:53) at org.apache.ignite.internal.util.lang.GridIteratorAdapter.hasNext(GridIteratorAdapter.java:45) at un.api.resolver.dao.CompanyDAO.getVarCompContains(CompanyDAO.scala:242) at un.api.resolver.accessor.CompanyAccessor.getVarCompContains(CompanyAccessor.scala:27) at un.api.resolver.CompanyResolverSparkTest$$anonfun$main$7.apply(CompanyResolverSparkTest.scala:291) at un.api.resolver.CompanyResolverSparkTest$$anonfun$main$7.apply(CompanyResolverSparkTest.scala:289) at scala.collection.Iterator$$anon$11.next(Iterator.scala:328) at org.apache.spark.util.Utils$.getIteratorSize(Utils.scala:1554) at org.apache.spark.rdd.RDD$$anonfun$count$1.apply(RDD.scala:1121) at org.apache.spark.rdd.RDD$$anonfun$count$1.apply(RDD.scala:1121) at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1850) at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1850) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:66) at org.apache.spark.scheduler.Task.run(Task.scala:88) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:214) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: class org.apache.ignite.IgniteCheckedException: Query execution failed: GridCacheQueryBean [qry=GridCacheQueryAdapter [type=TEXT, clsName=CompanyVO1, clause=UNION MEAT, filter=null, transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=true, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=47c1a0d8-9d4d-4d0d-9b27-388bd7f49278, taskHash=0], rdc=null, trans=null] at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.checkError(GridCacheQueryFutureAdapter.java:260) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.internalIterator(GridCacheQueryFutureAdapter.java:318) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.next(GridCacheQueryFutureAdapter.java:164) ... 19 more Caused by: class org.apache.ignite.IgniteCheckedException: Failed to execute query on node [query=GridCacheQueryBean [qry=GridCacheQueryAdapter [type=TEXT, clsName=CompanyVO1, clause=UNION MEAT, filter=null, transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=true, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=47c1a0d8-9d4d-4d0d-9b27-388bd7f49278, taskHash=0], rdc=null, trans=null], nodeId=a6343860-6e84-4d9c-9b87-84ffd76280cd] at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.onPage(GridCacheQueryFutureAdapter.java:383) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.processQueryResponse(GridCacheDistributedQueryManager.java:398) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.access$000(GridCacheDistributedQueryManager.java:63) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$1.apply(GridCacheDistributedQueryManager.java:93) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$1.apply(GridCacheDistributedQueryManager.java:91) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.processMessage(GridCacheIoManager.java:827) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.onMessage0(GridCacheIoManager.java:369) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.access$400(GridCacheIoManager.java:95) at org.apache.ignite.internal.processors.cache.GridCacheIoManager$OrderedMessageListener.onMessage(GridCacheIoManager.java:1345) at org.apache.ignite.internal.managers.communication.GridIoManager.invokeListener(GridIoManager.java:1082) at org.apache.ignite.internal.managers.communication.GridIoManager.access$1600(GridIoManager.java:102) at org.apache.ignite.internal.managers.communication.GridIoManager$GridCommunicationMessageSet.unwind(GridIoManager.java:2332) at org.apache.ignite.internal.managers.communication.GridIoManager.unwindMessageSet(GridIoManager.java:1042) at org.apache.ignite.internal.managers.communication.GridIoManager.access$1900(GridIoManager.java:102) at org.apache.ignite.internal.managers.communication.GridIoManager$6.run(GridIoManager.java:1011) ... 3 more Caused by: java.lang.NullPointerException at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneFile.numBuffers(GridLuceneFile.java:109) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneInputStream.switchCurrentBuffer(GridLuceneInputStream.java:132) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneInputStream.seek(GridLuceneInputStream.java:224) at org.apache.lucene.index.CompoundFileReader$CSIndexInput.readInternal(CompoundFileReader.java:273) at org.apache.lucene.store.BufferedIndexInput.refill(BufferedIndexInput.java:229) at org.apache.lucene.store.BufferedIndexInput.readByte(BufferedIndexInput.java:39) at org.apache.lucene.store.DataInput.readVInt(DataInput.java:105) at org.apache.lucene.store.BufferedIndexInput.readVInt(BufferedIndexInput.java:197) at org.apache.lucene.index.FieldsReader.doc(FieldsReader.java:235) at org.apache.lucene.index.SegmentReader.document(SegmentReader.java:477) at org.apache.lucene.index.DirectoryReader.document(DirectoryReader.java:583) at org.apache.lucene.index.IndexReader.document(IndexReader.java:1115) at org.apache.lucene.search.IndexSearcher.doc(IndexSearcher.java:258) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneIndex$It.findNext(GridLuceneIndex.java:383) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneIndex$It.onNext(GridLuceneIndex.java:415) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneIndex$It.onNext(GridLuceneIndex.java:299) at org.apache.ignite.internal.util.GridCloseableIteratorAdapter.nextX(GridCloseableIteratorAdapter.java:41) at org.apache.ignite.internal.util.lang.GridIteratorAdapter.next(GridIteratorAdapter.java:35) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryManager.runQuery(GridCacheQueryManager.java:1512) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.processQueryRequest(GridCacheDistributedQueryManager.java:230) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$2.apply(GridCacheDistributedQueryManager.java:108) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$2.apply(GridCacheDistributedQueryManager.java:106) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.processMessage(GridCacheIoManager.java:827) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.onMessage0(GridCacheIoManager.java:369) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.handleMessage(GridCacheIoManager.java:293) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.access$000(GridCacheIoManager.java:95) at org.apache.ignite.internal.processors.cache.GridCacheIoManager$1.onMessage(GridCacheIoManager.java:238) at org.apache.ignite.internal.managers.communication.GridIoManager.invokeListener(GridIoManager.java:1082) at org.apache.ignite.internal.managers.communication.GridIoManager.processRegularMessage0(GridIoManager.java:710) at org.apache.ignite.internal.managers.communication.GridIoManager.access$1700(GridIoManager.java:102) at org.apache.ignite.internal.managers.communication.GridIoManager$5.run(GridIoManager.java:673) ... 3 more 17/03/01 04:14:10 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=e87f12ce-5981-4418-8468-f6bfed0a0cd8, res=GridCacheQueryResponse [finished=false, reqId=369, err=null, fields=false, metadata=null]] 17/03/01 04:14:10 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=4136a0c9-14d5-42b3-9a60-81689c800438, res=GridCacheQueryResponse [finished=false, reqId=369, err=null, fields=false, metadata=null]] 17/03/01 04:14:10 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 285 17/03/01 04:14:10 INFO executor.Executor: Running task 34.1 in stage 7.0 (TID 285) 17/03/01 04:14:10 INFO dao.CompanyDAO: testing[ipaddress:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509] 17/03/01 04:14:10 INFO dao.CompanyDAO: input company name inside Contains searchUNION MEAT 17/03/01 04:14:23 INFO executor.Executor: Finished task 34.1 in stage 7.0 (TID 285). 969 bytes result sent to driver 17/03/01 04:14:47 INFO internal.IgniteKernal%WCA: Metrics for local node (to disable set 'metricsLogFrequency' to 0) ^-- Node [id=47c1a0d8, name=WCA, uptime=00:02:00:026] ^-- H/N/C [hosts=41, nodes=41, CPUs=1664] ^-- CPU [cur=0.23%, avg=3.71%, GC=0%] ^-- Heap [used=2542MB, free=82.62%, comm=14624MB] ^-- Non heap [used=125MB, free=-1%, comm=126MB] ^-- Public thread pool [active=0, idle=0, qSize=0] ^-- System thread pool [active=0, idle=80, qSize=0] ^-- Outbound messages queue [size=0] 17/03/01 04:14:49 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 338 17/03/01 04:14:49 INFO executor.Executor: Running task 25.0 in stage 8.0 (TID 338) 17/03/01 04:14:49 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 132 17/03/01 04:14:49 INFO storage.MemoryStore: ensureFreeSpace(887) called with curMem=417262, maxMem=8334920908 17/03/01 04:14:49 INFO storage.MemoryStore: Block broadcast_132_piece0 stored as bytes in memory (estimated size 887.0 B, free 7.8 GB) 17/03/01 04:14:49 INFO broadcast.TorrentBroadcast: Reading broadcast variable 132 took 75 ms 17/03/01 04:14:49 INFO storage.MemoryStore: ensureFreeSpace(1216) called with curMem=418149, maxMem=8334920908 17/03/01 04:14:49 INFO storage.MemoryStore: Block broadcast_132 stored as values in memory (estimated size 1216.0 B, free 7.8 GB) 17/03/01 04:14:49 INFO tcp.GridTcpRestProtocol: Command protocol successfully stopped: TCP binary 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=4136a0c9-14d5-42b3-9a60-81689c800438, addrs=[3, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/3:47500], discPort=47500, order=40, intOrder=40, lastExchangeTime=1488363162945, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=42, servers=40, clients=0, CPUs=1624, heap=620.0GB] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=cf4e6e83-207e-42da-a55c-5621bc20b891, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=38, intOrder=38, lastExchangeTime=1488363162723, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=43, servers=39, clients=0, CPUs=1584, heap=610.0GB] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=d8926a2c-2c00-4445-beb4-633c2d656c41, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=39, intOrder=39, lastExchangeTime=1488363162733, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=44, servers=38, clients=0, CPUs=1552, heap=590.0GB] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=e9e49d2d-5eeb-474f-8757-e447efc8ca8f, addrs=[6, 127.0.0.1], sockAddrs=[hostName/6:47500, /127.0.0.1:47500], discPort=47500, order=34, intOrder=34, lastExchangeTime=1488363161665, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=45, servers=37, clients=0, CPUs=1512, heap=580.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=57c09d88-a4dc-4179-98b4-1144fd97d8cc, addrs=[35, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/35:47500], discPort=47500, order=29, intOrder=29, lastExchangeTime=1488363161473, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=46, servers=36, clients=0, CPUs=1464, heap=560.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=0d675d57-b9b9-4cff-a994-77337d618bbe, addrs=[4, 127.0.0.1], sockAddrs=[hostName/4:47500, /127.0.0.1:47500], discPort=47500, order=25, intOrder=25, lastExchangeTime=1488363161433, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=47, servers=35, clients=0, CPUs=1424, heap=550.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=a6343860-6e84-4d9c-9b87-84ffd76280cd, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=26, intOrder=26, lastExchangeTime=1488363161433, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=48, servers=34, clients=0, CPUs=1384, heap=530.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=9fb6e583-cea0-4f78-b403-b403a8bc9a0e, addrs=[7, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/7:47500], discPort=47500, order=23, intOrder=23, lastExchangeTime=1488363161423, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=49, servers=33, clients=0, CPUs=1344, heap=520.0GB] 17/03/01 04:14:51 WARN tcp.TcpDiscoverySpi: Failed to ping node (status check will be initiated): 8fd4eea2-2a45-4563-ae87-1848fd388a98 17/03/01 04:14:52 INFO cache.GridCacheProcessor: Stopped cache: ignite-marshaller-sys-cache 17/03/01 04:14:52 INFO cache.GridCacheProcessor: Stopped cache: ignite-sys-cache 17/03/01 04:14:52 INFO cache.GridCacheProcessor: Stopped cache: ignite-atomics-sys-cache 17/03/01 04:14:52 INFO cache.GridCacheProcessor: Stopped cache: WCAIgniteCache 17/03/01 04:14:52 INFO internal.IgniteKernal%WCA: >>> +---------------------------------------------------------------------------------+ >>> Ignite ver. 1.8.0#20161205-sha1:9ca40dbeb7d559fcb299bdb6f5c90cdf8ce7e533 stopped OK >>> +---------------------------------------------------------------------------------+ >>> Grid name: WCA >>> Grid uptime: 00:02:05:374 17/03/01 04:14:52 INFO executor.Executor: Finished task 25.0 in stage 8.0 (TID 338). 931 bytes result sent to driver 17/03/01 04:14:53 INFO executor.CoarseGrainedExecutorBackend: Driver commanded a shutdown 17/03/01 04:14:53 INFO storage.MemoryStore: MemoryStore cleared 17/03/01 04:14:53 INFO storage.BlockManager: BlockManager stopped 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Shutting down remote daemon. 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remote daemon shut down; proceeding with flushing remote transports. 17/03/01 04:14:53 INFO Remoting: Remoting shut down 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remoting shut down. 17/03/01 04:14:53 INFO util.ShutdownHookManager: Shutdown hook called LogType:stdout Log Upload Time:Wed Mar 01 04:14:58 -0600 2017 LogLength:3806 Log Contents: rEnd of the programe - [04:12:38] __________ ________________ [04:12:38] / _/ ___/ |/ / _/_ __/ __/ [04:12:38] _/ // (7 7 // / / / / _/ [04:12:38] /___/\___/_/|_/___/ /_/ /___/ [04:12:38] [04:12:38] ver. 1.8.0#20161205-sha1:9ca40dbe [04:12:38] 2016 Copyright(C) Apache Software Foundation [04:12:38] [04:12:38] Ignite documentation: http://ignite.apache.org [04:12:38] [04:12:38] Quiet mode. [04:12:38] ^-- To see **FULL** console log here add -DIGNITE_QUIET=false or "-v" to ignite.{sh|bat} [04:12:38] [04:12:38] OS: Linux 2.6.32-431.5.1.el6.x86_64 amd64 [04:12:38] VM information: Java(TM) SE Runtime Environment 1.8.0_60-b27 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.60-b23 [04:12:38] Configured plugins: [04:12:38] ^-- None [04:12:38] [04:12:39] Security status [authentication=off, tls/ssl=off] [04:12:41] Topology snapshot [ver=19, servers=19, clients=0, CPUs=784, heap=310.0GB] [04:12:41] Topology snapshot [ver=20, servers=20, clients=0, CPUs=816, heap=320.0GB] [04:12:41] Topology snapshot [ver=21, servers=21, clients=0, CPUs=856, heap=340.0GB] [04:12:42] Topology snapshot [ver=22, servers=22, clients=0, CPUs=896, heap=350.0GB] [04:12:42] Topology snapshot [ver=23, servers=23, clients=0, CPUs=936, heap=370.0GB] [04:12:42] Topology snapshot [ver=24, servers=24, clients=0, CPUs=976, heap=380.0GB] [04:12:42] Topology snapshot [ver=25, servers=25, clients=0, CPUs=1016, heap=400.0GB] [04:12:42] Topology snapshot [ver=26, servers=26, clients=0, CPUs=1056, heap=410.0GB] [04:12:42] Topology snapshot [ver=27, servers=27, clients=0, CPUs=1104, heap=430.0GB] [04:12:43] Topology snapshot [ver=28, servers=28, clients=0, CPUs=1144, heap=440.0GB] [04:12:43] Topology snapshot [ver=29, servers=29, clients=0, CPUs=1192, heap=460.0GB] [04:12:43] Topology snapshot [ver=30, servers=30, clients=0, CPUs=1232, heap=470.0GB] [04:12:43] Topology snapshot [ver=31, servers=31, clients=0, CPUs=1280, heap=490.0GB] [04:12:43] Topology snapshot [ver=32, servers=32, clients=0, CPUs=1320, heap=500.0GB] [04:12:44] Topology snapshot [ver=33, servers=33, clients=0, CPUs=1360, heap=520.0GB] [04:12:44] Topology snapshot [ver=34, servers=34, clients=0, CPUs=1400, heap=530.0GB] [04:12:44] Topology snapshot [ver=35, servers=35, clients=0, CPUs=1432, heap=550.0GB] [04:12:44] Topology snapshot [ver=36, servers=36, clients=0, CPUs=1472, heap=560.0GB] [04:12:44] Topology snapshot [ver=37, servers=37, clients=0, CPUs=1512, heap=580.0GB] [04:12:44] Topology snapshot [ver=38, servers=38, clients=0, CPUs=1552, heap=590.0GB] [04:12:45] Topology snapshot [ver=39, servers=39, clients=0, CPUs=1584, heap=610.0GB] [04:12:45] Topology snapshot [ver=40, servers=40, clients=0, CPUs=1624, heap=620.0GB] [04:12:45] Topology snapshot [ver=41, servers=41, clients=0, CPUs=1664, heap=640.0GB] [04:12:47] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [04:12:47] [04:12:47] Ignite node started OK (id=47c1a0d8, grid=WCA) [04:12:47] Topology snapshot [ver=18, servers=18, clients=0, CPUs=744, heap=290.0GB] [04:14:49] Topology snapshot [ver=42, servers=40, clients=0, CPUs=1624, heap=620.0GB] [04:14:49] Topology snapshot [ver=43, servers=39, clients=0, CPUs=1584, heap=610.0GB] [04:14:49] Topology snapshot [ver=44, servers=38, clients=0, CPUs=1552, heap=590.0GB] [04:14:49] Topology snapshot [ver=45, servers=37, clients=0, CPUs=1512, heap=580.0GB] [04:14:51] Topology snapshot [ver=46, servers=36, clients=0, CPUs=1464, heap=560.0GB] [04:14:51] Topology snapshot [ver=47, servers=35, clients=0, CPUs=1424, heap=550.0GB] [04:14:51] Topology snapshot [ver=48, servers=34, clients=0, CPUs=1384, heap=530.0GB] [04:14:51] Topology snapshot [ver=49, servers=33, clients=0, CPUs=1344, heap=520.0GB] [04:14:52] Ignite node stopped OK [name=WCA, uptime=00:02:05:374] Container: container_e76_1487862040010_131981_01_000023 on hostName_8041 =========================================================================================== LogType:stderr Log Upload Time:Wed Mar 01 04:14:58 -0600 2017 LogLength:53010 Log Contents: 17/03/01 04:10:59 INFO executor.CoarseGrainedExecutorBackend: Registered signal handlers for [TERM, HUP, INT] 17/03/01 04:10:59 INFO spark.SecurityManager: Changing view acls to: userName 17/03/01 04:10:59 INFO spark.SecurityManager: Changing modify acls to: userName 17/03/01 04:10:59 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(userName); users with modify permissions: Set(userName) 17/03/01 04:11:00 INFO slf4j.Slf4jLogger: Slf4jLogger started 17/03/01 04:11:00 INFO Remoting: Starting remoting 17/03/01 04:11:00 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://driverPropsFetcher@hostName:34686] 17/03/01 04:11:00 INFO Remoting: Remoting now listens on addresses: [akka.tcp://driverPropsFetcher@hostName:34686] 17/03/01 04:11:00 INFO util.Utils: Successfully started service 'driverPropsFetcher' on port 34686. 17/03/01 04:11:00 INFO spark.SecurityManager: Changing view acls to: userName 17/03/01 04:11:00 INFO spark.SecurityManager: Changing modify acls to: userName 17/03/01 04:11:00 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(userName); users with modify permissions: Set(userName) 17/03/01 04:11:00 INFO remote.RemoteActorRefProvider$RemotingTerminator: Shutting down remote daemon. 17/03/01 04:11:00 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remote daemon shut down; proceeding with flushing remote transports. 17/03/01 04:11:00 INFO slf4j.Slf4jLogger: Slf4jLogger started 17/03/01 04:11:00 INFO Remoting: Starting remoting 17/03/01 04:11:00 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://sparkExecutor@hostName:58923] 17/03/01 04:11:00 INFO Remoting: Remoting now listens on addresses: [akka.tcp://sparkExecutor@hostName:58923] 17/03/01 04:11:00 INFO util.Utils: Successfully started service 'sparkExecutor' on port 58923. 17/03/01 04:11:00 INFO Remoting: Remoting shut down 17/03/01 04:11:00 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remoting shut down. 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/1/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-b44db73c-2a5b-428a-aea6-38200e770380 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/2/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-103094e4-2906-42a8-80df-ba218e8182cb 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/3/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-460e3eb8-30d5-4eff-b731-3268d44deec8 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/4/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-703563b5-8ce7-4bf4-bf73-be4a8f013393 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/5/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-2ba86b2b-1a1d-4e1d-b88f-549887c36ecd 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/6/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-6e59397e-95a3-432b-98f0-e5ba586948e0 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/7/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-308fdf01-e908-4aa9-b402-6b026dba8ad0 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/8/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-63185e68-714f-4c09-987a-286315b75cc6 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/9/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-afb44aea-620d-43ea-b300-6bf1fdbb6174 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/10/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-586d449d-6d9a-4cdd-9334-43a30a6fee8e 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/11/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-ece4558a-2b77-49d8-96e4-6737dd14d760 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/12/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-4977dd0e-2698-4529-9031-ba10d3b649f0 17/03/01 04:11:00 INFO storage.MemoryStore: MemoryStore started with capacity 7.8 GB 17/03/01 04:11:01 INFO executor.CoarseGrainedExecutorBackend: Connecting to driver: akka.tcp://sparkDriver@ipaddress:38995/user/CoarseGrainedScheduler 17/03/01 04:11:01 INFO executor.CoarseGrainedExecutorBackend: Successfully registered with driver 17/03/01 04:11:01 INFO executor.Executor: Starting executor ID 20 on host hostName 17/03/01 04:11:01 INFO util.Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 51382. 17/03/01 04:11:01 INFO netty.NettyBlockTransferService: Server created on 51382 17/03/01 04:11:01 INFO storage.BlockManagerMaster: Trying to register BlockManager 17/03/01 04:11:01 INFO storage.BlockManagerMaster: Registered BlockManager 17/03/01 04:11:02 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 23 17/03/01 04:11:02 INFO executor.Executor: Running task 23.0 in stage 0.0 (TID 23) 17/03/01 04:11:02 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 0 17/03/01 04:11:02 INFO storage.MemoryStore: ensureFreeSpace(1310) called with curMem=0, maxMem=8334920908 17/03/01 04:11:02 INFO storage.MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 1310.0 B, free 7.8 GB) 17/03/01 04:11:02 INFO broadcast.TorrentBroadcast: Reading broadcast variable 0 took 233 ms 17/03/01 04:11:02 INFO storage.MemoryStore: ensureFreeSpace(2064) called with curMem=1310, maxMem=8334920908 17/03/01 04:11:02 INFO storage.MemoryStore: Block broadcast_0 stored as values in memory (estimated size 2.0 KB, free 7.8 GB) 17/03/01 04:11:02 INFO resolver.CompanyResolverSparkTest: Ranjit exec test 17/03/01 04:11:02 INFO executor.Executor: Finished task 23.0 in stage 0.0 (TID 23). 972 bytes result sent to driver 17/03/01 04:12:03 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 45 17/03/01 04:12:03 INFO executor.Executor: Running task 40.0 in stage 2.0 (TID 45) 17/03/01 04:12:03 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 84 17/03/01 04:12:03 INFO storage.MemoryStore: ensureFreeSpace(9240) called with curMem=3374, maxMem=8334920908 17/03/01 04:12:03 INFO storage.MemoryStore: Block broadcast_84_piece0 stored as bytes in memory (estimated size 9.0 KB, free 7.8 GB) 17/03/01 04:12:03 INFO broadcast.TorrentBroadcast: Reading broadcast variable 84 took 45 ms 17/03/01 04:12:03 INFO storage.MemoryStore: ensureFreeSpace(32704) called with curMem=12614, maxMem=8334920908 17/03/01 04:12:03 INFO storage.MemoryStore: Block broadcast_84 stored as values in memory (estimated size 31.9 KB, free 7.8 GB) 17/03/01 04:12:04 INFO codegen.GenerateMutableProjection: Code generated in 93.076609 ms 17/03/01 04:12:04 INFO codegen.GenerateUnsafeProjection: Code generated in 9.352471 ms 17/03/01 04:12:04 INFO codegen.GenerateMutableProjection: Code generated in 12.696158 ms 17/03/01 04:12:04 INFO codegen.GenerateUnsafeRowJoiner: Code generated in 7.720599 ms 17/03/01 04:12:04 INFO codegen.GenerateUnsafeProjection: Code generated in 7.096447 ms 17/03/01 04:12:04 INFO rdd.HadoopRDD: Input split: avro path/part-r-00016-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:0+42876786 17/03/01 04:12:04 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 64 17/03/01 04:12:04 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=45318, maxMem=8334920908 17/03/01 04:12:04 INFO storage.MemoryStore: Block broadcast_64_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:12:04 INFO broadcast.TorrentBroadcast: Reading broadcast variable 64 took 9 ms 17/03/01 04:12:04 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=69961, maxMem=8334920908 17/03/01 04:12:04 INFO storage.MemoryStore: Block broadcast_64 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:12:04 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 17/03/01 04:12:04 INFO Configuration.deprecation: mapred.tip.id is deprecated. Instead, use mapreduce.task.id 17/03/01 04:12:04 INFO Configuration.deprecation: mapred.task.id is deprecated. Instead, use mapreduce.task.attempt.id 17/03/01 04:12:04 INFO Configuration.deprecation: mapred.task.is.map is deprecated. Instead, use mapreduce.task.ismap 17/03/01 04:12:04 INFO Configuration.deprecation: mapred.task.partition is deprecated. Instead, use mapreduce.task.partition 17/03/01 04:12:04 INFO Configuration.deprecation: mapred.job.id is deprecated. Instead, use mapreduce.job.id 17/03/01 04:12:04 WARN security.UserGroupInformation: PriviledgedActionException as:userName (auth:SIMPLE) cause:org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:12:04 WARN ipc.Client: Exception encountered while connecting to the server : org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:12:04 WARN security.UserGroupInformation: PriviledgedActionException as:userName (auth:SIMPLE) cause:org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:12:07 INFO executor.Executor: Finished task 40.0 in stage 2.0 (TID 45). 2495 bytes result sent to driver 17/03/01 04:12:38 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 136 17/03/01 04:12:38 INFO executor.Executor: Running task 14.0 in stage 4.0 (TID 136) 17/03/01 04:12:38 INFO spark.MapOutputTrackerWorker: Updating epoch to 1 and clearing cache 17/03/01 04:12:38 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 86 17/03/01 04:12:38 INFO storage.MemoryStore: ensureFreeSpace(2290) called with curMem=417033, maxMem=8334920908 17/03/01 04:12:38 INFO storage.MemoryStore: Block broadcast_86_piece0 stored as bytes in memory (estimated size 2.2 KB, free 7.8 GB) 17/03/01 04:12:38 INFO broadcast.TorrentBroadcast: Reading broadcast variable 86 took 8 ms 17/03/01 04:12:38 INFO storage.MemoryStore: ensureFreeSpace(6544) called with curMem=419323, maxMem=8334920908 17/03/01 04:12:38 INFO storage.MemoryStore: Block broadcast_86 stored as values in memory (estimated size 6.4 KB, free 7.8 GB) 17/03/01 04:12:38 INFO resolver.CompanyResolverSparkTest: testing worker[ipaddress:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509] 17/03/01 04:12:38 ERROR : Failed to resolve default logging config file: config/java.util.logging.properties Console logging handler is not configured. 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: >>> __________ ________________ >>> / _/ ___/ |/ / _/_ __/ __/ >>> _/ // (7 7 // / / / / _/ >>> /___/\___/_/|_/___/ /_/ /___/ >>> >>> ver. 1.8.0#20161205-sha1:9ca40dbe >>> 2016 Copyright(C) Apache Software Foundation >>> >>> Ignite documentation: http://ignite.apache.org 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Config URL: n/a 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Daemon mode: off 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: OS: Linux 2.6.32-431.5.1.el6.x86_64 amd64 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: OS user: userName 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: PID: 27070 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Language runtime: Java Platform API Specification ver. 1.8 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM information: Java(TM) SE Runtime Environment 1.8.0_60-b27 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.60-b23 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM total memory: 14.0GB 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Remote Management [restart: off, REST: on, JMX (remote: off)] 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: IGNITE_HOME=null 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM arguments: [-XX:OnOutOfMemoryError=kill %p, -Xms15360m, -Xmx15360m, -Djava.io.tmpdir=/data/7/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/container_e76_1487862040010_131981_01_000023/tmp, -Dspark.driver.port=38995, -Dspark.ui.port=0, -Dspark.yarn.app.container.log.dir=/data/6/yarn/log/container/application_1487862040010_131981/container_e76_1487862040010_131981_01_000023] 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Configured caches ['ignite-marshaller-sys-cache', 'ignite-sys-cache', 'ignite-atomics-sys-cache'] 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: Configured plugins: 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: ^-- None 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: IPC shared memory server endpoint started [port=48100, tokDir=/data/7/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/container_e76_1487862040010_131981_01_000023/tmp/ignite/work/ipc/shmem/af5837f0-25ec-4f3d-a1c1-90c09dc424cb-27070] 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: Successfully bound shared memory communication to TCP port [port=48100, locHost=0.0.0.0/0.0.0.0] 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: Successfully bound to TCP port [port=47100, locHost=0.0.0.0/0.0.0.0] 17/03/01 04:12:38 WARN noop.NoopCheckpointSpi: Checkpoints are disabled (to enable configure any GridCheckpointSpi implementation) 17/03/01 04:12:38 WARN collision.GridCollisionManager: Collision resolution is disabled (all jobs will be activated upon arrival). 17/03/01 04:12:38 WARN noop.NoopSwapSpaceSpi: Swap space is disabled. To enable use FileSwapSpaceSpi. 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Security status [authentication=off, tls/ssl=off] 17/03/01 04:12:39 INFO tcp.GridTcpRestProtocol: Command protocol successfully started [name=TCP binary, host=0.0.0.0/0.0.0.0, port=11211] 17/03/01 04:12:39 INFO internal.IgniteKernal%WCA: Non-loopback local IPs: 2 17/03/01 04:12:39 INFO internal.IgniteKernal%WCA: Enabled local MACs: 44A842106EF8 17/03/01 04:12:39 INFO tcp.TcpDiscoverySpi: Successfully bound to TCP port [port=47500, localHost=0.0.0.0/0.0.0.0, locNodeId=af5837f0-25ec-4f3d-a1c1-90c09dc424cb] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=e9e49d2d-5eeb-474f-8757-e447efc8ca8f, addrs=[6, 127.0.0.1], sockAddrs=[hostName/6:47500, /127.0.0.1:47500], discPort=47500, order=34, intOrder=34, lastExchangeTime=1488363163917, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=34, servers=34, clients=0, CPUs=1400, heap=530.0GB] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4b90e5a3-253a-435b-84ca-6b592610cf0c, addrs=[4, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/4:47500], discPort=47500, order=35, intOrder=35, lastExchangeTime=1488363163917, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=35, servers=35, clients=0, CPUs=1432, heap=550.0GB] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=8fd4eea2-2a45-4563-ae87-1848fd388a98, addrs=[3, 127.0.0.1], sockAddrs=[hostName/3:47500, /127.0.0.1:47500], discPort=47500, order=36, intOrder=36, lastExchangeTime=1488363163927, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=36, servers=36, clients=0, CPUs=1472, heap=560.0GB] 17/03/01 04:12:44 INFO cache.GridCacheProcessor: Started cache [name=ignite-sys-cache, mode=REPLICATED] 17/03/01 04:12:44 INFO cache.GridCacheProcessor: Started cache [name=ignite-atomics-sys-cache, mode=PARTITIONED] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=d7b45a02-0411-4028-acdf-f004e592f294, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=37, intOrder=37, lastExchangeTime=1488363163967, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=37, servers=37, clients=0, CPUs=1512, heap=580.0GB] 17/03/01 04:12:44 INFO cache.GridCacheProcessor: Started cache [name=WCAIgniteCache, mode=PARTITIONED] 17/03/01 04:12:44 INFO cache.GridCacheProcessor: Started cache [name=ignite-marshaller-sys-cache, mode=REPLICATED] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=cf4e6e83-207e-42da-a55c-5621bc20b891, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=38, intOrder=38, lastExchangeTime=1488363163978, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=38, servers=38, clients=0, CPUs=1552, heap=590.0GB] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=d8926a2c-2c00-4445-beb4-633c2d656c41, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=39, intOrder=39, lastExchangeTime=1488363163988, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=39, servers=39, clients=0, CPUs=1584, heap=610.0GB] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4136a0c9-14d5-42b3-9a60-81689c800438, addrs=[3, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/3:47500], discPort=47500, order=40, intOrder=40, lastExchangeTime=1488363163998, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=40, servers=40, clients=0, CPUs=1624, heap=620.0GB] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=694a80b8-02a3-44c9-a2dd-45bed7d20a50, addrs=[1, 127.0.0.1], sockAddrs=[hostName/1:47500, /127.0.0.1:47500], discPort=47500, order=41, intOrder=41, lastExchangeTime=1488363164008, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=41, servers=41, clients=0, CPUs=1664, heap=640.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=33, minorTopVer=0], evt=NODE_JOINED, node=af5837f0-25ec-4f3d-a1c1-90c09dc424cb] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=34, minorTopVer=0], evt=NODE_JOINED, node=e9e49d2d-5eeb-474f-8757-e447efc8ca8f] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=35, minorTopVer=0], evt=NODE_JOINED, node=4b90e5a3-253a-435b-84ca-6b592610cf0c] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=36, minorTopVer=0], evt=NODE_JOINED, node=8fd4eea2-2a45-4563-ae87-1848fd388a98] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=37, minorTopVer=0], evt=NODE_JOINED, node=d7b45a02-0411-4028-acdf-f004e592f294] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=38, minorTopVer=0], evt=NODE_JOINED, node=cf4e6e83-207e-42da-a55c-5621bc20b891] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=39, minorTopVer=0], evt=NODE_JOINED, node=d8926a2c-2c00-4445-beb4-633c2d656c41] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=40, minorTopVer=0], evt=NODE_JOINED, node=4136a0c9-14d5-42b3-9a60-81689c800438] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-sys-cache, waitList=[]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-marshaller-sys-cache, waitList=[]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-atomics-sys-cache, waitList=[ignite-sys-cache, ignite-marshaller-sys-cache]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=WCAIgniteCache, waitList=[ignite-sys-cache, ignite-marshaller-sys-cache, ignite-atomics-sys-cache]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Rebalancing required [top=AffinityTopologyVersion [topVer=41, minorTopVer=0], evt=NODE_JOINED, node=694a80b8-02a3-44c9-a2dd-45bed7d20a50] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-marshaller-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=20, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=9] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=100, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=9] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-marshaller-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=20 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=20 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-atomics-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=24, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=9] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-atomics-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=0 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=WCAIgniteCache, mode=ASYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=24, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=9] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=WCAIgniteCache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=0 ms] 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: >>> +----------------------------------------------------------------------+ >>> Ignite ver. 1.8.0#20161205-sha1:9ca40dbeb7d559fcb299bdb6f5c90cdf8ce7e533 >>> +----------------------------------------------------------------------+ >>> OS name: Linux 2.6.32-431.5.1.el6.x86_64 amd64 >>> CPU(s): 40 >>> Heap: 15.0GB >>> VM name: 27070@hostName >>> Grid name: WCA >>> Local node [ID=AF5837F0-25EC-4F3D-A1C1-90C09DC424CB, order=33, clientMode=false] >>> Local node addresses: [hostName/2, /127.0.0.1] >>> Local ports: TCP:11211 TCP:47100 TCP:47500 TCP:48100 17/03/01 04:12:47 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=33, servers=33, clients=0, CPUs=1360, heap=520.0GB] 17/03/01 04:12:47 INFO resolver.CompanyResolverSparkTest: Started ignite node on executor 17/03/01 04:12:47 INFO executor.Executor: Finished task 14.0 in stage 4.0 (TID 136). 931 bytes result sent to driver 17/03/01 04:12:49 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 168 17/03/01 04:12:49 INFO executor.Executor: Running task 40.0 in stage 5.0 (TID 168) 17/03/01 04:12:49 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 128 17/03/01 04:12:49 INFO storage.MemoryStore: ensureFreeSpace(7311) called with curMem=12208, maxMem=8334920908 17/03/01 04:12:49 INFO storage.MemoryStore: Block broadcast_128_piece0 stored as bytes in memory (estimated size 7.1 KB, free 7.8 GB) 17/03/01 04:12:49 INFO broadcast.TorrentBroadcast: Reading broadcast variable 128 took 10 ms 17/03/01 04:12:49 INFO storage.MemoryStore: ensureFreeSpace(28168) called with curMem=19519, maxMem=8334920908 17/03/01 04:12:49 INFO storage.MemoryStore: Block broadcast_128 stored as values in memory (estimated size 27.5 KB, free 7.8 GB) 17/03/01 04:12:49 INFO rdd.HadoopRDD: Input split: avro path/part-r-00016-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:0+42876786 17/03/01 04:12:49 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 108 17/03/01 04:12:49 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=47687, maxMem=8334920908 17/03/01 04:12:49 INFO storage.MemoryStore: Block broadcast_108_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:12:49 INFO broadcast.TorrentBroadcast: Reading broadcast variable 108 took 9 ms 17/03/01 04:12:49 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=72330, maxMem=8334920908 17/03/01 04:12:49 INFO storage.MemoryStore: Block broadcast_108 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:12:49 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=41, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, node=6172ee3a-eb33-4bf5-9080-c255f52caed8] 17/03/01 04:12:57 INFO executor.Executor: Finished task 40.0 in stage 5.0 (TID 168). 2098 bytes result sent to driver 17/03/01 04:13:33 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 236 17/03/01 04:13:33 INFO executor.Executor: Running task 30.0 in stage 5.0 (TID 236) 17/03/01 04:13:33 INFO rdd.HadoopRDD: Input split: avro path/part-r-00027-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:0+58976207 17/03/01 04:13:33 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 103 17/03/01 04:13:33 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=407194, maxMem=8334920908 17/03/01 04:13:33 INFO storage.MemoryStore: Block broadcast_103_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:13:33 INFO broadcast.TorrentBroadcast: Reading broadcast variable 103 took 27 ms 17/03/01 04:13:33 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=431837, maxMem=8334920908 17/03/01 04:13:33 INFO storage.MemoryStore: Block broadcast_103 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:13:45 INFO executor.Executor: Finished task 30.0 in stage 5.0 (TID 236). 2098 bytes result sent to driver 17/03/01 04:13:47 INFO internal.IgniteKernal%WCA: Metrics for local node (to disable set 'metricsLogFrequency' to 0) ^-- Node [id=af5837f0, name=WCA, uptime=00:01:00:008] ^-- H/N/C [hosts=41, nodes=41, CPUs=1664] ^-- CPU [cur=1.6%, avg=3.67%, GC=0%] ^-- Heap [used=2547MB, free=82.69%, comm=14718MB] ^-- Non heap [used=119MB, free=-1%, comm=121MB] ^-- Public thread pool [active=0, idle=0, qSize=0] ^-- System thread pool [active=0, idle=80, qSize=0] ^-- Outbound messages queue [size=0] 17/03/01 04:13:54 INFO cluster.GridUpdateNotifier: Update status is not available. 17/03/01 04:14:00 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 262 17/03/01 04:14:00 INFO executor.Executor: Running task 18.0 in stage 7.0 (TID 262) 17/03/01 04:14:00 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 131 17/03/01 04:14:00 INFO storage.MemoryStore: ensureFreeSpace(2732) called with curMem=778909, maxMem=8334920908 17/03/01 04:14:00 INFO storage.MemoryStore: Block broadcast_131_piece0 stored as bytes in memory (estimated size 2.7 KB, free 7.8 GB) 17/03/01 04:14:00 INFO broadcast.TorrentBroadcast: Reading broadcast variable 131 took 25 ms 17/03/01 04:14:00 INFO storage.MemoryStore: ensureFreeSpace(7336) called with curMem=781641, maxMem=8334920908 17/03/01 04:14:00 INFO storage.MemoryStore: Block broadcast_131 stored as values in memory (estimated size 7.2 KB, free 7.8 GB) 17/03/01 04:14:00 INFO dao.CompanyDAO: testing[ipaddress:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509] 17/03/01 04:14:00 INFO dao.CompanyDAO: input company name inside Contains searchERB BUILDING SUPPLY 17/03/01 04:14:11 ERROR executor.Executor: Exception in task 18.0 in stage 7.0 (TID 262) javax.cache.CacheException: class org.apache.ignite.IgniteCheckedException: Query execution failed: GridCacheQueryBean [qry=GridCacheQueryAdapter [type=TEXT, clsName=CompanyVO1, clause=ERB BUILDING SUPPLY, filter=null, transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=true, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=af5837f0-25ec-4f3d-a1c1-90c09dc424cb, taskHash=0], rdc=null, trans=null] at org.apache.ignite.internal.processors.cache.GridCacheUtils.convertToCacheException(GridCacheUtils.java:1440) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.next(GridCacheQueryFutureAdapter.java:174) at org.apache.ignite.internal.processors.cache.IgniteCacheProxy$5.onHasNext(IgniteCacheProxy.java:600) at org.apache.ignite.internal.util.GridCloseableIteratorAdapter.hasNextX(GridCloseableIteratorAdapter.java:53) at org.apache.ignite.internal.util.lang.GridIteratorAdapter.hasNext(GridIteratorAdapter.java:45) at un.api.resolver.dao.CompanyDAO.getVarCompContains(CompanyDAO.scala:242) at un.api.resolver.accessor.CompanyAccessor.getVarCompContains(CompanyAccessor.scala:27) at un.api.resolver.CompanyResolverSparkTest$$anonfun$main$7.apply(CompanyResolverSparkTest.scala:291) at un.api.resolver.CompanyResolverSparkTest$$anonfun$main$7.apply(CompanyResolverSparkTest.scala:289) at scala.collection.Iterator$$anon$11.next(Iterator.scala:328) at org.apache.spark.util.Utils$.getIteratorSize(Utils.scala:1554) at org.apache.spark.rdd.RDD$$anonfun$count$1.apply(RDD.scala:1121) at org.apache.spark.rdd.RDD$$anonfun$count$1.apply(RDD.scala:1121) at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1850) at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1850) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:66) at org.apache.spark.scheduler.Task.run(Task.scala:88) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:214) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: class org.apache.ignite.IgniteCheckedException: Query execution failed: GridCacheQueryBean [qry=GridCacheQueryAdapter [type=TEXT, clsName=CompanyVO1, clause=ERB BUILDING SUPPLY, filter=null, transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=true, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=af5837f0-25ec-4f3d-a1c1-90c09dc424cb, taskHash=0], rdc=null, trans=null] at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.checkError(GridCacheQueryFutureAdapter.java:260) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.internalIterator(GridCacheQueryFutureAdapter.java:318) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.next(GridCacheQueryFutureAdapter.java:164) ... 19 more Caused by: class org.apache.ignite.IgniteCheckedException: Failed to execute query on node [query=GridCacheQueryBean [qry=GridCacheQueryAdapter [type=TEXT, clsName=CompanyVO1, clause=ERB BUILDING SUPPLY, filter=null, transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=true, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=af5837f0-25ec-4f3d-a1c1-90c09dc424cb, taskHash=0], rdc=null, trans=null], nodeId=23f61699-e2c9-4ff6-8731-2483934e84c4] at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.onPage(GridCacheQueryFutureAdapter.java:383) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.processQueryResponse(GridCacheDistributedQueryManager.java:398) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.access$000(GridCacheDistributedQueryManager.java:63) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$1.apply(GridCacheDistributedQueryManager.java:93) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$1.apply(GridCacheDistributedQueryManager.java:91) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.processMessage(GridCacheIoManager.java:827) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.onMessage0(GridCacheIoManager.java:369) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.access$400(GridCacheIoManager.java:95) at org.apache.ignite.internal.processors.cache.GridCacheIoManager$OrderedMessageListener.onMessage(GridCacheIoManager.java:1345) at org.apache.ignite.internal.managers.communication.GridIoManager.invokeListener(GridIoManager.java:1082) at org.apache.ignite.internal.managers.communication.GridIoManager.access$1600(GridIoManager.java:102) at org.apache.ignite.internal.managers.communication.GridIoManager$GridCommunicationMessageSet.unwind(GridIoManager.java:2332) at org.apache.ignite.internal.managers.communication.GridIoManager.unwindMessageSet(GridIoManager.java:1042) at org.apache.ignite.internal.managers.communication.GridIoManager.access$1900(GridIoManager.java:102) at org.apache.ignite.internal.managers.communication.GridIoManager$6.run(GridIoManager.java:1011) ... 3 more Caused by: java.lang.NullPointerException 17/03/01 04:14:11 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=9fb6e583-cea0-4f78-b403-b403a8bc9a0e, res=GridCacheQueryResponse [finished=false, reqId=393, err=null, fields=false, metadata=null]] 17/03/01 04:14:11 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 298 17/03/01 04:14:11 INFO executor.Executor: Running task 18.1 in stage 7.0 (TID 298) 17/03/01 04:14:28 INFO executor.Executor: Finished task 18.1 in stage 7.0 (TID 298). 969 bytes result sent to driver 17/03/01 04:14:47 INFO internal.IgniteKernal%WCA: Metrics for local node (to disable set 'metricsLogFrequency' to 0) ^-- Node [id=af5837f0, name=WCA, uptime=00:02:00:021] ^-- H/N/C [hosts=41, nodes=41, CPUs=1664] ^-- CPU [cur=0.23%, avg=3.15%, GC=0%] ^-- Heap [used=2017MB, free=86.02%, comm=14423MB] ^-- Non heap [used=124MB, free=-1%, comm=126MB] ^-- Public thread pool [active=0, idle=0, qSize=0] ^-- System thread pool [active=0, idle=80, qSize=0] ^-- Outbound messages queue [size=0] 17/03/01 04:14:49 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 321 17/03/01 04:14:49 INFO executor.Executor: Running task 8.0 in stage 8.0 (TID 321) 17/03/01 04:14:49 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 132 17/03/01 04:14:49 INFO storage.MemoryStore: ensureFreeSpace(887) called with curMem=788977, maxMem=8334920908 17/03/01 04:14:49 INFO storage.MemoryStore: Block broadcast_132_piece0 stored as bytes in memory (estimated size 887.0 B, free 7.8 GB) 17/03/01 04:14:49 INFO broadcast.TorrentBroadcast: Reading broadcast variable 132 took 114 ms 17/03/01 04:14:49 INFO storage.MemoryStore: ensureFreeSpace(1216) called with curMem=789864, maxMem=8334920908 17/03/01 04:14:49 INFO storage.MemoryStore: Block broadcast_132 stored as values in memory (estimated size 1216.0 B, free 7.8 GB) 17/03/01 04:14:49 INFO tcp.GridTcpRestProtocol: Command protocol successfully stopped: TCP binary 17/03/01 04:14:50 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=4136a0c9-14d5-42b3-9a60-81689c800438, addrs=[3, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/3:47500], discPort=47500, order=40, intOrder=40, lastExchangeTime=1488363163998, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:50 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=42, servers=40, clients=0, CPUs=1624, heap=620.0GB] 17/03/01 04:14:50 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=cf4e6e83-207e-42da-a55c-5621bc20b891, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=38, intOrder=38, lastExchangeTime=1488363163978, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:50 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=43, servers=39, clients=0, CPUs=1584, heap=610.0GB] 17/03/01 04:14:50 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=d8926a2c-2c00-4445-beb4-633c2d656c41, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=39, intOrder=39, lastExchangeTime=1488363163988, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:50 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=44, servers=38, clients=0, CPUs=1552, heap=590.0GB] 17/03/01 04:14:50 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=e9e49d2d-5eeb-474f-8757-e447efc8ca8f, addrs=[6, 127.0.0.1], sockAddrs=[hostName/6:47500, /127.0.0.1:47500], discPort=47500, order=34, intOrder=34, lastExchangeTime=1488363163917, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:50 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=45, servers=37, clients=0, CPUs=1512, heap=580.0GB] 17/03/01 04:14:51 WARN tcp.TcpDiscoverySpi: Failed to ping node (status check will be initiated): 8fd4eea2-2a45-4563-ae87-1848fd388a98 17/03/01 04:14:52 INFO cache.GridCacheProcessor: Stopped cache: ignite-marshaller-sys-cache 17/03/01 04:14:52 INFO cache.GridCacheProcessor: Stopped cache: ignite-sys-cache 17/03/01 04:14:52 INFO cache.GridCacheProcessor: Stopped cache: ignite-atomics-sys-cache 17/03/01 04:14:52 INFO cache.GridCacheProcessor: Stopped cache: WCAIgniteCache 17/03/01 04:14:52 INFO internal.IgniteKernal%WCA: >>> +---------------------------------------------------------------------------------+ >>> Ignite ver. 1.8.0#20161205-sha1:9ca40dbeb7d559fcb299bdb6f5c90cdf8ce7e533 stopped OK >>> +---------------------------------------------------------------------------------+ >>> Grid name: WCA >>> Grid uptime: 00:02:04:859 17/03/01 04:14:52 INFO executor.Executor: Finished task 8.0 in stage 8.0 (TID 321). 931 bytes result sent to driver 17/03/01 04:14:53 INFO executor.CoarseGrainedExecutorBackend: Driver commanded a shutdown 17/03/01 04:14:53 INFO storage.MemoryStore: MemoryStore cleared 17/03/01 04:14:53 INFO storage.BlockManager: BlockManager stopped 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Shutting down remote daemon. 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remote daemon shut down; proceeding with flushing remote transports. 17/03/01 04:14:53 INFO Remoting: Remoting shut down 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remoting shut down. 17/03/01 04:14:53 INFO util.ShutdownHookManager: Shutdown hook called LogType:stdout Log Upload Time:Wed Mar 01 04:14:58 -0600 2017 LogLength:2179 Log Contents: rEnd of the programe - [04:12:38] __________ ________________ [04:12:38] / _/ ___/ |/ / _/_ __/ __/ [04:12:38] _/ // (7 7 // / / / / _/ [04:12:38] /___/\___/_/|_/___/ /_/ /___/ [04:12:38] [04:12:38] ver. 1.8.0#20161205-sha1:9ca40dbe [04:12:38] 2016 Copyright(C) Apache Software Foundation [04:12:38] [04:12:38] Ignite documentation: http://ignite.apache.org [04:12:38] [04:12:38] Quiet mode. [04:12:38] ^-- To see **FULL** console log here add -DIGNITE_QUIET=false or "-v" to ignite.{sh|bat} [04:12:38] [04:12:38] OS: Linux 2.6.32-431.5.1.el6.x86_64 amd64 [04:12:38] VM information: Java(TM) SE Runtime Environment 1.8.0_60-b27 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.60-b23 [04:12:38] Configured plugins: [04:12:38] ^-- None [04:12:38] [04:12:38] Security status [authentication=off, tls/ssl=off] [04:12:44] Topology snapshot [ver=34, servers=34, clients=0, CPUs=1400, heap=530.0GB] [04:12:44] Topology snapshot [ver=35, servers=35, clients=0, CPUs=1432, heap=550.0GB] [04:12:44] Topology snapshot [ver=36, servers=36, clients=0, CPUs=1472, heap=560.0GB] [04:12:44] Topology snapshot [ver=37, servers=37, clients=0, CPUs=1512, heap=580.0GB] [04:12:44] Topology snapshot [ver=38, servers=38, clients=0, CPUs=1552, heap=590.0GB] [04:12:45] Topology snapshot [ver=39, servers=39, clients=0, CPUs=1584, heap=610.0GB] [04:12:45] Topology snapshot [ver=40, servers=40, clients=0, CPUs=1624, heap=620.0GB] [04:12:45] Topology snapshot [ver=41, servers=41, clients=0, CPUs=1664, heap=640.0GB] [04:12:47] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [04:12:47] [04:12:47] Ignite node started OK (id=af5837f0, grid=WCA) [04:12:47] Topology snapshot [ver=33, servers=33, clients=0, CPUs=1360, heap=520.0GB] [04:14:50] Topology snapshot [ver=42, servers=40, clients=0, CPUs=1624, heap=620.0GB] [04:14:50] Topology snapshot [ver=43, servers=39, clients=0, CPUs=1584, heap=610.0GB] [04:14:50] Topology snapshot [ver=44, servers=38, clients=0, CPUs=1552, heap=590.0GB] [04:14:50] Topology snapshot [ver=45, servers=37, clients=0, CPUs=1512, heap=580.0GB] [04:14:52] Ignite node stopped OK [name=WCA, uptime=00:02:04:859] Container: container_e76_1487862040010_131981_01_000020 on hostName_8041 =========================================================================================== LogType:stderr Log Upload Time:Wed Mar 01 04:14:58 -0600 2017 LogLength:75845 Log Contents: 17/03/01 04:10:59 INFO executor.CoarseGrainedExecutorBackend: Registered signal handlers for [TERM, HUP, INT] 17/03/01 04:11:00 INFO spark.SecurityManager: Changing view acls to: userName 17/03/01 04:11:00 INFO spark.SecurityManager: Changing modify acls to: userName 17/03/01 04:11:00 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(userName); users with modify permissions: Set(userName) 17/03/01 04:11:00 INFO slf4j.Slf4jLogger: Slf4jLogger started 17/03/01 04:11:00 INFO Remoting: Starting remoting 17/03/01 04:11:00 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://driverPropsFetcher@hostName:37524] 17/03/01 04:11:00 INFO Remoting: Remoting now listens on addresses: [akka.tcp://driverPropsFetcher@hostName:37524] 17/03/01 04:11:00 INFO util.Utils: Successfully started service 'driverPropsFetcher' on port 37524. 17/03/01 04:11:00 INFO spark.SecurityManager: Changing view acls to: userName 17/03/01 04:11:00 INFO spark.SecurityManager: Changing modify acls to: userName 17/03/01 04:11:00 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(userName); users with modify permissions: Set(userName) 17/03/01 04:11:00 INFO remote.RemoteActorRefProvider$RemotingTerminator: Shutting down remote daemon. 17/03/01 04:11:00 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remote daemon shut down; proceeding with flushing remote transports. 17/03/01 04:11:01 INFO slf4j.Slf4jLogger: Slf4jLogger started 17/03/01 04:11:01 INFO Remoting: Starting remoting 17/03/01 04:11:01 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://sparkExecutor@hostName:52031] 17/03/01 04:11:01 INFO Remoting: Remoting shut down 17/03/01 04:11:01 INFO Remoting: Remoting now listens on addresses: [akka.tcp://sparkExecutor@hostName:52031] 17/03/01 04:11:01 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remoting shut down. 17/03/01 04:11:01 INFO util.Utils: Successfully started service 'sparkExecutor' on port 52031. 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/1/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-81711493-995b-4863-830c-96787d000063 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/2/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-13a80366-54c7-4f5a-b5a2-a9f6e759365c 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/3/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-9616a9a9-21bb-4edc-9488-690c2ff76f13 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/4/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-075d12cd-0e7b-4c28-b3bd-fcde8f61b931 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/5/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-2c85dfc4-1b2c-46a0-b8fc-b4d39954c59e 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/6/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-e10451c8-f205-4bc0-8fe7-47da71f85ae0 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/7/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-5e9ffe97-c31e-4512-be6f-ba634597a0f5 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/8/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-231b6710-06a2-4d75-b489-7da77fe6c1c4 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/9/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-46d9be59-a60f-4448-9a09-5b033563dadf 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/10/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-c480cbc3-0562-4e01-978e-70b54d23a502 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/11/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-ce02653d-a11f-4058-bb84-b49e3fa92d83 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/12/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-a035194f-a603-4856-b96f-21b85bc21299 17/03/01 04:11:01 INFO storage.MemoryStore: MemoryStore started with capacity 7.8 GB 17/03/01 04:11:01 INFO executor.CoarseGrainedExecutorBackend: Connecting to driver: akka.tcp://sparkDriver@ipaddress:38995/user/CoarseGrainedScheduler 17/03/01 04:11:01 INFO executor.CoarseGrainedExecutorBackend: Successfully registered with driver 17/03/01 04:11:01 INFO executor.Executor: Starting executor ID 17 on host hostName 17/03/01 04:11:01 INFO util.Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 35569. 17/03/01 04:11:01 INFO netty.NettyBlockTransferService: Server created on 35569 17/03/01 04:11:01 INFO storage.BlockManagerMaster: Trying to register BlockManager 17/03/01 04:11:01 INFO storage.BlockManagerMaster: Registered BlockManager 17/03/01 04:11:02 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 30 17/03/01 04:11:02 INFO executor.Executor: Running task 30.0 in stage 0.0 (TID 30) 17/03/01 04:11:02 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 0 17/03/01 04:11:02 INFO storage.MemoryStore: ensureFreeSpace(1310) called with curMem=0, maxMem=8334920908 17/03/01 04:11:02 INFO storage.MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 1310.0 B, free 7.8 GB) 17/03/01 04:11:02 INFO broadcast.TorrentBroadcast: Reading broadcast variable 0 took 233 ms 17/03/01 04:11:02 INFO storage.MemoryStore: ensureFreeSpace(2064) called with curMem=1310, maxMem=8334920908 17/03/01 04:11:02 INFO storage.MemoryStore: Block broadcast_0 stored as values in memory (estimated size 2.0 KB, free 7.8 GB) 17/03/01 04:11:02 INFO resolver.CompanyResolverSparkTest: Ranjit exec test 17/03/01 04:11:02 INFO executor.Executor: Finished task 30.0 in stage 0.0 (TID 30). 972 bytes result sent to driver 17/03/01 04:12:31 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 114 17/03/01 04:12:31 INFO executor.Executor: Running task 8.0 in stage 2.0 (TID 114) 17/03/01 04:12:31 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 84 17/03/01 04:12:31 INFO storage.MemoryStore: ensureFreeSpace(9240) called with curMem=3374, maxMem=8334920908 17/03/01 04:12:31 INFO storage.MemoryStore: Block broadcast_84_piece0 stored as bytes in memory (estimated size 9.0 KB, free 7.8 GB) 17/03/01 04:12:31 INFO broadcast.TorrentBroadcast: Reading broadcast variable 84 took 13 ms 17/03/01 04:12:31 INFO storage.MemoryStore: ensureFreeSpace(32704) called with curMem=12614, maxMem=8334920908 17/03/01 04:12:31 INFO storage.MemoryStore: Block broadcast_84 stored as values in memory (estimated size 31.9 KB, free 7.8 GB) 17/03/01 04:12:32 INFO codegen.GenerateMutableProjection: Code generated in 101.54412 ms 17/03/01 04:12:32 INFO codegen.GenerateUnsafeProjection: Code generated in 9.003913 ms 17/03/01 04:12:32 INFO codegen.GenerateMutableProjection: Code generated in 12.867911 ms 17/03/01 04:12:32 INFO codegen.GenerateUnsafeRowJoiner: Code generated in 7.739363 ms 17/03/01 04:12:32 INFO codegen.GenerateUnsafeProjection: Code generated in 7.374418 ms 17/03/01 04:12:32 INFO rdd.HadoopRDD: Input split: avro path/part-r-00023-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:0+37464516 17/03/01 04:12:32 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 48 17/03/01 04:12:32 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=45318, maxMem=8334920908 17/03/01 04:12:32 INFO storage.MemoryStore: Block broadcast_48_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:12:32 INFO broadcast.TorrentBroadcast: Reading broadcast variable 48 took 8 ms 17/03/01 04:12:32 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=69961, maxMem=8334920908 17/03/01 04:12:32 INFO storage.MemoryStore: Block broadcast_48 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:12:33 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 17/03/01 04:12:33 INFO Configuration.deprecation: mapred.tip.id is deprecated. Instead, use mapreduce.task.id 17/03/01 04:12:33 INFO Configuration.deprecation: mapred.task.id is deprecated. Instead, use mapreduce.task.attempt.id 17/03/01 04:12:33 INFO Configuration.deprecation: mapred.task.is.map is deprecated. Instead, use mapreduce.task.ismap 17/03/01 04:12:33 INFO Configuration.deprecation: mapred.task.partition is deprecated. Instead, use mapreduce.task.partition 17/03/01 04:12:33 INFO Configuration.deprecation: mapred.job.id is deprecated. Instead, use mapreduce.job.id 17/03/01 04:12:33 WARN security.UserGroupInformation: PriviledgedActionException as:userName (auth:SIMPLE) cause:org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:12:33 WARN ipc.Client: Exception encountered while connecting to the server : org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:12:33 WARN security.UserGroupInformation: PriviledgedActionException as:userName (auth:SIMPLE) cause:org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:12:36 INFO executor.Executor: Finished task 8.0 in stage 2.0 (TID 114). 2495 bytes result sent to driver 17/03/01 04:12:38 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 154 17/03/01 04:12:38 INFO executor.Executor: Running task 32.0 in stage 4.0 (TID 154) 17/03/01 04:12:38 INFO spark.MapOutputTrackerWorker: Updating epoch to 1 and clearing cache 17/03/01 04:12:38 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 86 17/03/01 04:12:38 INFO storage.MemoryStore: ensureFreeSpace(2290) called with curMem=417033, maxMem=8334920908 17/03/01 04:12:38 INFO storage.MemoryStore: Block broadcast_86_piece0 stored as bytes in memory (estimated size 2.2 KB, free 7.8 GB) 17/03/01 04:12:38 INFO broadcast.TorrentBroadcast: Reading broadcast variable 86 took 9 ms 17/03/01 04:12:38 INFO storage.MemoryStore: ensureFreeSpace(6544) called with curMem=419323, maxMem=8334920908 17/03/01 04:12:38 INFO storage.MemoryStore: Block broadcast_86 stored as values in memory (estimated size 6.4 KB, free 7.8 GB) 17/03/01 04:12:38 INFO resolver.CompanyResolverSparkTest: testing worker[ipaddress:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509] 17/03/01 04:12:38 ERROR : Failed to resolve default logging config file: config/java.util.logging.properties Console logging handler is not configured. 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: >>> __________ ________________ >>> / _/ ___/ |/ / _/_ __/ __/ >>> _/ // (7 7 // / / / / _/ >>> /___/\___/_/|_/___/ /_/ /___/ >>> >>> ver. 1.8.0#20161205-sha1:9ca40dbe >>> 2016 Copyright(C) Apache Software Foundation >>> >>> Ignite documentation: http://ignite.apache.org 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Config URL: n/a 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Daemon mode: off 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: OS: Linux 2.6.32-431.5.1.el6.x86_64 amd64 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: OS user: userName 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: PID: 38562 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Language runtime: Java Platform API Specification ver. 1.8 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM information: Java(TM) SE Runtime Environment 1.8.0_60-b27 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.60-b23 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM total memory: 14.0GB 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Remote Management [restart: off, REST: on, JMX (remote: off)] 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: IGNITE_HOME=null 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM arguments: [-XX:OnOutOfMemoryError=kill %p, -Xms15360m, -Xmx15360m, -Djava.io.tmpdir=/data/2/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/container_e76_1487862040010_131981_01_000020/tmp, -Dspark.driver.port=38995, -Dspark.ui.port=0, -Dspark.yarn.app.container.log.dir=/data/6/yarn/log/container/application_1487862040010_131981/container_e76_1487862040010_131981_01_000020] 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Configured caches ['ignite-marshaller-sys-cache', 'ignite-sys-cache', 'ignite-atomics-sys-cache'] 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: Configured plugins: 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: ^-- None 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: IPC shared memory server endpoint started [port=48100, tokDir=/data/2/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/container_e76_1487862040010_131981_01_000020/tmp/ignite/work/ipc/shmem/717de453-fc6b-4a46-91b2-b5c54ab8a4be-38562] 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: Successfully bound shared memory communication to TCP port [port=48100, locHost=0.0.0.0/0.0.0.0] 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: Successfully bound to TCP port [port=47100, locHost=0.0.0.0/0.0.0.0] 17/03/01 04:12:38 WARN noop.NoopCheckpointSpi: Checkpoints are disabled (to enable configure any GridCheckpointSpi implementation) 17/03/01 04:12:38 WARN collision.GridCollisionManager: Collision resolution is disabled (all jobs will be activated upon arrival). 17/03/01 04:12:38 WARN noop.NoopSwapSpaceSpi: Swap space is disabled. To enable use FileSwapSpaceSpi. 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Security status [authentication=off, tls/ssl=off] 17/03/01 04:12:39 INFO tcp.GridTcpRestProtocol: Command protocol successfully started [name=TCP binary, host=0.0.0.0/0.0.0.0, port=11211] 17/03/01 04:12:39 INFO internal.IgniteKernal%WCA: Non-loopback local IPs: 2 17/03/01 04:12:39 INFO internal.IgniteKernal%WCA: Enabled local MACs: B083FECD68D2 17/03/01 04:12:39 INFO tcp.TcpDiscoverySpi: Successfully bound to TCP port [port=47500, localHost=0.0.0.0/0.0.0.0, locNodeId=717de453-fc6b-4a46-91b2-b5c54ab8a4be] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=ffe19475-7849-4027-8648-ce56598ff50f, addrs=[7, 127.0.0.1], sockAddrs=[/127.0.0.1:47501, hostName/7:47501], discPort=47501, order=11, intOrder=11, lastExchangeTime=1488363160389, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=11, servers=11, clients=0, CPUs=472, heap=190.0GB] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=8be1bd05-d62c-4f1a-83f2-91dcb3f3b62a, addrs=[07, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/07:47500], discPort=47500, order=12, intOrder=12, lastExchangeTime=1488363160399, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=12, servers=12, clients=0, CPUs=504, heap=200.0GB] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=133c388f-3399-4cc8-b2f1-7ae8ba971b03, addrs=[7, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/7:47500], discPort=47500, order=13, intOrder=13, lastExchangeTime=1488363160409, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=13, servers=13, clients=0, CPUs=544, heap=220.0GB] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=23f61699-e2c9-4ff6-8731-2483934e84c4, addrs=[0, 127.0.0.1], sockAddrs=[hostName/0:47500, /127.0.0.1:47500], discPort=47500, order=14, intOrder=14, lastExchangeTime=1488363160419, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=14, servers=14, clients=0, CPUs=584, heap=230.0GB] 17/03/01 04:12:41 INFO cache.GridCacheProcessor: Started cache [name=ignite-sys-cache, mode=REPLICATED] 17/03/01 04:12:41 INFO cache.GridCacheProcessor: Started cache [name=ignite-atomics-sys-cache, mode=PARTITIONED] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=95f164b5-4b73-438f-804f-62854d615b5b, addrs=[9, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/9:47500], discPort=47500, order=15, intOrder=15, lastExchangeTime=1488363160429, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=15, servers=15, clients=0, CPUs=624, heap=250.0GB] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=c4f4f6bb-b71a-4a29-9575-afee2ddc1b2d, addrs=[6, 127.0.0.1], sockAddrs=[hostName/6:47500, /127.0.0.1:47500], discPort=47500, order=16, intOrder=16, lastExchangeTime=1488363160429, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=16, servers=16, clients=0, CPUs=664, heap=260.0GB] 17/03/01 04:12:41 INFO cache.GridCacheProcessor: Started cache [name=WCAIgniteCache, mode=PARTITIONED] 17/03/01 04:12:41 INFO cache.GridCacheProcessor: Started cache [name=ignite-marshaller-sys-cache, mode=REPLICATED] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=ddc47224-d030-4d1f-ba66-08f61368a395, addrs=[4, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/4:47500], discPort=47500, order=17, intOrder=17, lastExchangeTime=1488363160439, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=17, servers=17, clients=0, CPUs=704, heap=280.0GB] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=47c1a0d8-9d4d-4d0d-9b27-388bd7f49278, addrs=[1, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/1:47500], discPort=47500, order=18, intOrder=18, lastExchangeTime=1488363160439, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=18, servers=18, clients=0, CPUs=744, heap=290.0GB] 17/03/01 04:12:41 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=10, minorTopVer=0], evt=NODE_JOINED, node=717de453-fc6b-4a46-91b2-b5c54ab8a4be] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=e87f12ce-5981-4418-8468-f6bfed0a0cd8, addrs=[6, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/6:47500], discPort=47500, order=19, intOrder=19, lastExchangeTime=1488363160449, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=19, servers=19, clients=0, CPUs=784, heap=310.0GB] 17/03/01 04:12:41 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=11, minorTopVer=0], evt=NODE_JOINED, node=ffe19475-7849-4027-8648-ce56598ff50f] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=e2cba212-89dd-48dd-8d7e-821b5725fe03, addrs=[8, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/8:47500], discPort=47500, order=20, intOrder=20, lastExchangeTime=1488363160470, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=12, minorTopVer=0], evt=NODE_JOINED, node=8be1bd05-d62c-4f1a-83f2-91dcb3f3b62a] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=20, servers=20, clients=0, CPUs=816, heap=320.0GB] 17/03/01 04:12:41 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=13, minorTopVer=0], evt=NODE_JOINED, node=133c388f-3399-4cc8-b2f1-7ae8ba971b03] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=f9ce8dd7-2060-4c34-b597-d7bee86ebedb, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=21, intOrder=21, lastExchangeTime=1488363160480, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=21, servers=21, clients=0, CPUs=856, heap=340.0GB] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=14, minorTopVer=0], evt=NODE_JOINED, node=23f61699-e2c9-4ff6-8731-2483934e84c4] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=6b1889dd-9de5-4f1b-8ec9-c123c7df8ea2, addrs=[, 127.0.0.1], sockAddrs=[hostName/:47500, /127.0.0.1:47500], discPort=47500, order=22, intOrder=22, lastExchangeTime=1488363160480, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=22, servers=22, clients=0, CPUs=896, heap=350.0GB] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=15, minorTopVer=0], evt=NODE_JOINED, node=95f164b5-4b73-438f-804f-62854d615b5b] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=9fb6e583-cea0-4f78-b403-b403a8bc9a0e, addrs=[7, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/7:47500], discPort=47500, order=23, intOrder=23, lastExchangeTime=1488363160490, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=23, servers=23, clients=0, CPUs=936, heap=370.0GB] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=20860cae-2881-4311-a3f5-edaa160ef37f, addrs=[7, 127.0.0.1], sockAddrs=[hostName/7:47500, /127.0.0.1:47500], discPort=47500, order=24, intOrder=24, lastExchangeTime=1488363160490, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=24, servers=24, clients=0, CPUs=976, heap=380.0GB] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=16, minorTopVer=0], evt=NODE_JOINED, node=c4f4f6bb-b71a-4a29-9575-afee2ddc1b2d] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=0d675d57-b9b9-4cff-a994-77337d618bbe, addrs=[4, 127.0.0.1], sockAddrs=[hostName/4:47500, /127.0.0.1:47500], discPort=47500, order=25, intOrder=25, lastExchangeTime=1488363160500, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=25, servers=25, clients=0, CPUs=1016, heap=400.0GB] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=17, minorTopVer=0], evt=NODE_JOINED, node=ddc47224-d030-4d1f-ba66-08f61368a395] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=a6343860-6e84-4d9c-9b87-84ffd76280cd, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=26, intOrder=26, lastExchangeTime=1488363160500, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=26, servers=26, clients=0, CPUs=1056, heap=410.0GB] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=18, minorTopVer=0], evt=NODE_JOINED, node=47c1a0d8-9d4d-4d0d-9b27-388bd7f49278] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=19, minorTopVer=0], evt=NODE_JOINED, node=e87f12ce-5981-4418-8468-f6bfed0a0cd8] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=479b18e6-54af-4313-85f7-c7525f6229a4, addrs=[, 127.0.0.1], sockAddrs=[hostName/:47500, /127.0.0.1:47500], discPort=47500, order=27, intOrder=27, lastExchangeTime=1488363160530, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=27, servers=27, clients=0, CPUs=1104, heap=430.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=20, minorTopVer=0], evt=NODE_JOINED, node=e2cba212-89dd-48dd-8d7e-821b5725fe03] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=058a99e8-3b65-4ec9-84b0-6f3502c2afce, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=28, intOrder=28, lastExchangeTime=1488363160671, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=28, servers=28, clients=0, CPUs=1144, heap=440.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=21, minorTopVer=0], evt=NODE_JOINED, node=f9ce8dd7-2060-4c34-b597-d7bee86ebedb] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=57c09d88-a4dc-4179-98b4-1144fd97d8cc, addrs=[35, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/35:47500], discPort=47500, order=29, intOrder=29, lastExchangeTime=1488363160691, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=29, servers=29, clients=0, CPUs=1192, heap=460.0GB] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=58298821-7aa9-4b58-ba15-e7f1ef2830fb, addrs=[3, 127.0.0.1], sockAddrs=[hostName/3:47500, /127.0.0.1:47500], discPort=47500, order=30, intOrder=30, lastExchangeTime=1488363160702, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=30, servers=30, clients=0, CPUs=1232, heap=470.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=22, minorTopVer=0], evt=NODE_JOINED, node=6b1889dd-9de5-4f1b-8ec9-c123c7df8ea2] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4d5de2f3-d975-4b28-b593-0cc0481cdc74, addrs=[03, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/03:47500], discPort=47500, order=31, intOrder=31, lastExchangeTime=1488363160812, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=31, servers=31, clients=0, CPUs=1280, heap=490.0GB] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=fa09caab-f4dc-43b6-ac8b-4a4bae6e7da6, addrs=[01, 127.0.0.1], sockAddrs=[hostName/01:47500, /127.0.0.1:47500], discPort=47500, order=32, intOrder=32, lastExchangeTime=1488363161478, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=32, servers=32, clients=0, CPUs=1320, heap=500.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=23, minorTopVer=0], evt=NODE_JOINED, node=9fb6e583-cea0-4f78-b403-b403a8bc9a0e] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=24, minorTopVer=0], evt=NODE_JOINED, node=20860cae-2881-4311-a3f5-edaa160ef37f] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=af5837f0-25ec-4f3d-a1c1-90c09dc424cb, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=33, intOrder=33, lastExchangeTime=1488363161610, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=33, servers=33, clients=0, CPUs=1360, heap=520.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=25, minorTopVer=0], evt=NODE_JOINED, node=0d675d57-b9b9-4cff-a994-77337d618bbe] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=e9e49d2d-5eeb-474f-8757-e447efc8ca8f, addrs=[6, 127.0.0.1], sockAddrs=[hostName/6:47500, /127.0.0.1:47500], discPort=47500, order=34, intOrder=34, lastExchangeTime=1488363161610, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=34, servers=34, clients=0, CPUs=1400, heap=530.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=26, minorTopVer=0], evt=NODE_JOINED, node=a6343860-6e84-4d9c-9b87-84ffd76280cd] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4b90e5a3-253a-435b-84ca-6b592610cf0c, addrs=[4, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/4:47500], discPort=47500, order=35, intOrder=35, lastExchangeTime=1488363161620, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=35, servers=35, clients=0, CPUs=1432, heap=550.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=27, minorTopVer=0], evt=NODE_JOINED, node=479b18e6-54af-4313-85f7-c7525f6229a4] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=8fd4eea2-2a45-4563-ae87-1848fd388a98, addrs=[3, 127.0.0.1], sockAddrs=[hostName/3:47500, /127.0.0.1:47500], discPort=47500, order=36, intOrder=36, lastExchangeTime=1488363161630, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=36, servers=36, clients=0, CPUs=1472, heap=560.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=28, minorTopVer=0], evt=NODE_JOINED, node=058a99e8-3b65-4ec9-84b0-6f3502c2afce] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=d7b45a02-0411-4028-acdf-f004e592f294, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=37, intOrder=37, lastExchangeTime=1488363161912, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=37, servers=37, clients=0, CPUs=1512, heap=580.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=29, minorTopVer=0], evt=NODE_JOINED, node=57c09d88-a4dc-4179-98b4-1144fd97d8cc] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=cf4e6e83-207e-42da-a55c-5621bc20b891, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=38, intOrder=38, lastExchangeTime=1488363162668, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=38, servers=38, clients=0, CPUs=1552, heap=590.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=30, minorTopVer=0], evt=NODE_JOINED, node=58298821-7aa9-4b58-ba15-e7f1ef2830fb] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=d8926a2c-2c00-4445-beb4-633c2d656c41, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=39, intOrder=39, lastExchangeTime=1488363162678, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=39, servers=39, clients=0, CPUs=1584, heap=610.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=31, minorTopVer=0], evt=NODE_JOINED, node=4d5de2f3-d975-4b28-b593-0cc0481cdc74] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4136a0c9-14d5-42b3-9a60-81689c800438, addrs=[3, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/3:47500], discPort=47500, order=40, intOrder=40, lastExchangeTime=1488363162899, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=40, servers=40, clients=0, CPUs=1624, heap=620.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=32, minorTopVer=0], evt=NODE_JOINED, node=fa09caab-f4dc-43b6-ac8b-4a4bae6e7da6] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=694a80b8-02a3-44c9-a2dd-45bed7d20a50, addrs=[1, 127.0.0.1], sockAddrs=[hostName/1:47500, /127.0.0.1:47500], discPort=47500, order=41, intOrder=41, lastExchangeTime=1488363162920, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=41, servers=41, clients=0, CPUs=1664, heap=640.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=33, minorTopVer=0], evt=NODE_JOINED, node=af5837f0-25ec-4f3d-a1c1-90c09dc424cb] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=34, minorTopVer=0], evt=NODE_JOINED, node=e9e49d2d-5eeb-474f-8757-e447efc8ca8f] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=35, minorTopVer=0], evt=NODE_JOINED, node=4b90e5a3-253a-435b-84ca-6b592610cf0c] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=36, minorTopVer=0], evt=NODE_JOINED, node=8fd4eea2-2a45-4563-ae87-1848fd388a98] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=37, minorTopVer=0], evt=NODE_JOINED, node=d7b45a02-0411-4028-acdf-f004e592f294] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=38, minorTopVer=0], evt=NODE_JOINED, node=cf4e6e83-207e-42da-a55c-5621bc20b891] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=39, minorTopVer=0], evt=NODE_JOINED, node=d8926a2c-2c00-4445-beb4-633c2d656c41] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=40, minorTopVer=0], evt=NODE_JOINED, node=4136a0c9-14d5-42b3-9a60-81689c800438] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-sys-cache, waitList=[]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-marshaller-sys-cache, waitList=[]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-atomics-sys-cache, waitList=[ignite-sys-cache, ignite-marshaller-sys-cache]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=WCAIgniteCache, waitList=[ignite-sys-cache, ignite-marshaller-sys-cache, ignite-atomics-sys-cache]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Rebalancing required [top=AffinityTopologyVersion [topVer=41, minorTopVer=0], evt=NODE_JOINED, node=694a80b8-02a3-44c9-a2dd-45bed7d20a50] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-marshaller-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=20, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=32] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=100, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=32] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-marshaller-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=20 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=20 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-atomics-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=26, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=32] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-atomics-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=0 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=WCAIgniteCache, mode=ASYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=26, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=32] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=WCAIgniteCache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=0 ms] 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: >>> +----------------------------------------------------------------------+ >>> Ignite ver. 1.8.0#20161205-sha1:9ca40dbeb7d559fcb299bdb6f5c90cdf8ce7e533 >>> +----------------------------------------------------------------------+ >>> OS name: Linux 2.6.32-431.5.1.el6.x86_64 amd64 >>> CPU(s): 40 >>> Heap: 15.0GB >>> VM name: 38562@hostName >>> Grid name: WCA >>> Local node [ID=717DE453-FC6B-4A46-91B2-B5C54AB8A4BE, order=10, clientMode=false] >>> Local node addresses: [hostName/2, /127.0.0.1] >>> Local ports: TCP:11211 TCP:47100 TCP:47500 TCP:48100 17/03/01 04:12:47 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=10, servers=10, clients=0, CPUs=432, heap=170.0GB] 17/03/01 04:12:47 INFO resolver.CompanyResolverSparkTest: Started ignite node on executor 17/03/01 04:12:47 INFO executor.Executor: Finished task 32.0 in stage 4.0 (TID 154). 931 bytes result sent to driver 17/03/01 04:12:49 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=41, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, node=6172ee3a-eb33-4bf5-9080-c255f52caed8] 17/03/01 04:13:47 INFO internal.IgniteKernal%WCA: Metrics for local node (to disable set 'metricsLogFrequency' to 0) ^-- Node [id=717de453, name=WCA, uptime=00:01:00:005] ^-- H/N/C [hosts=41, nodes=41, CPUs=1664] ^-- CPU [cur=2.17%, avg=2.97%, GC=0%] ^-- Heap [used=3893MB, free=74.05%, comm=15003MB] ^-- Non heap [used=118MB, free=-1%, comm=120MB] ^-- Public thread pool [active=0, idle=0, qSize=0] ^-- System thread pool [active=0, idle=80, qSize=0] ^-- Outbound messages queue [size=0] 17/03/01 04:13:50 INFO cluster.GridUpdateNotifier: Update status is not available. 17/03/01 04:14:00 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 256 17/03/01 04:14:00 INFO executor.Executor: Running task 12.0 in stage 7.0 (TID 256) 17/03/01 04:14:00 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 131 17/03/01 04:14:00 INFO storage.MemoryStore: ensureFreeSpace(2732) called with curMem=0, maxMem=8334920908 17/03/01 04:14:00 INFO storage.MemoryStore: Block broadcast_131_piece0 stored as bytes in memory (estimated size 2.7 KB, free 7.8 GB) 17/03/01 04:14:00 INFO broadcast.TorrentBroadcast: Reading broadcast variable 131 took 17 ms 17/03/01 04:14:00 INFO storage.MemoryStore: ensureFreeSpace(7336) called with curMem=2732, maxMem=8334920908 17/03/01 04:14:00 INFO storage.MemoryStore: Block broadcast_131 stored as values in memory (estimated size 7.2 KB, free 7.8 GB) 17/03/01 04:14:00 INFO dao.CompanyDAO: testing[ipaddress:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509] 17/03/01 04:14:00 INFO dao.CompanyDAO: input company name inside Contains searchSEWELL OIL 17/03/01 04:14:10 ERROR executor.Executor: Exception in task 12.0 in stage 7.0 (TID 256) javax.cache.CacheException: class org.apache.ignite.IgniteCheckedException: Query execution failed: GridCacheQueryBean [qry=GridCacheQueryAdapter [type=TEXT, clsName=CompanyVO1, clause=SEWELL OIL, filter=null, transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=true, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=717de453-fc6b-4a46-91b2-b5c54ab8a4be, taskHash=0], rdc=null, trans=null] at org.apache.ignite.internal.processors.cache.GridCacheUtils.convertToCacheException(GridCacheUtils.java:1440) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.next(GridCacheQueryFutureAdapter.java:174) at org.apache.ignite.internal.processors.cache.IgniteCacheProxy$5.onHasNext(IgniteCacheProxy.java:600) at org.apache.ignite.internal.util.GridCloseableIteratorAdapter.hasNextX(GridCloseableIteratorAdapter.java:53) at org.apache.ignite.internal.util.lang.GridIteratorAdapter.hasNext(GridIteratorAdapter.java:45) at un.api.resolver.dao.CompanyDAO.getVarCompContains(CompanyDAO.scala:242) at un.api.resolver.accessor.CompanyAccessor.getVarCompContains(CompanyAccessor.scala:27) at un.api.resolver.CompanyResolverSparkTest$$anonfun$main$7.apply(CompanyResolverSparkTest.scala:291) at un.api.resolver.CompanyResolverSparkTest$$anonfun$main$7.apply(CompanyResolverSparkTest.scala:289) at scala.collection.Iterator$$anon$11.next(Iterator.scala:328) at org.apache.spark.util.Utils$.getIteratorSize(Utils.scala:1554) at org.apache.spark.rdd.RDD$$anonfun$count$1.apply(RDD.scala:1121) at org.apache.spark.rdd.RDD$$anonfun$count$1.apply(RDD.scala:1121) at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1850) at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1850) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:66) at org.apache.spark.scheduler.Task.run(Task.scala:88) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:214) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: class org.apache.ignite.IgniteCheckedException: Query execution failed: GridCacheQueryBean [qry=GridCacheQueryAdapter [type=TEXT, clsName=CompanyVO1, clause=SEWELL OIL, filter=null, transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=true, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=717de453-fc6b-4a46-91b2-b5c54ab8a4be, taskHash=0], rdc=null, trans=null] at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.checkError(GridCacheQueryFutureAdapter.java:260) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.internalIterator(GridCacheQueryFutureAdapter.java:318) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.next(GridCacheQueryFutureAdapter.java:164) ... 19 more Caused by: class org.apache.ignite.IgniteCheckedException: Failed to execute query on node [query=GridCacheQueryBean [qry=GridCacheQueryAdapter [type=TEXT, clsName=CompanyVO1, clause=SEWELL OIL, filter=null, transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=true, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=717de453-fc6b-4a46-91b2-b5c54ab8a4be, taskHash=0], rdc=null, trans=null], nodeId=23f61699-e2c9-4ff6-8731-2483934e84c4] at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.onPage(GridCacheQueryFutureAdapter.java:383) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.processQueryResponse(GridCacheDistributedQueryManager.java:398) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.access$000(GridCacheDistributedQueryManager.java:63) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$1.apply(GridCacheDistributedQueryManager.java:93) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$1.apply(GridCacheDistributedQueryManager.java:91) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.processMessage(GridCacheIoManager.java:827) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.onMessage0(GridCacheIoManager.java:369) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.access$400(GridCacheIoManager.java:95) at org.apache.ignite.internal.processors.cache.GridCacheIoManager$OrderedMessageListener.onMessage(GridCacheIoManager.java:1345) at org.apache.ignite.internal.managers.communication.GridIoManager.invokeListener(GridIoManager.java:1082) at org.apache.ignite.internal.managers.communication.GridIoManager.access$1600(GridIoManager.java:102) at org.apache.ignite.internal.managers.communication.GridIoManager$GridCommunicationMessageSet.unwind(GridIoManager.java:2332) at org.apache.ignite.internal.managers.communication.GridIoManager.unwindMessageSet(GridIoManager.java:1042) at org.apache.ignite.internal.managers.communication.GridIoManager.access$1900(GridIoManager.java:102) at org.apache.ignite.internal.managers.communication.GridIoManager$6.run(GridIoManager.java:1011) ... 3 more Caused by: java.lang.NullPointerException at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneFile.numBuffers(GridLuceneFile.java:109) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneInputStream.switchCurrentBuffer(GridLuceneInputStream.java:132) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneInputStream.seek(GridLuceneInputStream.java:224) at org.apache.lucene.index.CompoundFileReader$CSIndexInput.readInternal(CompoundFileReader.java:273) at org.apache.lucene.store.BufferedIndexInput.refill(BufferedIndexInput.java:229) at org.apache.lucene.store.BufferedIndexInput.readByte(BufferedIndexInput.java:39) at org.apache.lucene.store.DataInput.readInt(DataInput.java:84) at org.apache.lucene.store.BufferedIndexInput.readInt(BufferedIndexInput.java:169) at org.apache.lucene.store.DataInput.readLong(DataInput.java:126) at org.apache.lucene.store.BufferedIndexInput.readLong(BufferedIndexInput.java:182) at org.apache.lucene.index.FieldsReader.doc(FieldsReader.java:231) at org.apache.lucene.index.SegmentReader.document(SegmentReader.java:477) at org.apache.lucene.index.DirectoryReader.document(DirectoryReader.java:583) at org.apache.lucene.index.IndexReader.document(IndexReader.java:1115) at org.apache.lucene.search.IndexSearcher.doc(IndexSearcher.java:258) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneIndex$It.findNext(GridLuceneIndex.java:383) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneIndex$It.onNext(GridLuceneIndex.java:415) at org.apache.ignite.internal.processors.query.h2.opt.GridLuceneIndex$It.onNext(GridLuceneIndex.java:299) at org.apache.ignite.internal.util.GridCloseableIteratorAdapter.nextX(GridCloseableIteratorAdapter.java:41) at org.apache.ignite.internal.util.lang.GridIteratorAdapter.next(GridIteratorAdapter.java:35) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryManager.runQuery(GridCacheQueryManager.java:1512) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.processQueryRequest(GridCacheDistributedQueryManager.java:230) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$2.apply(GridCacheDistributedQueryManager.java:108) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$2.apply(GridCacheDistributedQueryManager.java:106) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.processMessage(GridCacheIoManager.java:827) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.onMessage0(GridCacheIoManager.java:369) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.handleMessage(GridCacheIoManager.java:293) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.access$000(GridCacheIoManager.java:95) at org.apache.ignite.internal.processors.cache.GridCacheIoManager$1.onMessage(GridCacheIoManager.java:238) at org.apache.ignite.internal.managers.communication.GridIoManager.invokeListener(GridIoManager.java:1082) at org.apache.ignite.internal.managers.communication.GridIoManager.processRegularMessage0(GridIoManager.java:710) at org.apache.ignite.internal.managers.communication.GridIoManager.access$1700(GridIoManager.java:102) at org.apache.ignite.internal.managers.communication.GridIoManager$5.run(GridIoManager.java:673) ... 3 more 17/03/01 04:14:10 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 287 17/03/01 04:14:10 INFO executor.Executor: Running task 12.1 in stage 7.0 (TID 287) 17/03/01 04:14:17 INFO executor.Executor: Finished task 12.1 in stage 7.0 (TID 287). 969 bytes result sent to driver 17/03/01 04:14:47 INFO internal.IgniteKernal%WCA: Metrics for local node (to disable set 'metricsLogFrequency' to 0) ^-- Node [id=717de453, name=WCA, uptime=00:02:00:040] ^-- H/N/C [hosts=41, nodes=41, CPUs=1664] ^-- CPU [cur=0.17%, avg=2.96%, GC=0%] ^-- Heap [used=2111MB, free=85.54%, comm=14606MB] ^-- Non heap [used=123MB, free=-1%, comm=124MB] ^-- Public thread pool [active=0, idle=0, qSize=0] ^-- System thread pool [active=0, idle=80, qSize=0] ^-- Outbound messages queue [size=0] 17/03/01 04:14:49 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 342 17/03/01 04:14:49 INFO executor.Executor: Running task 29.0 in stage 8.0 (TID 342) 17/03/01 04:14:49 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 132 17/03/01 04:14:49 INFO storage.MemoryStore: ensureFreeSpace(887) called with curMem=10068, maxMem=8334920908 17/03/01 04:14:49 INFO storage.MemoryStore: Block broadcast_132_piece0 stored as bytes in memory (estimated size 887.0 B, free 7.8 GB) 17/03/01 04:14:49 INFO broadcast.TorrentBroadcast: Reading broadcast variable 132 took 76 ms 17/03/01 04:14:49 INFO storage.MemoryStore: ensureFreeSpace(1216) called with curMem=10955, maxMem=8334920908 17/03/01 04:14:49 INFO storage.MemoryStore: Block broadcast_132 stored as values in memory (estimated size 1216.0 B, free 7.8 GB) 17/03/01 04:14:49 INFO tcp.GridTcpRestProtocol: Command protocol successfully stopped: TCP binary 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=4136a0c9-14d5-42b3-9a60-81689c800438, addrs=[3, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/3:47500], discPort=47500, order=40, intOrder=40, lastExchangeTime=1488363162899, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=42, servers=40, clients=0, CPUs=1624, heap=620.0GB] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=cf4e6e83-207e-42da-a55c-5621bc20b891, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=38, intOrder=38, lastExchangeTime=1488363162668, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=43, servers=39, clients=0, CPUs=1584, heap=610.0GB] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=d8926a2c-2c00-4445-beb4-633c2d656c41, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=39, intOrder=39, lastExchangeTime=1488363162678, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=44, servers=38, clients=0, CPUs=1552, heap=590.0GB] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=e9e49d2d-5eeb-474f-8757-e447efc8ca8f, addrs=[6, 127.0.0.1], sockAddrs=[hostName/6:47500, /127.0.0.1:47500], discPort=47500, order=34, intOrder=34, lastExchangeTime=1488363161610, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=45, servers=37, clients=0, CPUs=1512, heap=580.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=57c09d88-a4dc-4179-98b4-1144fd97d8cc, addrs=[35, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/35:47500], discPort=47500, order=29, intOrder=29, lastExchangeTime=1488363160691, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=46, servers=36, clients=0, CPUs=1464, heap=560.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=0d675d57-b9b9-4cff-a994-77337d618bbe, addrs=[4, 127.0.0.1], sockAddrs=[hostName/4:47500, /127.0.0.1:47500], discPort=47500, order=25, intOrder=25, lastExchangeTime=1488363160500, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=47, servers=35, clients=0, CPUs=1424, heap=550.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=a6343860-6e84-4d9c-9b87-84ffd76280cd, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=26, intOrder=26, lastExchangeTime=1488363160500, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=48, servers=34, clients=0, CPUs=1384, heap=530.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=9fb6e583-cea0-4f78-b403-b403a8bc9a0e, addrs=[7, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/7:47500], discPort=47500, order=23, intOrder=23, lastExchangeTime=1488363160490, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=49, servers=33, clients=0, CPUs=1344, heap=520.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=23f61699-e2c9-4ff6-8731-2483934e84c4, addrs=[0, 127.0.0.1], sockAddrs=[hostName/0:47500, /127.0.0.1:47500], discPort=47500, order=14, intOrder=14, lastExchangeTime=1488363160419, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=50, servers=32, clients=0, CPUs=1304, heap=500.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=ddc47224-d030-4d1f-ba66-08f61368a395, addrs=[4, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/4:47500], discPort=47500, order=17, intOrder=17, lastExchangeTime=1488363160439, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=51, servers=31, clients=0, CPUs=1264, heap=490.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=e87f12ce-5981-4418-8468-f6bfed0a0cd8, addrs=[6, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/6:47500], discPort=47500, order=19, intOrder=19, lastExchangeTime=1488363160449, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=52, servers=30, clients=0, CPUs=1224, heap=470.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=40d089f0-7c80-4f1f-8659-350791f57a4c, addrs=[37, 127.0.0.1], sockAddrs=[hostName/37:47500, /127.0.0.1:47500], discPort=47500, order=4, intOrder=4, lastExchangeTime=1488363160379, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=53, servers=29, clients=0, CPUs=1176, heap=460.0GB] 17/03/01 04:14:51 WARN tcp.TcpDiscoverySpi: Failed to ping node (status check will be initiated): 8fd4eea2-2a45-4563-ae87-1848fd388a98 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=29716cf1-ed55-4550-82bd-cf980a0aee2c, addrs=[, 127.0.0.1], sockAddrs=[hostName/:47501, /127.0.0.1:47501], discPort=47501, order=9, intOrder=9, lastExchangeTime=1488363160379, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=54, servers=28, clients=0, CPUs=1136, heap=440.0GB] 17/03/01 04:14:52 INFO cache.GridCacheProcessor: Stopped cache: ignite-marshaller-sys-cache 17/03/01 04:14:52 INFO cache.GridCacheProcessor: Stopped cache: ignite-sys-cache 17/03/01 04:14:52 INFO cache.GridCacheProcessor: Stopped cache: ignite-atomics-sys-cache 17/03/01 04:14:52 INFO cache.GridCacheProcessor: Stopped cache: WCAIgniteCache 17/03/01 04:14:53 INFO internal.IgniteKernal%WCA: >>> +---------------------------------------------------------------------------------+ >>> Ignite ver. 1.8.0#20161205-sha1:9ca40dbeb7d559fcb299bdb6f5c90cdf8ce7e533 stopped OK >>> +---------------------------------------------------------------------------------+ >>> Grid name: WCA >>> Grid uptime: 00:02:05:558 17/03/01 04:14:53 INFO executor.Executor: Finished task 29.0 in stage 8.0 (TID 342). 931 bytes result sent to driver 17/03/01 04:14:53 INFO executor.CoarseGrainedExecutorBackend: Driver commanded a shutdown 17/03/01 04:14:53 INFO storage.MemoryStore: MemoryStore cleared 17/03/01 04:14:53 INFO storage.BlockManager: BlockManager stopped 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Shutting down remote daemon. 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remote daemon shut down; proceeding with flushing remote transports. 17/03/01 04:14:53 INFO Remoting: Remoting shut down 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remoting shut down. 17/03/01 04:14:53 INFO util.ShutdownHookManager: Shutdown hook called LogType:stdout Log Upload Time:Wed Mar 01 04:14:58 -0600 2017 LogLength:4916 Log Contents: rEnd of the programe - [04:12:38] __________ ________________ [04:12:38] / _/ ___/ |/ / _/_ __/ __/ [04:12:38] _/ // (7 7 // / / / / _/ [04:12:38] /___/\___/_/|_/___/ /_/ /___/ [04:12:38] [04:12:38] ver. 1.8.0#20161205-sha1:9ca40dbe [04:12:38] 2016 Copyright(C) Apache Software Foundation [04:12:38] [04:12:38] Ignite documentation: http://ignite.apache.org [04:12:38] [04:12:38] Quiet mode. [04:12:38] ^-- To see **FULL** console log here add -DIGNITE_QUIET=false or "-v" to ignite.{sh|bat} [04:12:38] [04:12:38] OS: Linux 2.6.32-431.5.1.el6.x86_64 amd64 [04:12:38] VM information: Java(TM) SE Runtime Environment 1.8.0_60-b27 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.60-b23 [04:12:38] Configured plugins: [04:12:38] ^-- None [04:12:38] [04:12:38] Security status [authentication=off, tls/ssl=off] [04:12:40] Topology snapshot [ver=11, servers=11, clients=0, CPUs=472, heap=190.0GB] [04:12:40] Topology snapshot [ver=12, servers=12, clients=0, CPUs=504, heap=200.0GB] [04:12:40] Topology snapshot [ver=13, servers=13, clients=0, CPUs=544, heap=220.0GB] [04:12:40] Topology snapshot [ver=14, servers=14, clients=0, CPUs=584, heap=230.0GB] [04:12:41] Topology snapshot [ver=15, servers=15, clients=0, CPUs=624, heap=250.0GB] [04:12:41] Topology snapshot [ver=16, servers=16, clients=0, CPUs=664, heap=260.0GB] [04:12:41] Topology snapshot [ver=17, servers=17, clients=0, CPUs=704, heap=280.0GB] [04:12:41] Topology snapshot [ver=18, servers=18, clients=0, CPUs=744, heap=290.0GB] [04:12:41] Topology snapshot [ver=19, servers=19, clients=0, CPUs=784, heap=310.0GB] [04:12:41] Topology snapshot [ver=20, servers=20, clients=0, CPUs=816, heap=320.0GB] [04:12:41] Topology snapshot [ver=21, servers=21, clients=0, CPUs=856, heap=340.0GB] [04:12:42] Topology snapshot [ver=22, servers=22, clients=0, CPUs=896, heap=350.0GB] [04:12:42] Topology snapshot [ver=23, servers=23, clients=0, CPUs=936, heap=370.0GB] [04:12:42] Topology snapshot [ver=24, servers=24, clients=0, CPUs=976, heap=380.0GB] [04:12:42] Topology snapshot [ver=25, servers=25, clients=0, CPUs=1016, heap=400.0GB] [04:12:42] Topology snapshot [ver=26, servers=26, clients=0, CPUs=1056, heap=410.0GB] [04:12:42] Topology snapshot [ver=27, servers=27, clients=0, CPUs=1104, heap=430.0GB] [04:12:43] Topology snapshot [ver=28, servers=28, clients=0, CPUs=1144, heap=440.0GB] [04:12:43] Topology snapshot [ver=29, servers=29, clients=0, CPUs=1192, heap=460.0GB] [04:12:43] Topology snapshot [ver=30, servers=30, clients=0, CPUs=1232, heap=470.0GB] [04:12:43] Topology snapshot [ver=31, servers=31, clients=0, CPUs=1280, heap=490.0GB] [04:12:43] Topology snapshot [ver=32, servers=32, clients=0, CPUs=1320, heap=500.0GB] [04:12:43] Topology snapshot [ver=33, servers=33, clients=0, CPUs=1360, heap=520.0GB] [04:12:44] Topology snapshot [ver=34, servers=34, clients=0, CPUs=1400, heap=530.0GB] [04:12:44] Topology snapshot [ver=35, servers=35, clients=0, CPUs=1432, heap=550.0GB] [04:12:44] Topology snapshot [ver=36, servers=36, clients=0, CPUs=1472, heap=560.0GB] [04:12:44] Topology snapshot [ver=37, servers=37, clients=0, CPUs=1512, heap=580.0GB] [04:12:44] Topology snapshot [ver=38, servers=38, clients=0, CPUs=1552, heap=590.0GB] [04:12:45] Topology snapshot [ver=39, servers=39, clients=0, CPUs=1584, heap=610.0GB] [04:12:45] Topology snapshot [ver=40, servers=40, clients=0, CPUs=1624, heap=620.0GB] [04:12:45] Topology snapshot [ver=41, servers=41, clients=0, CPUs=1664, heap=640.0GB] [04:12:47] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [04:12:47] [04:12:47] Ignite node started OK (id=717de453, grid=WCA) [04:12:47] Topology snapshot [ver=10, servers=10, clients=0, CPUs=432, heap=170.0GB] [04:14:49] Topology snapshot [ver=42, servers=40, clients=0, CPUs=1624, heap=620.0GB] [04:14:49] Topology snapshot [ver=43, servers=39, clients=0, CPUs=1584, heap=610.0GB] [04:14:49] Topology snapshot [ver=44, servers=38, clients=0, CPUs=1552, heap=590.0GB] [04:14:49] Topology snapshot [ver=45, servers=37, clients=0, CPUs=1512, heap=580.0GB] [04:14:51] Topology snapshot [ver=46, servers=36, clients=0, CPUs=1464, heap=560.0GB] [04:14:51] Topology snapshot [ver=47, servers=35, clients=0, CPUs=1424, heap=550.0GB] [04:14:51] Topology snapshot [ver=48, servers=34, clients=0, CPUs=1384, heap=530.0GB] [04:14:51] Topology snapshot [ver=49, servers=33, clients=0, CPUs=1344, heap=520.0GB] [04:14:51] Topology snapshot [ver=50, servers=32, clients=0, CPUs=1304, heap=500.0GB] [04:14:51] Topology snapshot [ver=51, servers=31, clients=0, CPUs=1264, heap=490.0GB] [04:14:51] Topology snapshot [ver=52, servers=30, clients=0, CPUs=1224, heap=470.0GB] [04:14:51] Topology snapshot [ver=53, servers=29, clients=0, CPUs=1176, heap=460.0GB] [04:14:51] Topology snapshot [ver=54, servers=28, clients=0, CPUs=1136, heap=440.0GB] [04:14:53] Ignite node stopped OK [name=WCA, uptime=00:02:05:558] Container: container_e76_1487862040010_131981_01_000008 on hostName_8041 =========================================================================================== LogType:stderr Log Upload Time:Wed Mar 01 04:14:58 -0600 2017 LogLength:49288 Log Contents: 17/03/01 04:10:59 INFO executor.CoarseGrainedExecutorBackend: Registered signal handlers for [TERM, HUP, INT] 17/03/01 04:10:59 INFO spark.SecurityManager: Changing view acls to: userName 17/03/01 04:10:59 INFO spark.SecurityManager: Changing modify acls to: userName 17/03/01 04:10:59 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(userName); users with modify permissions: Set(userName) 17/03/01 04:11:00 INFO slf4j.Slf4jLogger: Slf4jLogger started 17/03/01 04:11:00 INFO Remoting: Starting remoting 17/03/01 04:11:00 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://driverPropsFetcher@hostName:50503] 17/03/01 04:11:00 INFO Remoting: Remoting now listens on addresses: [akka.tcp://driverPropsFetcher@hostName:50503] 17/03/01 04:11:00 INFO util.Utils: Successfully started service 'driverPropsFetcher' on port 50503. 17/03/01 04:11:00 INFO spark.SecurityManager: Changing view acls to: userName 17/03/01 04:11:00 INFO spark.SecurityManager: Changing modify acls to: userName 17/03/01 04:11:00 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(userName); users with modify permissions: Set(userName) 17/03/01 04:11:00 INFO remote.RemoteActorRefProvider$RemotingTerminator: Shutting down remote daemon. 17/03/01 04:11:00 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remote daemon shut down; proceeding with flushing remote transports. 17/03/01 04:11:00 INFO Remoting: Remoting shut down 17/03/01 04:11:00 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remoting shut down. 17/03/01 04:11:00 INFO slf4j.Slf4jLogger: Slf4jLogger started 17/03/01 04:11:00 INFO Remoting: Starting remoting 17/03/01 04:11:00 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://sparkExecutor@hostName:52829] 17/03/01 04:11:00 INFO Remoting: Remoting now listens on addresses: [akka.tcp://sparkExecutor@hostName:52829] 17/03/01 04:11:00 INFO util.Utils: Successfully started service 'sparkExecutor' on port 52829. 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/1/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-3ee32324-7ee3-479e-aac3-9bc5b0cf3790 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/2/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-eba3a34a-9c21-46d1-af3c-1c829e20ce9d 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/3/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-9deeca51-28a9-4a2f-83fd-583bcb9e3c34 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/4/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-6d726043-1d87-4fb0-ac03-419fa8c46ff8 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/5/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-797507b2-2e94-4000-868e-2c1a364404dd 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/6/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-78e8bf1d-3f1b-4797-9c99-8aca5e82481f 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/7/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-b2dfab51-4565-4861-a0ae-61f7655f36a2 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/8/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-61161ccb-8cda-41e4-af36-9fc8ee9eec3b 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/9/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-4851f553-e1fa-4c83-aa4f-aaead8e09efe 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/10/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-d1311aba-adc5-4551-b141-691b8e47e60e 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/11/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-3160c2e0-3278-4b95-804d-4cfc8f92e2f9 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/12/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-cf498d27-8cd4-403d-91e8-5129da209451 17/03/01 04:11:00 INFO storage.MemoryStore: MemoryStore started with capacity 7.8 GB 17/03/01 04:11:00 INFO executor.CoarseGrainedExecutorBackend: Connecting to driver: akka.tcp://sparkDriver@ipaddress:38995/user/CoarseGrainedScheduler 17/03/01 04:11:00 INFO executor.CoarseGrainedExecutorBackend: Successfully registered with driver 17/03/01 04:11:00 INFO executor.Executor: Starting executor ID 5 on host hostName 17/03/01 04:11:00 INFO util.Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 49289. 17/03/01 04:11:00 INFO netty.NettyBlockTransferService: Server created on 49289 17/03/01 04:11:00 INFO storage.BlockManagerMaster: Trying to register BlockManager 17/03/01 04:11:01 INFO storage.BlockManagerMaster: Registered BlockManager 17/03/01 04:11:02 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 25 17/03/01 04:11:02 INFO executor.Executor: Running task 25.0 in stage 0.0 (TID 25) 17/03/01 04:11:02 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 0 17/03/01 04:11:02 INFO storage.MemoryStore: ensureFreeSpace(1310) called with curMem=0, maxMem=8334920908 17/03/01 04:11:02 INFO storage.MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 1310.0 B, free 7.8 GB) 17/03/01 04:11:02 INFO broadcast.TorrentBroadcast: Reading broadcast variable 0 took 240 ms 17/03/01 04:11:02 INFO storage.MemoryStore: ensureFreeSpace(2064) called with curMem=1310, maxMem=8334920908 17/03/01 04:11:02 INFO storage.MemoryStore: Block broadcast_0 stored as values in memory (estimated size 2.0 KB, free 7.8 GB) 17/03/01 04:11:02 INFO resolver.CompanyResolverSparkTest: Ranjit exec test 17/03/01 04:11:02 INFO executor.Executor: Finished task 25.0 in stage 0.0 (TID 25). 972 bytes result sent to driver 17/03/01 04:11:02 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 38 17/03/01 04:11:02 INFO executor.Executor: Running task 38.0 in stage 0.0 (TID 38) 17/03/01 04:11:02 INFO resolver.CompanyResolverSparkTest: Ranjit exec test 17/03/01 04:11:02 INFO executor.Executor: Finished task 38.0 in stage 0.0 (TID 38). 972 bytes result sent to driver 17/03/01 04:12:16 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 74 17/03/01 04:12:16 INFO executor.Executor: Running task 22.0 in stage 2.0 (TID 74) 17/03/01 04:12:16 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 84 17/03/01 04:12:16 INFO storage.MemoryStore: ensureFreeSpace(9240) called with curMem=3374, maxMem=8334920908 17/03/01 04:12:16 INFO storage.MemoryStore: Block broadcast_84_piece0 stored as bytes in memory (estimated size 9.0 KB, free 7.8 GB) 17/03/01 04:12:16 INFO broadcast.TorrentBroadcast: Reading broadcast variable 84 took 42 ms 17/03/01 04:12:16 INFO storage.MemoryStore: ensureFreeSpace(32704) called with curMem=12614, maxMem=8334920908 17/03/01 04:12:16 INFO storage.MemoryStore: Block broadcast_84 stored as values in memory (estimated size 31.9 KB, free 7.8 GB) 17/03/01 04:12:17 INFO codegen.GenerateMutableProjection: Code generated in 93.126032 ms 17/03/01 04:12:17 INFO codegen.GenerateUnsafeProjection: Code generated in 8.818984 ms 17/03/01 04:12:17 INFO codegen.GenerateMutableProjection: Code generated in 12.346003 ms 17/03/01 04:12:17 INFO codegen.GenerateUnsafeRowJoiner: Code generated in 7.09942 ms 17/03/01 04:12:17 INFO codegen.GenerateUnsafeProjection: Code generated in 7.308695 ms 17/03/01 04:12:17 INFO rdd.HadoopRDD: Input split: avro path/part-r-00022-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:0+32180181 17/03/01 04:12:17 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 55 17/03/01 04:12:17 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=45318, maxMem=8334920908 17/03/01 04:12:17 INFO storage.MemoryStore: Block broadcast_55_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:12:17 INFO broadcast.TorrentBroadcast: Reading broadcast variable 55 took 9 ms 17/03/01 04:12:17 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=69961, maxMem=8334920908 17/03/01 04:12:17 INFO storage.MemoryStore: Block broadcast_55 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:12:18 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 17/03/01 04:12:18 INFO Configuration.deprecation: mapred.tip.id is deprecated. Instead, use mapreduce.task.id 17/03/01 04:12:18 INFO Configuration.deprecation: mapred.task.id is deprecated. Instead, use mapreduce.task.attempt.id 17/03/01 04:12:18 INFO Configuration.deprecation: mapred.task.is.map is deprecated. Instead, use mapreduce.task.ismap 17/03/01 04:12:18 INFO Configuration.deprecation: mapred.task.partition is deprecated. Instead, use mapreduce.task.partition 17/03/01 04:12:18 INFO Configuration.deprecation: mapred.job.id is deprecated. Instead, use mapreduce.job.id 17/03/01 04:12:18 WARN security.UserGroupInformation: PriviledgedActionException as:userName (auth:SIMPLE) cause:org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:12:18 WARN ipc.Client: Exception encountered while connecting to the server : org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:12:18 WARN security.UserGroupInformation: PriviledgedActionException as:userName (auth:SIMPLE) cause:org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:12:20 INFO executor.Executor: Finished task 22.0 in stage 2.0 (TID 74). 2494 bytes result sent to driver 17/03/01 04:12:38 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 121 17/03/01 04:12:38 INFO executor.Executor: Running task 0.0 in stage 3.0 (TID 121) 17/03/01 04:12:38 INFO spark.MapOutputTrackerWorker: Updating epoch to 1 and clearing cache 17/03/01 04:12:38 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 85 17/03/01 04:12:38 INFO storage.MemoryStore: ensureFreeSpace(9776) called with curMem=417033, maxMem=8334920908 17/03/01 04:12:38 INFO storage.MemoryStore: Block broadcast_85_piece0 stored as bytes in memory (estimated size 9.5 KB, free 7.8 GB) 17/03/01 04:12:38 INFO broadcast.TorrentBroadcast: Reading broadcast variable 85 took 8 ms 17/03/01 04:12:38 INFO storage.MemoryStore: ensureFreeSpace(33328) called with curMem=426809, maxMem=8334920908 17/03/01 04:12:38 INFO storage.MemoryStore: Block broadcast_85 stored as values in memory (estimated size 32.5 KB, free 7.8 GB) 17/03/01 04:12:38 INFO codegen.GenerateMutableProjection: Code generated in 8.820299 ms 17/03/01 04:12:38 INFO codegen.GenerateUnsafeProjection: Code generated in 8.341552 ms 17/03/01 04:12:38 INFO spark.MapOutputTrackerWorker: Don't have map outputs for shuffle 0, fetching them 17/03/01 04:12:38 INFO spark.MapOutputTrackerWorker: Doing the fetch; tracker endpoint = AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@ipaddress:38995/user/MapOutputTracker#-116120939]) 17/03/01 04:12:38 INFO spark.MapOutputTrackerWorker: Got the output locations 17/03/01 04:12:38 INFO storage.ShuffleBlockFetcherIterator: Getting 80 non-empty blocks out of 80 blocks 17/03/01 04:12:38 INFO storage.ShuffleBlockFetcherIterator: Started 30 remote fetches in 86 ms 17/03/01 04:12:38 INFO executor.Executor: Finished task 0.0 in stage 3.0 (TID 121). 2468 bytes result sent to driver 17/03/01 04:12:38 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 153 17/03/01 04:12:38 INFO executor.Executor: Running task 31.0 in stage 4.0 (TID 153) 17/03/01 04:12:38 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 86 17/03/01 04:12:38 INFO storage.MemoryStore: ensureFreeSpace(2290) called with curMem=460137, maxMem=8334920908 17/03/01 04:12:38 INFO storage.MemoryStore: Block broadcast_86_piece0 stored as bytes in memory (estimated size 2.2 KB, free 7.8 GB) 17/03/01 04:12:38 INFO broadcast.TorrentBroadcast: Reading broadcast variable 86 took 6 ms 17/03/01 04:12:38 INFO storage.MemoryStore: ensureFreeSpace(6544) called with curMem=462427, maxMem=8334920908 17/03/01 04:12:38 INFO storage.MemoryStore: Block broadcast_86 stored as values in memory (estimated size 6.4 KB, free 7.8 GB) 17/03/01 04:12:38 INFO resolver.CompanyResolverSparkTest: testing worker[ipaddress:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509] 17/03/01 04:12:38 ERROR : Failed to resolve default logging config file: config/java.util.logging.properties Console logging handler is not configured. 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: >>> __________ ________________ >>> / _/ ___/ |/ / _/_ __/ __/ >>> _/ // (7 7 // / / / / _/ >>> /___/\___/_/|_/___/ /_/ /___/ >>> >>> ver. 1.8.0#20161205-sha1:9ca40dbe >>> 2016 Copyright(C) Apache Software Foundation >>> >>> Ignite documentation: http://ignite.apache.org 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Config URL: n/a 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Daemon mode: off 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: OS: Linux 2.6.32-431.5.1.el6.x86_64 amd64 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: OS user: userName 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: PID: 20993 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Language runtime: Java Platform API Specification ver. 1.8 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM information: Java(TM) SE Runtime Environment 1.8.0_60-b27 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.60-b23 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM total memory: 14.0GB 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Remote Management [restart: off, REST: on, JMX (remote: off)] 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: IGNITE_HOME=null 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM arguments: [-XX:OnOutOfMemoryError=kill %p, -Xms15360m, -Xmx15360m, -Djava.io.tmpdir=/data/5/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/container_e76_1487862040010_131981_01_000008/tmp, -Dspark.driver.port=38995, -Dspark.ui.port=0, -Dspark.yarn.app.container.log.dir=/data/4/yarn/log/container/application_1487862040010_131981/container_e76_1487862040010_131981_01_000008] 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Configured caches ['ignite-marshaller-sys-cache', 'ignite-sys-cache', 'ignite-atomics-sys-cache'] 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: Configured plugins: 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: ^-- None 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: IPC shared memory server endpoint started [port=48100, tokDir=/data/5/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/container_e76_1487862040010_131981_01_000008/tmp/ignite/work/ipc/shmem/8fd4eea2-2a45-4563-ae87-1848fd388a98-20993] 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: Successfully bound shared memory communication to TCP port [port=48100, locHost=0.0.0.0/0.0.0.0] 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: Successfully bound to TCP port [port=47100, locHost=0.0.0.0/0.0.0.0] 17/03/01 04:12:38 WARN noop.NoopCheckpointSpi: Checkpoints are disabled (to enable configure any GridCheckpointSpi implementation) 17/03/01 04:12:38 WARN collision.GridCollisionManager: Collision resolution is disabled (all jobs will be activated upon arrival). 17/03/01 04:12:38 WARN noop.NoopSwapSpaceSpi: Swap space is disabled. To enable use FileSwapSpaceSpi. 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Security status [authentication=off, tls/ssl=off] 17/03/01 04:12:39 INFO tcp.GridTcpRestProtocol: Command protocol successfully started [name=TCP binary, host=0.0.0.0/0.0.0.0, port=11211] 17/03/01 04:12:39 INFO internal.IgniteKernal%WCA: Non-loopback local IPs: 3 17/03/01 04:12:39 INFO internal.IgniteKernal%WCA: Enabled local MACs: 44A8421007BE 17/03/01 04:12:39 INFO tcp.TcpDiscoverySpi: Successfully bound to TCP port [port=47500, localHost=0.0.0.0/0.0.0.0, locNodeId=8fd4eea2-2a45-4563-ae87-1848fd388a98] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=d7b45a02-0411-4028-acdf-f004e592f294, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=37, intOrder=37, lastExchangeTime=1488363164455, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=37, servers=37, clients=0, CPUs=1512, heap=580.0GB] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=cf4e6e83-207e-42da-a55c-5621bc20b891, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=38, intOrder=38, lastExchangeTime=1488363164465, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=38, servers=38, clients=0, CPUs=1552, heap=590.0GB] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=d8926a2c-2c00-4445-beb4-633c2d656c41, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=39, intOrder=39, lastExchangeTime=1488363164476, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=39, servers=39, clients=0, CPUs=1584, heap=610.0GB] 17/03/01 04:12:45 INFO cache.GridCacheProcessor: Started cache [name=ignite-sys-cache, mode=REPLICATED] 17/03/01 04:12:45 INFO cache.GridCacheProcessor: Started cache [name=ignite-atomics-sys-cache, mode=PARTITIONED] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4136a0c9-14d5-42b3-9a60-81689c800438, addrs=[3, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/3:47500], discPort=47500, order=40, intOrder=40, lastExchangeTime=1488363164486, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=40, servers=40, clients=0, CPUs=1624, heap=620.0GB] 17/03/01 04:12:45 INFO cache.GridCacheProcessor: Started cache [name=WCAIgniteCache, mode=PARTITIONED] 17/03/01 04:12:45 INFO cache.GridCacheProcessor: Started cache [name=ignite-marshaller-sys-cache, mode=REPLICATED] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=694a80b8-02a3-44c9-a2dd-45bed7d20a50, addrs=[1, 127.0.0.1], sockAddrs=[hostName/1:47500, /127.0.0.1:47500], discPort=47500, order=41, intOrder=41, lastExchangeTime=1488363164486, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=41, servers=41, clients=0, CPUs=1664, heap=640.0GB] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=36, minorTopVer=0], evt=NODE_JOINED, node=8fd4eea2-2a45-4563-ae87-1848fd388a98] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=37, minorTopVer=0], evt=NODE_JOINED, node=d7b45a02-0411-4028-acdf-f004e592f294] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=38, minorTopVer=0], evt=NODE_JOINED, node=cf4e6e83-207e-42da-a55c-5621bc20b891] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=39, minorTopVer=0], evt=NODE_JOINED, node=d8926a2c-2c00-4445-beb4-633c2d656c41] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=40, minorTopVer=0], evt=NODE_JOINED, node=4136a0c9-14d5-42b3-9a60-81689c800438] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-sys-cache, waitList=[]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-marshaller-sys-cache, waitList=[]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-atomics-sys-cache, waitList=[ignite-sys-cache, ignite-marshaller-sys-cache]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=WCAIgniteCache, waitList=[ignite-sys-cache, ignite-marshaller-sys-cache, ignite-atomics-sys-cache]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Rebalancing required [top=AffinityTopologyVersion [topVer=41, minorTopVer=0], evt=NODE_JOINED, node=694a80b8-02a3-44c9-a2dd-45bed7d20a50] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-marshaller-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=20, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=6] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=100, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=6] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-marshaller-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=20 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=20 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-atomics-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=26, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=6] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-atomics-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=0 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=WCAIgniteCache, mode=ASYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=26, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=6] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=WCAIgniteCache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=0 ms] 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: >>> +----------------------------------------------------------------------+ >>> Ignite ver. 1.8.0#20161205-sha1:9ca40dbeb7d559fcb299bdb6f5c90cdf8ce7e533 >>> +----------------------------------------------------------------------+ >>> OS name: Linux 2.6.32-431.5.1.el6.x86_64 amd64 >>> CPU(s): 40 >>> Heap: 15.0GB >>> VM name: 20993@hostName >>> Grid name: WCA >>> Local node [ID=8FD4EEA2-2A45-4563-AE87-1848FD388A98, order=36, clientMode=false] >>> Local node addresses: [hostName/3, /127.0.0.1] >>> Local ports: TCP:11211 TCP:47100 TCP:47500 TCP:48100 17/03/01 04:12:47 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=36, servers=36, clients=0, CPUs=1472, heap=560.0GB] 17/03/01 04:12:47 INFO resolver.CompanyResolverSparkTest: Started ignite node on executor 17/03/01 04:12:47 INFO executor.Executor: Finished task 31.0 in stage 4.0 (TID 153). 931 bytes result sent to driver 17/03/01 04:12:49 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=41, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, node=6172ee3a-eb33-4bf5-9080-c255f52caed8] 17/03/01 04:13:47 INFO internal.IgniteKernal%WCA: Metrics for local node (to disable set 'metricsLogFrequency' to 0) ^-- Node [id=8fd4eea2, name=WCA, uptime=00:01:00:011] ^-- H/N/C [hosts=41, nodes=41, CPUs=1664] ^-- CPU [cur=5.93%, avg=3.37%, GC=0.23%] ^-- Heap [used=1158MB, free=92.05%, comm=14573MB] ^-- Non heap [used=120MB, free=-1%, comm=122MB] ^-- Public thread pool [active=0, idle=0, qSize=0] ^-- System thread pool [active=0, idle=80, qSize=0] ^-- Outbound messages queue [size=0] 17/03/01 04:13:54 INFO cluster.GridUpdateNotifier: Update status is not available. 17/03/01 04:14:00 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 261 17/03/01 04:14:00 INFO executor.Executor: Running task 17.0 in stage 7.0 (TID 261) 17/03/01 04:14:00 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 131 17/03/01 04:14:00 INFO storage.MemoryStore: ensureFreeSpace(2732) called with curMem=0, maxMem=8334920908 17/03/01 04:14:00 INFO storage.MemoryStore: Block broadcast_131_piece0 stored as bytes in memory (estimated size 2.7 KB, free 7.8 GB) 17/03/01 04:14:00 INFO broadcast.TorrentBroadcast: Reading broadcast variable 131 took 30 ms 17/03/01 04:14:00 INFO storage.MemoryStore: ensureFreeSpace(7336) called with curMem=2732, maxMem=8334920908 17/03/01 04:14:00 INFO storage.MemoryStore: Block broadcast_131 stored as values in memory (estimated size 7.2 KB, free 7.8 GB) 17/03/01 04:14:00 INFO dao.CompanyDAO: testing[ipaddress:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509] 17/03/01 04:14:00 INFO dao.CompanyDAO: input company name inside Contains searchRON CRAFT CHEVROLET CADILLAC OLDSMOBILE GEO 17/03/01 04:14:11 ERROR executor.Executor: Exception in task 17.0 in stage 7.0 (TID 261) javax.cache.CacheException: class org.apache.ignite.IgniteCheckedException: Query execution failed: GridCacheQueryBean [qry=GridCacheQueryAdapter [type=TEXT, clsName=CompanyVO1, clause=RON CRAFT CHEVROLET CADILLAC OLDSMOBILE GEO, filter=null, transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=true, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=8fd4eea2-2a45-4563-ae87-1848fd388a98, taskHash=0], rdc=null, trans=null] at org.apache.ignite.internal.processors.cache.GridCacheUtils.convertToCacheException(GridCacheUtils.java:1440) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.next(GridCacheQueryFutureAdapter.java:174) at org.apache.ignite.internal.processors.cache.IgniteCacheProxy$5.onHasNext(IgniteCacheProxy.java:600) at org.apache.ignite.internal.util.GridCloseableIteratorAdapter.hasNextX(GridCloseableIteratorAdapter.java:53) at org.apache.ignite.internal.util.lang.GridIteratorAdapter.hasNext(GridIteratorAdapter.java:45) at un.api.resolver.dao.CompanyDAO.getVarCompContains(CompanyDAO.scala:242) at un.api.resolver.accessor.CompanyAccessor.getVarCompContains(CompanyAccessor.scala:27) at un.api.resolver.CompanyResolverSparkTest$$anonfun$main$7.apply(CompanyResolverSparkTest.scala:291) at un.api.resolver.CompanyResolverSparkTest$$anonfun$main$7.apply(CompanyResolverSparkTest.scala:289) at scala.collection.Iterator$$anon$11.next(Iterator.scala:328) at org.apache.spark.util.Utils$.getIteratorSize(Utils.scala:1554) at org.apache.spark.rdd.RDD$$anonfun$count$1.apply(RDD.scala:1121) at org.apache.spark.rdd.RDD$$anonfun$count$1.apply(RDD.scala:1121) at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1850) at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1850) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:66) at org.apache.spark.scheduler.Task.run(Task.scala:88) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:214) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: class org.apache.ignite.IgniteCheckedException: Query execution failed: GridCacheQueryBean [qry=GridCacheQueryAdapter [type=TEXT, clsName=CompanyVO1, clause=RON CRAFT CHEVROLET CADILLAC OLDSMOBILE GEO, filter=null, transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=true, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=8fd4eea2-2a45-4563-ae87-1848fd388a98, taskHash=0], rdc=null, trans=null] at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.checkError(GridCacheQueryFutureAdapter.java:260) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.internalIterator(GridCacheQueryFutureAdapter.java:318) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.next(GridCacheQueryFutureAdapter.java:164) ... 19 more Caused by: class org.apache.ignite.IgniteCheckedException: Failed to execute query on node [query=GridCacheQueryBean [qry=GridCacheQueryAdapter [type=TEXT, clsName=CompanyVO1, clause=RON CRAFT CHEVROLET CADILLAC OLDSMOBILE GEO, filter=null, transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=true, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=8fd4eea2-2a45-4563-ae87-1848fd388a98, taskHash=0], rdc=null, trans=null], nodeId=694a80b8-02a3-44c9-a2dd-45bed7d20a50] at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.onPage(GridCacheQueryFutureAdapter.java:383) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.processQueryResponse(GridCacheDistributedQueryManager.java:398) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.access$000(GridCacheDistributedQueryManager.java:63) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$1.apply(GridCacheDistributedQueryManager.java:93) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$1.apply(GridCacheDistributedQueryManager.java:91) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.processMessage(GridCacheIoManager.java:827) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.onMessage0(GridCacheIoManager.java:369) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.access$400(GridCacheIoManager.java:95) at org.apache.ignite.internal.processors.cache.GridCacheIoManager$OrderedMessageListener.onMessage(GridCacheIoManager.java:1345) at org.apache.ignite.internal.managers.communication.GridIoManager.invokeListener(GridIoManager.java:1082) at org.apache.ignite.internal.managers.communication.GridIoManager.access$1600(GridIoManager.java:102) at org.apache.ignite.internal.managers.communication.GridIoManager$GridCommunicationMessageSet.unwind(GridIoManager.java:2332) at org.apache.ignite.internal.managers.communication.GridIoManager.unwindMessageSet(GridIoManager.java:1042) at org.apache.ignite.internal.managers.communication.GridIoManager.access$1900(GridIoManager.java:102) at org.apache.ignite.internal.managers.communication.GridIoManager$6.run(GridIoManager.java:1011) ... 3 more Caused by: java.lang.NullPointerException 17/03/01 04:14:11 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=717de453-fc6b-4a46-91b2-b5c54ab8a4be, res=GridCacheQueryResponse [finished=true, reqId=268, err=null, fields=false, metadata=null]] 17/03/01 04:14:11 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 304 17/03/01 04:14:11 INFO executor.Executor: Running task 17.1 in stage 7.0 (TID 304) 17/03/01 04:14:47 INFO internal.IgniteKernal%WCA: Metrics for local node (to disable set 'metricsLogFrequency' to 0) ^-- Node [id=8fd4eea2, name=WCA, uptime=00:02:00:181] ^-- H/N/C [hosts=41, nodes=41, CPUs=1664] ^-- CPU [cur=38.8%, avg=4.77%, GC=2.13%] ^-- Heap [used=5001MB, free=63.96%, comm=13876MB] ^-- Non heap [used=126MB, free=-1%, comm=128MB] ^-- Public thread pool [active=0, idle=0, qSize=0] ^-- System thread pool [active=0, idle=80, qSize=0] ^-- Outbound messages queue [size=0] 17/03/01 04:14:49 INFO executor.Executor: Finished task 17.1 in stage 7.0 (TID 304). 969 bytes result sent to driver 17/03/01 04:14:49 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 316 17/03/01 04:14:49 INFO executor.Executor: Running task 3.0 in stage 8.0 (TID 316) 17/03/01 04:14:49 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 132 17/03/01 04:14:49 INFO storage.MemoryStore: ensureFreeSpace(887) called with curMem=10068, maxMem=8334920908 17/03/01 04:14:49 INFO storage.MemoryStore: Block broadcast_132_piece0 stored as bytes in memory (estimated size 887.0 B, free 7.8 GB) 17/03/01 04:14:49 INFO broadcast.TorrentBroadcast: Reading broadcast variable 132 took 13 ms 17/03/01 04:14:49 INFO storage.MemoryStore: ensureFreeSpace(1216) called with curMem=10955, maxMem=8334920908 17/03/01 04:14:49 INFO storage.MemoryStore: Block broadcast_132 stored as values in memory (estimated size 1216.0 B, free 7.8 GB) 17/03/01 04:14:49 INFO tcp.GridTcpRestProtocol: Command protocol successfully stopped: TCP binary 17/03/01 04:14:52 INFO cache.GridCacheProcessor: Stopped cache: ignite-marshaller-sys-cache 17/03/01 04:14:52 INFO cache.GridCacheProcessor: Stopped cache: ignite-sys-cache 17/03/01 04:14:52 INFO cache.GridCacheProcessor: Stopped cache: ignite-atomics-sys-cache 17/03/01 04:14:52 INFO cache.GridCacheProcessor: Stopped cache: WCAIgniteCache 17/03/01 04:14:52 INFO internal.IgniteKernal%WCA: >>> +---------------------------------------------------------------------------------+ >>> Ignite ver. 1.8.0#20161205-sha1:9ca40dbeb7d559fcb299bdb6f5c90cdf8ce7e533 stopped OK >>> +---------------------------------------------------------------------------------+ >>> Grid name: WCA >>> Grid uptime: 00:02:04:681 17/03/01 04:14:52 INFO executor.Executor: Finished task 3.0 in stage 8.0 (TID 316). 931 bytes result sent to driver 17/03/01 04:14:53 INFO executor.CoarseGrainedExecutorBackend: Driver commanded a shutdown 17/03/01 04:14:53 INFO storage.MemoryStore: MemoryStore cleared 17/03/01 04:14:53 INFO storage.BlockManager: BlockManager stopped 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Shutting down remote daemon. 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remote daemon shut down; proceeding with flushing remote transports. 17/03/01 04:14:53 INFO Remoting: Remoting shut down 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remoting shut down. 17/03/01 04:14:53 INFO util.ShutdownHookManager: Shutdown hook called LogType:stdout Log Upload Time:Wed Mar 01 04:14:58 -0600 2017 LogLength:1577 Log Contents: rEnd of the programe - [04:12:38] __________ ________________ [04:12:38] / _/ ___/ |/ / _/_ __/ __/ [04:12:38] _/ // (7 7 // / / / / _/ [04:12:38] /___/\___/_/|_/___/ /_/ /___/ [04:12:38] [04:12:38] ver. 1.8.0#20161205-sha1:9ca40dbe [04:12:38] 2016 Copyright(C) Apache Software Foundation [04:12:38] [04:12:38] Ignite documentation: http://ignite.apache.org [04:12:38] [04:12:38] Quiet mode. [04:12:38] ^-- To see **FULL** console log here add -DIGNITE_QUIET=false or "-v" to ignite.{sh|bat} [04:12:38] [04:12:38] OS: Linux 2.6.32-431.5.1.el6.x86_64 amd64 [04:12:38] VM information: Java(TM) SE Runtime Environment 1.8.0_60-b27 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.60-b23 [04:12:38] Configured plugins: [04:12:38] ^-- None [04:12:38] [04:12:38] Security status [authentication=off, tls/ssl=off] [04:12:44] Topology snapshot [ver=37, servers=37, clients=0, CPUs=1512, heap=580.0GB] [04:12:44] Topology snapshot [ver=38, servers=38, clients=0, CPUs=1552, heap=590.0GB] [04:12:45] Topology snapshot [ver=39, servers=39, clients=0, CPUs=1584, heap=610.0GB] [04:12:45] Topology snapshot [ver=40, servers=40, clients=0, CPUs=1624, heap=620.0GB] [04:12:45] Topology snapshot [ver=41, servers=41, clients=0, CPUs=1664, heap=640.0GB] [04:12:47] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [04:12:47] [04:12:47] Ignite node started OK (id=8fd4eea2, grid=WCA) [04:12:47] Topology snapshot [ver=36, servers=36, clients=0, CPUs=1472, heap=560.0GB] [04:14:52] Ignite node stopped OK [name=WCA, uptime=00:02:04:681] Container: container_e76_1487862040010_131981_01_000035 on hostName_8041 =========================================================================================== LogType:stderr Log Upload Time:Wed Mar 01 04:14:55 -0600 2017 LogLength:136865 Log Contents: 17/03/01 04:10:59 INFO executor.CoarseGrainedExecutorBackend: Registered signal handlers for [TERM, HUP, INT] 17/03/01 04:11:00 INFO spark.SecurityManager: Changing view acls to: userName 17/03/01 04:11:00 INFO spark.SecurityManager: Changing modify acls to: userName 17/03/01 04:11:00 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(userName); users with modify permissions: Set(userName) 17/03/01 04:11:00 INFO slf4j.Slf4jLogger: Slf4jLogger started 17/03/01 04:11:00 INFO Remoting: Starting remoting 17/03/01 04:11:01 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://driverPropsFetcher@hostName:60582] 17/03/01 04:11:01 INFO Remoting: Remoting now listens on addresses: [akka.tcp://driverPropsFetcher@hostName:60582] 17/03/01 04:11:01 INFO util.Utils: Successfully started service 'driverPropsFetcher' on port 60582. 17/03/01 04:11:01 INFO spark.SecurityManager: Changing view acls to: userName 17/03/01 04:11:01 INFO spark.SecurityManager: Changing modify acls to: userName 17/03/01 04:11:01 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(userName); users with modify permissions: Set(userName) 17/03/01 04:11:01 INFO remote.RemoteActorRefProvider$RemotingTerminator: Shutting down remote daemon. 17/03/01 04:11:01 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remote daemon shut down; proceeding with flushing remote transports. 17/03/01 04:11:01 INFO slf4j.Slf4jLogger: Slf4jLogger started 17/03/01 04:11:01 INFO Remoting: Starting remoting 17/03/01 04:11:01 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://sparkExecutor@hostName:50529] 17/03/01 04:11:01 INFO Remoting: Remoting shut down 17/03/01 04:11:01 INFO Remoting: Remoting now listens on addresses: [akka.tcp://sparkExecutor@hostName:50529] 17/03/01 04:11:01 INFO util.Utils: Successfully started service 'sparkExecutor' on port 50529. 17/03/01 04:11:01 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remoting shut down. 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/1/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-f900b43c-5a06-49a8-81bc-7369c6bbd4ff 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/2/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-560e6442-a3cb-4056-9b12-e61476aaeeb2 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/3/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-09dff1f2-0a24-474e-9b03-db4a55dca788 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/4/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-8bc7b00a-a4df-48fd-b18e-7cfd45336980 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/5/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-6fdfb87c-aa6d-4096-9b99-58d4a10c9047 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/6/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-5d7967ac-61fc-4f7d-b029-ebeb925a0e0e 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/7/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-63ca247d-4fdf-482e-b8ae-0bcff98efedc 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/8/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-90d466c6-9eb9-4369-8962-af35e8466c40 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/9/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-57dd9467-8024-4a70-9fd8-3ec17f12b894 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/10/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-0c24d25a-2fa3-4929-a4db-14e903e0fe77 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/11/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-74bbaae0-49f0-4d53-9d71-f49405ee2a6f 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/12/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-276a0ad4-dd37-4c02-920e-8adbc50a433c 17/03/01 04:11:01 INFO storage.MemoryStore: MemoryStore started with capacity 7.8 GB 17/03/01 04:11:01 INFO executor.CoarseGrainedExecutorBackend: Connecting to driver: akka.tcp://sparkDriver@ipaddress:38995/user/CoarseGrainedScheduler 17/03/01 04:11:01 INFO executor.CoarseGrainedExecutorBackend: Successfully registered with driver 17/03/01 04:11:01 INFO executor.Executor: Starting executor ID 32 on host hostName 17/03/01 04:11:01 INFO util.Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 55987. 17/03/01 04:11:01 INFO netty.NettyBlockTransferService: Server created on 55987 17/03/01 04:11:01 INFO storage.BlockManagerMaster: Trying to register BlockManager 17/03/01 04:11:01 INFO storage.BlockManagerMaster: Registered BlockManager 17/03/01 04:11:02 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 29 17/03/01 04:11:02 INFO executor.Executor: Running task 29.0 in stage 0.0 (TID 29) 17/03/01 04:11:02 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 0 17/03/01 04:11:02 INFO storage.MemoryStore: ensureFreeSpace(1310) called with curMem=0, maxMem=8334920908 17/03/01 04:11:02 INFO storage.MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 1310.0 B, free 7.8 GB) 17/03/01 04:11:02 INFO broadcast.TorrentBroadcast: Reading broadcast variable 0 took 242 ms 17/03/01 04:11:02 INFO storage.MemoryStore: ensureFreeSpace(2064) called with curMem=1310, maxMem=8334920908 17/03/01 04:11:02 INFO storage.MemoryStore: Block broadcast_0 stored as values in memory (estimated size 2.0 KB, free 7.8 GB) 17/03/01 04:11:02 INFO resolver.CompanyResolverSparkTest: Ranjit exec test 17/03/01 04:11:02 INFO executor.Executor: Finished task 29.0 in stage 0.0 (TID 29). 972 bytes result sent to driver 17/03/01 04:12:38 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 137 17/03/01 04:12:38 INFO executor.Executor: Running task 15.0 in stage 4.0 (TID 137) 17/03/01 04:12:38 INFO spark.MapOutputTrackerWorker: Updating epoch to 1 and clearing cache 17/03/01 04:12:38 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 86 17/03/01 04:12:38 INFO storage.MemoryStore: ensureFreeSpace(2290) called with curMem=3374, maxMem=8334920908 17/03/01 04:12:38 INFO storage.MemoryStore: Block broadcast_86_piece0 stored as bytes in memory (estimated size 2.2 KB, free 7.8 GB) 17/03/01 04:12:38 INFO broadcast.TorrentBroadcast: Reading broadcast variable 86 took 10 ms 17/03/01 04:12:38 INFO storage.MemoryStore: ensureFreeSpace(6544) called with curMem=5664, maxMem=8334920908 17/03/01 04:12:38 INFO storage.MemoryStore: Block broadcast_86 stored as values in memory (estimated size 6.4 KB, free 7.8 GB) 17/03/01 04:12:38 INFO resolver.CompanyResolverSparkTest: testing worker[ipaddress:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509] 17/03/01 04:12:38 ERROR : Failed to resolve default logging config file: config/java.util.logging.properties Console logging handler is not configured. 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: >>> __________ ________________ >>> / _/ ___/ |/ / _/_ __/ __/ >>> _/ // (7 7 // / / / / _/ >>> /___/\___/_/|_/___/ /_/ /___/ >>> >>> ver. 1.8.0#20161205-sha1:9ca40dbe >>> 2016 Copyright(C) Apache Software Foundation >>> >>> Ignite documentation: http://ignite.apache.org 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Config URL: n/a 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Daemon mode: off 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: OS: Linux 2.6.32-431.5.1.el6.x86_64 amd64 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: OS user: userName 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: PID: 16283 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Language runtime: Java Platform API Specification ver. 1.8 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM information: Java(TM) SE Runtime Environment 1.8.0_60-b27 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.60-b23 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM total memory: 14.0GB 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Remote Management [restart: off, REST: on, JMX (remote: off)] 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: IGNITE_HOME=null 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM arguments: [-XX:OnOutOfMemoryError=kill %p, -Xms15360m, -Xmx15360m, -Djava.io.tmpdir=/data/5/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/container_e76_1487862040010_131981_01_000035/tmp, -Dspark.driver.port=38995, -Dspark.ui.port=0, -Dspark.yarn.app.container.log.dir=/data/11/yarn/log/container/application_1487862040010_131981/container_e76_1487862040010_131981_01_000035] 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Configured caches ['ignite-marshaller-sys-cache', 'ignite-sys-cache', 'ignite-atomics-sys-cache'] 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: Configured plugins: 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: ^-- None 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: IPC shared memory server endpoint started [port=48100, tokDir=/data/5/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/container_e76_1487862040010_131981_01_000035/tmp/ignite/work/ipc/shmem/0d675d57-b9b9-4cff-a994-77337d618bbe-16283] 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: Successfully bound shared memory communication to TCP port [port=48100, locHost=0.0.0.0/0.0.0.0] 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: Successfully bound to TCP port [port=47100, locHost=0.0.0.0/0.0.0.0] 17/03/01 04:12:38 WARN noop.NoopCheckpointSpi: Checkpoints are disabled (to enable configure any GridCheckpointSpi implementation) 17/03/01 04:12:38 WARN collision.GridCollisionManager: Collision resolution is disabled (all jobs will be activated upon arrival). 17/03/01 04:12:38 WARN noop.NoopSwapSpaceSpi: Swap space is disabled. To enable use FileSwapSpaceSpi. 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Security status [authentication=off, tls/ssl=off] 17/03/01 04:12:39 INFO tcp.GridTcpRestProtocol: Command protocol successfully started [name=TCP binary, host=0.0.0.0/0.0.0.0, port=11211] 17/03/01 04:12:39 INFO internal.IgniteKernal%WCA: Non-loopback local IPs: 4 17/03/01 04:12:39 INFO internal.IgniteKernal%WCA: Enabled local MACs: 44A84210AAEB 17/03/01 04:12:39 INFO tcp.TcpDiscoverySpi: Successfully bound to TCP port [port=47500, localHost=0.0.0.0/0.0.0.0, locNodeId=0d675d57-b9b9-4cff-a994-77337d618bbe] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=a6343860-6e84-4d9c-9b87-84ffd76280cd, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=26, intOrder=26, lastExchangeTime=1488363162416, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=26, servers=26, clients=0, CPUs=1056, heap=410.0GB] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=479b18e6-54af-4313-85f7-c7525f6229a4, addrs=[, 127.0.0.1], sockAddrs=[hostName/:47500, /127.0.0.1:47500], discPort=47500, order=27, intOrder=27, lastExchangeTime=1488363162436, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=27, servers=27, clients=0, CPUs=1104, heap=430.0GB] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=058a99e8-3b65-4ec9-84b0-6f3502c2afce, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=28, intOrder=28, lastExchangeTime=1488363162449, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=28, servers=28, clients=0, CPUs=1144, heap=440.0GB] 17/03/01 04:12:43 INFO cache.GridCacheProcessor: Started cache [name=ignite-sys-cache, mode=REPLICATED] 17/03/01 04:12:43 INFO cache.GridCacheProcessor: Started cache [name=ignite-atomics-sys-cache, mode=PARTITIONED] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=57c09d88-a4dc-4179-98b4-1144fd97d8cc, addrs=[35, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/35:47500], discPort=47500, order=29, intOrder=29, lastExchangeTime=1488363162460, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=29, servers=29, clients=0, CPUs=1192, heap=460.0GB] 17/03/01 04:12:43 INFO cache.GridCacheProcessor: Started cache [name=WCAIgniteCache, mode=PARTITIONED] 17/03/01 04:12:43 INFO cache.GridCacheProcessor: Started cache [name=ignite-marshaller-sys-cache, mode=REPLICATED] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=58298821-7aa9-4b58-ba15-e7f1ef2830fb, addrs=[3, 127.0.0.1], sockAddrs=[hostName/3:47500, /127.0.0.1:47500], discPort=47500, order=30, intOrder=30, lastExchangeTime=1488363162471, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=30, servers=30, clients=0, CPUs=1232, heap=470.0GB] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4d5de2f3-d975-4b28-b593-0cc0481cdc74, addrs=[03, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/03:47500], discPort=47500, order=31, intOrder=31, lastExchangeTime=1488363162471, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=31, servers=31, clients=0, CPUs=1280, heap=490.0GB] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=fa09caab-f4dc-43b6-ac8b-4a4bae6e7da6, addrs=[01, 127.0.0.1], sockAddrs=[hostName/01:47500, /127.0.0.1:47500], discPort=47500, order=32, intOrder=32, lastExchangeTime=1488363162491, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=32, servers=32, clients=0, CPUs=1320, heap=500.0GB] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=af5837f0-25ec-4f3d-a1c1-90c09dc424cb, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=33, intOrder=33, lastExchangeTime=1488363162522, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=33, servers=33, clients=0, CPUs=1360, heap=520.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=25, minorTopVer=0], evt=NODE_JOINED, node=0d675d57-b9b9-4cff-a994-77337d618bbe] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=e9e49d2d-5eeb-474f-8757-e447efc8ca8f, addrs=[6, 127.0.0.1], sockAddrs=[hostName/6:47500, /127.0.0.1:47500], discPort=47500, order=34, intOrder=34, lastExchangeTime=1488363162532, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=34, servers=34, clients=0, CPUs=1400, heap=530.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=26, minorTopVer=0], evt=NODE_JOINED, node=a6343860-6e84-4d9c-9b87-84ffd76280cd] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4b90e5a3-253a-435b-84ca-6b592610cf0c, addrs=[4, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/4:47500], discPort=47500, order=35, intOrder=35, lastExchangeTime=1488363162542, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=35, servers=35, clients=0, CPUs=1432, heap=550.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=27, minorTopVer=0], evt=NODE_JOINED, node=479b18e6-54af-4313-85f7-c7525f6229a4] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=8fd4eea2-2a45-4563-ae87-1848fd388a98, addrs=[3, 127.0.0.1], sockAddrs=[hostName/3:47500, /127.0.0.1:47500], discPort=47500, order=36, intOrder=36, lastExchangeTime=1488363162542, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=36, servers=36, clients=0, CPUs=1472, heap=560.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=28, minorTopVer=0], evt=NODE_JOINED, node=058a99e8-3b65-4ec9-84b0-6f3502c2afce] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=d7b45a02-0411-4028-acdf-f004e592f294, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=37, intOrder=37, lastExchangeTime=1488363162572, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=37, servers=37, clients=0, CPUs=1512, heap=580.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=29, minorTopVer=0], evt=NODE_JOINED, node=57c09d88-a4dc-4179-98b4-1144fd97d8cc] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=cf4e6e83-207e-42da-a55c-5621bc20b891, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=38, intOrder=38, lastExchangeTime=1488363162774, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=38, servers=38, clients=0, CPUs=1552, heap=590.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=30, minorTopVer=0], evt=NODE_JOINED, node=58298821-7aa9-4b58-ba15-e7f1ef2830fb] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=d8926a2c-2c00-4445-beb4-633c2d656c41, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=39, intOrder=39, lastExchangeTime=1488363162774, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=39, servers=39, clients=0, CPUs=1584, heap=610.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=31, minorTopVer=0], evt=NODE_JOINED, node=4d5de2f3-d975-4b28-b593-0cc0481cdc74] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4136a0c9-14d5-42b3-9a60-81689c800438, addrs=[3, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/3:47500], discPort=47500, order=40, intOrder=40, lastExchangeTime=1488363162996, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=40, servers=40, clients=0, CPUs=1624, heap=620.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=32, minorTopVer=0], evt=NODE_JOINED, node=fa09caab-f4dc-43b6-ac8b-4a4bae6e7da6] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=694a80b8-02a3-44c9-a2dd-45bed7d20a50, addrs=[1, 127.0.0.1], sockAddrs=[hostName/1:47500, /127.0.0.1:47500], discPort=47500, order=41, intOrder=41, lastExchangeTime=1488363163006, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=41, servers=41, clients=0, CPUs=1664, heap=640.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=33, minorTopVer=0], evt=NODE_JOINED, node=af5837f0-25ec-4f3d-a1c1-90c09dc424cb] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=34, minorTopVer=0], evt=NODE_JOINED, node=e9e49d2d-5eeb-474f-8757-e447efc8ca8f] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=35, minorTopVer=0], evt=NODE_JOINED, node=4b90e5a3-253a-435b-84ca-6b592610cf0c] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=36, minorTopVer=0], evt=NODE_JOINED, node=8fd4eea2-2a45-4563-ae87-1848fd388a98] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=37, minorTopVer=0], evt=NODE_JOINED, node=d7b45a02-0411-4028-acdf-f004e592f294] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=38, minorTopVer=0], evt=NODE_JOINED, node=cf4e6e83-207e-42da-a55c-5621bc20b891] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=39, minorTopVer=0], evt=NODE_JOINED, node=d8926a2c-2c00-4445-beb4-633c2d656c41] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=40, minorTopVer=0], evt=NODE_JOINED, node=4136a0c9-14d5-42b3-9a60-81689c800438] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-sys-cache, waitList=[]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-marshaller-sys-cache, waitList=[]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-atomics-sys-cache, waitList=[ignite-sys-cache, ignite-marshaller-sys-cache]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=WCAIgniteCache, waitList=[ignite-sys-cache, ignite-marshaller-sys-cache, ignite-atomics-sys-cache]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Rebalancing required [top=AffinityTopologyVersion [topVer=41, minorTopVer=0], evt=NODE_JOINED, node=694a80b8-02a3-44c9-a2dd-45bed7d20a50] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-marshaller-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=20, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=17] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=100, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=17] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-marshaller-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=20 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=20 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-atomics-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=18, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=17] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-atomics-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=10 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=WCAIgniteCache, mode=ASYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=18, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=17] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=WCAIgniteCache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=0 ms] 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: >>> +----------------------------------------------------------------------+ >>> Ignite ver. 1.8.0#20161205-sha1:9ca40dbeb7d559fcb299bdb6f5c90cdf8ce7e533 >>> +----------------------------------------------------------------------+ >>> OS name: Linux 2.6.32-431.5.1.el6.x86_64 amd64 >>> CPU(s): 40 >>> Heap: 15.0GB >>> VM name: 16283@hostName >>> Grid name: WCA >>> Local node [ID=0D675D57-B9B9-4CFF-A994-77337D618BBE, order=25, clientMode=false] >>> Local node addresses: [hostName/4, /127.0.0.1] >>> Local ports: TCP:11211 TCP:47100 TCP:47500 TCP:48100 17/03/01 04:12:47 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=25, servers=25, clients=0, CPUs=1016, heap=400.0GB] 17/03/01 04:12:47 INFO resolver.CompanyResolverSparkTest: Started ignite node on executor 17/03/01 04:12:47 INFO executor.Executor: Finished task 15.0 in stage 4.0 (TID 137). 931 bytes result sent to driver 17/03/01 04:12:49 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=41, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, node=6172ee3a-eb33-4bf5-9080-c255f52caed8] 17/03/01 04:13:47 INFO internal.IgniteKernal%WCA: Metrics for local node (to disable set 'metricsLogFrequency' to 0) ^-- Node [id=0d675d57, name=WCA, uptime=00:01:00:002] ^-- H/N/C [hosts=41, nodes=41, CPUs=1664] ^-- CPU [cur=1.33%, avg=2.03%, GC=0%] ^-- Heap [used=1370MB, free=90.69%, comm=14720MB] ^-- Non heap [used=85MB, free=-1%, comm=88MB] ^-- Public thread pool [active=0, idle=0, qSize=0] ^-- System thread pool [active=0, idle=80, qSize=0] ^-- Outbound messages queue [size=0] 17/03/01 04:13:52 INFO cluster.GridUpdateNotifier: Update status is not available. 17/03/01 04:14:00 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 274 17/03/01 04:14:00 INFO executor.Executor: Running task 30.0 in stage 7.0 (TID 274) 17/03/01 04:14:00 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 131 17/03/01 04:14:00 INFO storage.MemoryStore: ensureFreeSpace(2732) called with curMem=0, maxMem=8334920908 17/03/01 04:14:00 INFO storage.MemoryStore: Block broadcast_131_piece0 stored as bytes in memory (estimated size 2.7 KB, free 7.8 GB) 17/03/01 04:14:00 INFO broadcast.TorrentBroadcast: Reading broadcast variable 131 took 25 ms 17/03/01 04:14:00 INFO storage.MemoryStore: ensureFreeSpace(7336) called with curMem=2732, maxMem=8334920908 17/03/01 04:14:00 INFO storage.MemoryStore: Block broadcast_131 stored as values in memory (estimated size 7.2 KB, free 7.8 GB) 17/03/01 04:14:11 ERROR executor.Executor: Exception in task 30.0 in stage 7.0 (TID 274) javax.cache.CacheException: class org.apache.ignite.IgniteCheckedException: Query execution failed: GridCacheQueryBean [qry=GridCacheQueryAdapter [type=TEXT, clsName=CompanyVO1, clause=HARBOR OF SANTA BARBARATHE, filter=null, transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=true, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=0d675d57-b9b9-4cff-a994-77337d618bbe, taskHash=0], rdc=null, trans=null] at org.apache.ignite.internal.processors.cache.GridCacheUtils.convertToCacheException(GridCacheUtils.java:1440) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.next(GridCacheQueryFutureAdapter.java:174) at org.apache.ignite.internal.processors.cache.IgniteCacheProxy$5.onHasNext(IgniteCacheProxy.java:600) at org.apache.ignite.internal.util.GridCloseableIteratorAdapter.hasNextX(GridCloseableIteratorAdapter.java:53) at org.apache.ignite.internal.util.lang.GridIteratorAdapter.hasNext(GridIteratorAdapter.java:45) at un.api.resolver.dao.CompanyDAO.getVarCompContains(CompanyDAO.scala:242) at un.api.resolver.accessor.CompanyAccessor.getVarCompContains(CompanyAccessor.scala:27) at un.api.resolver.CompanyResolverSparkTest$$anonfun$main$7.apply(CompanyResolverSparkTest.scala:291) at un.api.resolver.CompanyResolverSparkTest$$anonfun$main$7.apply(CompanyResolverSparkTest.scala:289) at scala.collection.Iterator$$anon$11.next(Iterator.scala:328) at org.apache.spark.util.Utils$.getIteratorSize(Utils.scala:1554) at org.apache.spark.rdd.RDD$$anonfun$count$1.apply(RDD.scala:1121) at org.apache.spark.rdd.RDD$$anonfun$count$1.apply(RDD.scala:1121) at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1850) at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1850) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:66) at org.apache.spark.scheduler.Task.run(Task.scala:88) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:214) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: class org.apache.ignite.IgniteCheckedException: Query execution failed: GridCacheQueryBean [qry=GridCacheQueryAdapter [type=TEXT, clsName=CompanyVO1, clause=HARBOR OF SANTA BARBARATHE, filter=null, transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=true, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=0d675d57-b9b9-4cff-a994-77337d618bbe, taskHash=0], rdc=null, trans=null] at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.checkError(GridCacheQueryFutureAdapter.java:260) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.internalIterator(GridCacheQueryFutureAdapter.java:318) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.next(GridCacheQueryFutureAdapter.java:164) ... 19 more Caused by: class org.apache.ignite.IgniteCheckedException: Failed to execute query on node [query=GridCacheQueryBean [qry=GridCacheQueryAdapter [type=TEXT, clsName=CompanyVO1, clause=HARBOR OF SANTA BARBARATHE, filter=null, transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=true, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=0d675d57-b9b9-4cff-a994-77337d618bbe, taskHash=0], rdc=null, trans=null], nodeId=694a80b8-02a3-44c9-a2dd-45bed7d20a50] at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.onPage(GridCacheQueryFutureAdapter.java:383) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.processQueryResponse(GridCacheDistributedQueryManager.java:398) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.access$000(GridCacheDistributedQueryManager.java:63) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$1.apply(GridCacheDistributedQueryManager.java:93) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$1.apply(GridCacheDistributedQueryManager.java:91) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.processMessage(GridCacheIoManager.java:827) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.onMessage0(GridCacheIoManager.java:369) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.access$400(GridCacheIoManager.java:95) at org.apache.ignite.internal.processors.cache.GridCacheIoManager$OrderedMessageListener.onMessage(GridCacheIoManager.java:1345) at org.apache.ignite.internal.managers.communication.GridIoManager.invokeListener(GridIoManager.java:1082) at org.apache.ignite.internal.managers.communication.GridIoManager.access$1600(GridIoManager.java:102) at org.apache.ignite.internal.managers.communication.GridIoManager$GridCommunicationMessageSet.unwind(GridIoManager.java:2332) at org.apache.ignite.internal.managers.communication.GridIoManager.unwindMessageSet(GridIoManager.java:1042) at org.apache.ignite.internal.managers.communication.GridIoManager.access$1900(GridIoManager.java:102) at org.apache.ignite.internal.managers.communication.GridIoManager$6.run(GridIoManager.java:1011) ... 3 more Caused by: java.lang.NullPointerException 17/03/01 04:14:11 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 294 17/03/01 04:14:11 INFO executor.Executor: Running task 30.1 in stage 7.0 (TID 294) 17/03/01 04:14:17 INFO executor.Executor: Finished task 30.1 in stage 7.0 (TID 294). 969 bytes result sent to driver 17/03/01 04:14:47 INFO internal.IgniteKernal%WCA: Metrics for local node (to disable set 'metricsLogFrequency' to 0) ^-- Node [id=0d675d57, name=WCA, uptime=00:02:00:054] ^-- H/N/C [hosts=41, nodes=41, CPUs=1664] ^-- CPU [cur=0.1%, avg=1.38%, GC=0%] ^-- Heap [used=2277MB, free=84.6%, comm=14789MB] ^-- Non heap [used=91MB, free=-1%, comm=92MB] ^-- Public thread pool [active=0, idle=0, qSize=0] ^-- System thread pool [active=0, idle=80, qSize=0] ^-- Outbound messages queue [size=0] 17/03/01 04:14:49 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 352 17/03/01 04:14:49 INFO executor.Executor: Running task 39.0 in stage 8.0 (TID 352) 17/03/01 04:14:49 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 132 17/03/01 04:14:49 INFO storage.MemoryStore: ensureFreeSpace(887) called with curMem=10068, maxMem=8334920908 17/03/01 04:14:49 INFO storage.MemoryStore: Block broadcast_132_piece0 stored as bytes in memory (estimated size 887.0 B, free 7.8 GB) 17/03/01 04:14:49 INFO broadcast.TorrentBroadcast: Reading broadcast variable 132 took 14 ms 17/03/01 04:14:49 INFO storage.MemoryStore: ensureFreeSpace(1216) called with curMem=10955, maxMem=8334920908 17/03/01 04:14:49 INFO storage.MemoryStore: Block broadcast_132 stored as values in memory (estimated size 1216.0 B, free 7.8 GB) 17/03/01 04:14:49 INFO tcp.GridTcpRestProtocol: Command protocol successfully stopped: TCP binary 17/03/01 04:14:51 INFO cache.GridCacheProcessor: Stopped cache: ignite-marshaller-sys-cache 17/03/01 04:14:51 INFO cache.GridCacheProcessor: Stopped cache: ignite-sys-cache 17/03/01 04:14:51 INFO cache.GridCacheProcessor: Stopped cache: ignite-atomics-sys-cache 17/03/01 04:14:51 INFO cache.GridCacheProcessor: Stopped cache: WCAIgniteCache 17/03/01 04:14:51 INFO internal.IgniteKernal%WCA: >>> +---------------------------------------------------------------------------------+ >>> Ignite ver. 1.8.0#20161205-sha1:9ca40dbeb7d559fcb299bdb6f5c90cdf8ce7e533 stopped OK >>> +---------------------------------------------------------------------------------+ >>> Grid name: WCA >>> Grid uptime: 00:02:04:183 17/03/01 04:14:51 INFO executor.Executor: Finished task 39.0 in stage 8.0 (TID 352). 931 bytes result sent to driver 17/03/01 04:14:53 INFO executor.CoarseGrainedExecutorBackend: Driver commanded a shutdown 17/03/01 04:14:53 INFO storage.MemoryStore: MemoryStore cleared 17/03/01 04:14:53 INFO storage.BlockManager: BlockManager stopped 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Shutting down remote daemon. 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remote daemon shut down; proceeding with flushing remote transports. 17/03/01 04:14:53 INFO Remoting: Remoting shut down 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remoting shut down. 17/03/01 04:14:53 INFO util.ShutdownHookManager: Shutdown hook called LogType:stdout Log Upload Time:Wed Mar 01 04:14:55 -0600 2017 LogLength:2523 Log Contents: rEnd of the programe - [04:12:38] __________ ________________ [04:12:38] / _/ ___/ |/ / _/_ __/ __/ [04:12:38] _/ // (7 7 // / / / / _/ [04:12:38] /___/\___/_/|_/___/ /_/ /___/ [04:12:38] [04:12:38] ver. 1.8.0#20161205-sha1:9ca40dbe [04:12:38] 2016 Copyright(C) Apache Software Foundation [04:12:38] [04:12:38] Ignite documentation: http://ignite.apache.org [04:12:38] [04:12:38] Quiet mode. [04:12:38] ^-- To see **FULL** console log here add -DIGNITE_QUIET=false or "-v" to ignite.{sh|bat} [04:12:38] [04:12:38] OS: Linux 2.6.32-431.5.1.el6.x86_64 amd64 [04:12:38] VM information: Java(TM) SE Runtime Environment 1.8.0_60-b27 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.60-b23 [04:12:38] Configured plugins: [04:12:38] ^-- None [04:12:38] [04:12:38] Security status [authentication=off, tls/ssl=off] [04:12:42] Topology snapshot [ver=26, servers=26, clients=0, CPUs=1056, heap=410.0GB] [04:12:42] Topology snapshot [ver=27, servers=27, clients=0, CPUs=1104, heap=430.0GB] [04:12:43] Topology snapshot [ver=28, servers=28, clients=0, CPUs=1144, heap=440.0GB] [04:12:43] Topology snapshot [ver=29, servers=29, clients=0, CPUs=1192, heap=460.0GB] [04:12:43] Topology snapshot [ver=30, servers=30, clients=0, CPUs=1232, heap=470.0GB] [04:12:43] Topology snapshot [ver=31, servers=31, clients=0, CPUs=1280, heap=490.0GB] [04:12:43] Topology snapshot [ver=32, servers=32, clients=0, CPUs=1320, heap=500.0GB] [04:12:44] Topology snapshot [ver=33, servers=33, clients=0, CPUs=1360, heap=520.0GB] [04:12:44] Topology snapshot [ver=34, servers=34, clients=0, CPUs=1400, heap=530.0GB] [04:12:44] Topology snapshot [ver=35, servers=35, clients=0, CPUs=1432, heap=550.0GB] [04:12:44] Topology snapshot [ver=36, servers=36, clients=0, CPUs=1472, heap=560.0GB] [04:12:44] Topology snapshot [ver=37, servers=37, clients=0, CPUs=1512, heap=580.0GB] [04:12:44] Topology snapshot [ver=38, servers=38, clients=0, CPUs=1552, heap=590.0GB] [04:12:45] Topology snapshot [ver=39, servers=39, clients=0, CPUs=1584, heap=610.0GB] [04:12:45] Topology snapshot [ver=40, servers=40, clients=0, CPUs=1624, heap=620.0GB] [04:12:45] Topology snapshot [ver=41, servers=41, clients=0, CPUs=1664, heap=640.0GB] [04:12:47] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [04:12:47] [04:12:47] Ignite node started OK (id=0d675d57, grid=WCA) [04:12:47] Topology snapshot [ver=25, servers=25, clients=0, CPUs=1016, heap=400.0GB] [04:14:51] Ignite node stopped OK [name=WCA, uptime=00:02:04:183] Container: container_e76_1487862040010_131981_01_000037 on hostName_8041 =========================================================================================== LogType:stderr Log Upload Time:Wed Mar 01 04:14:58 -0600 2017 LogLength:81929 Log Contents: 17/03/01 04:10:59 INFO executor.CoarseGrainedExecutorBackend: Registered signal handlers for [TERM, HUP, INT] 17/03/01 04:10:59 INFO spark.SecurityManager: Changing view acls to: userName 17/03/01 04:10:59 INFO spark.SecurityManager: Changing modify acls to: userName 17/03/01 04:10:59 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(userName); users with modify permissions: Set(userName) 17/03/01 04:11:00 INFO slf4j.Slf4jLogger: Slf4jLogger started 17/03/01 04:11:00 INFO Remoting: Starting remoting 17/03/01 04:11:00 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://driverPropsFetcher@hostName:59005] 17/03/01 04:11:00 INFO Remoting: Remoting now listens on addresses: [akka.tcp://driverPropsFetcher@hostName:59005] 17/03/01 04:11:00 INFO util.Utils: Successfully started service 'driverPropsFetcher' on port 59005. 17/03/01 04:11:00 INFO spark.SecurityManager: Changing view acls to: userName 17/03/01 04:11:00 INFO spark.SecurityManager: Changing modify acls to: userName 17/03/01 04:11:00 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(userName); users with modify permissions: Set(userName) 17/03/01 04:11:00 INFO remote.RemoteActorRefProvider$RemotingTerminator: Shutting down remote daemon. 17/03/01 04:11:00 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remote daemon shut down; proceeding with flushing remote transports. 17/03/01 04:11:00 INFO slf4j.Slf4jLogger: Slf4jLogger started 17/03/01 04:11:00 INFO Remoting: Starting remoting 17/03/01 04:11:00 INFO Remoting: Remoting shut down 17/03/01 04:11:00 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://sparkExecutor@hostName:48294] 17/03/01 04:11:00 INFO Remoting: Remoting now listens on addresses: [akka.tcp://sparkExecutor@hostName:48294] 17/03/01 04:11:00 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remoting shut down. 17/03/01 04:11:00 INFO util.Utils: Successfully started service 'sparkExecutor' on port 48294. 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/1/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-54512c2a-d5d2-4c1d-ae87-23cb782e5859 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/2/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-bd21121f-148c-4cf2-b578-a7b25082ce4f 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/3/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-020b4627-fbe0-48dc-845b-3e1fbe5e0e17 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/4/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-94b3ced6-19f6-431d-8a12-ff4bf89895b0 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/5/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-0a3e3b8b-406e-4fcb-b49d-528ef202b50a 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/6/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-674fe7af-9048-4fa3-9d0b-6792273b4fb6 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/7/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-e06c7c79-f6b0-4240-a340-27bc36e0685b 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/8/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-a1a78402-c56a-4e6c-8e1d-7ff35069c4fc 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/9/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-ea42b536-11db-4acf-b5cc-79bfe2a94e91 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/10/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-71f6d292-ba8a-4a1f-8562-388b19fafd80 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/11/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-64dfa495-1a3b-4e1c-adec-4347375a5e5e 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/12/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-5dcf427d-7b55-4d6e-9cb5-83d55625963f 17/03/01 04:11:00 INFO storage.MemoryStore: MemoryStore started with capacity 7.8 GB 17/03/01 04:11:00 INFO executor.CoarseGrainedExecutorBackend: Connecting to driver: akka.tcp://sparkDriver@ipaddress:38995/user/CoarseGrainedScheduler 17/03/01 04:11:00 INFO executor.CoarseGrainedExecutorBackend: Successfully registered with driver 17/03/01 04:11:00 INFO executor.Executor: Starting executor ID 34 on host hostName 17/03/01 04:11:00 INFO util.Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 57052. 17/03/01 04:11:00 INFO netty.NettyBlockTransferService: Server created on 57052 17/03/01 04:11:00 INFO storage.BlockManagerMaster: Trying to register BlockManager 17/03/01 04:11:00 INFO storage.BlockManagerMaster: Registered BlockManager 17/03/01 04:11:02 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 2 17/03/01 04:11:02 INFO executor.Executor: Running task 2.0 in stage 0.0 (TID 2) 17/03/01 04:11:02 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 0 17/03/01 04:11:02 INFO storage.MemoryStore: ensureFreeSpace(1310) called with curMem=0, maxMem=8334920908 17/03/01 04:11:02 INFO storage.MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 1310.0 B, free 7.8 GB) 17/03/01 04:11:02 INFO broadcast.TorrentBroadcast: Reading broadcast variable 0 took 243 ms 17/03/01 04:11:02 INFO storage.MemoryStore: ensureFreeSpace(2064) called with curMem=1310, maxMem=8334920908 17/03/01 04:11:02 INFO storage.MemoryStore: Block broadcast_0 stored as values in memory (estimated size 2.0 KB, free 7.8 GB) 17/03/01 04:11:02 INFO resolver.CompanyResolverSparkTest: Ranjit exec test 17/03/01 04:11:02 INFO executor.Executor: Finished task 2.0 in stage 0.0 (TID 2). 972 bytes result sent to driver 17/03/01 04:12:38 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 139 17/03/01 04:12:38 INFO executor.Executor: Running task 17.0 in stage 4.0 (TID 139) 17/03/01 04:12:38 INFO spark.MapOutputTrackerWorker: Updating epoch to 1 and clearing cache 17/03/01 04:12:38 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 86 17/03/01 04:12:38 INFO storage.MemoryStore: ensureFreeSpace(2290) called with curMem=3374, maxMem=8334920908 17/03/01 04:12:38 INFO storage.MemoryStore: Block broadcast_86_piece0 stored as bytes in memory (estimated size 2.2 KB, free 7.8 GB) 17/03/01 04:12:38 INFO broadcast.TorrentBroadcast: Reading broadcast variable 86 took 8 ms 17/03/01 04:12:38 INFO storage.MemoryStore: ensureFreeSpace(6544) called with curMem=5664, maxMem=8334920908 17/03/01 04:12:38 INFO storage.MemoryStore: Block broadcast_86 stored as values in memory (estimated size 6.4 KB, free 7.8 GB) 17/03/01 04:12:38 INFO resolver.CompanyResolverSparkTest: testing worker[ipaddress:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509] 17/03/01 04:12:38 ERROR : Failed to resolve default logging config file: config/java.util.logging.properties Console logging handler is not configured. 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: >>> __________ ________________ >>> / _/ ___/ |/ / _/_ __/ __/ >>> _/ // (7 7 // / / / / _/ >>> /___/\___/_/|_/___/ /_/ /___/ >>> >>> ver. 1.8.0#20161205-sha1:9ca40dbe >>> 2016 Copyright(C) Apache Software Foundation >>> >>> Ignite documentation: http://ignite.apache.org 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Config URL: n/a 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Daemon mode: off 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: OS: Linux 2.6.32-431.5.1.el6.x86_64 amd64 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: OS user: userName 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: PID: 4053 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Language runtime: Java Platform API Specification ver. 1.8 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM information: Java(TM) SE Runtime Environment 1.8.0_60-b27 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.60-b23 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM total memory: 14.0GB 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Remote Management [restart: off, REST: on, JMX (remote: off)] 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: IGNITE_HOME=null 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM arguments: [-XX:OnOutOfMemoryError=kill %p, -Xms15360m, -Xmx15360m, -Djava.io.tmpdir=/data/2/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/container_e76_1487862040010_131981_01_000037/tmp, -Dspark.driver.port=38995, -Dspark.ui.port=0, -Dspark.yarn.app.container.log.dir=/data/2/yarn/log/container/application_1487862040010_131981/container_e76_1487862040010_131981_01_000037] 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Configured caches ['ignite-marshaller-sys-cache', 'ignite-sys-cache', 'ignite-atomics-sys-cache'] 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: Configured plugins: 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: ^-- None 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: IPC shared memory server endpoint started [port=48100, tokDir=/data/2/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/container_e76_1487862040010_131981_01_000037/tmp/ignite/work/ipc/shmem/d4a9fe7f-de19-4df7-874c-a084da78562f-4053] 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: Successfully bound shared memory communication to TCP port [port=48100, locHost=0.0.0.0/0.0.0.0] 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: Successfully bound to TCP port [port=47100, locHost=0.0.0.0/0.0.0.0] 17/03/01 04:12:38 WARN noop.NoopCheckpointSpi: Checkpoints are disabled (to enable configure any GridCheckpointSpi implementation) 17/03/01 04:12:38 WARN collision.GridCollisionManager: Collision resolution is disabled (all jobs will be activated upon arrival). 17/03/01 04:12:38 WARN noop.NoopSwapSpaceSpi: Swap space is disabled. To enable use FileSwapSpaceSpi. 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Security status [authentication=off, tls/ssl=off] 17/03/01 04:12:39 INFO tcp.GridTcpRestProtocol: Command protocol successfully started [name=TCP binary, host=0.0.0.0/0.0.0.0, port=11211] 17/03/01 04:12:39 INFO internal.IgniteKernal%WCA: Non-loopback local IPs: 4 17/03/01 04:12:39 INFO internal.IgniteKernal%WCA: Enabled local MACs: 44A8421032E2 17/03/01 04:12:39 INFO tcp.TcpDiscoverySpi: Successfully bound to TCP port [port=47500, localHost=0.0.0.0/0.0.0.0, locNodeId=d4a9fe7f-de19-4df7-874c-a084da78562f] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=5bc51e21-1dcf-498a-b87e-6dd24f7e36ad, addrs=[8, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/8:47500], discPort=47500, order=7, intOrder=7, lastExchangeTime=1488363159990, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=7, servers=7, clients=0, CPUs=312, heap=130.0GB] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=daed0152-83fc-4828-ada6-64c74787b190, addrs=[, 127.0.0.1], sockAddrs=[hostName/:47500, /127.0.0.1:47500], discPort=47500, order=8, intOrder=8, lastExchangeTime=1488363160020, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=8, servers=8, clients=0, CPUs=352, heap=140.0GB] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=29716cf1-ed55-4550-82bd-cf980a0aee2c, addrs=[, 127.0.0.1], sockAddrs=[hostName/:47501, /127.0.0.1:47501], discPort=47501, order=9, intOrder=9, lastExchangeTime=1488363160041, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=9, servers=9, clients=0, CPUs=392, heap=160.0GB] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=717de453-fc6b-4a46-91b2-b5c54ab8a4be, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=10, intOrder=10, lastExchangeTime=1488363160051, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=10, servers=10, clients=0, CPUs=432, heap=170.0GB] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=ffe19475-7849-4027-8648-ce56598ff50f, addrs=[7, 127.0.0.1], sockAddrs=[/127.0.0.1:47501, hostName/7:47501], discPort=47501, order=11, intOrder=11, lastExchangeTime=1488363160051, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=11, servers=11, clients=0, CPUs=472, heap=190.0GB] 17/03/01 04:12:40 INFO cache.GridCacheProcessor: Started cache [name=ignite-sys-cache, mode=REPLICATED] 17/03/01 04:12:40 INFO cache.GridCacheProcessor: Started cache [name=ignite-atomics-sys-cache, mode=PARTITIONED] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=8be1bd05-d62c-4f1a-83f2-91dcb3f3b62a, addrs=[07, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/07:47500], discPort=47500, order=12, intOrder=12, lastExchangeTime=1488363160061, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=12, servers=12, clients=0, CPUs=504, heap=200.0GB] 17/03/01 04:12:40 INFO cache.GridCacheProcessor: Started cache [name=WCAIgniteCache, mode=PARTITIONED] 17/03/01 04:12:40 INFO cache.GridCacheProcessor: Started cache [name=ignite-marshaller-sys-cache, mode=REPLICATED] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=133c388f-3399-4cc8-b2f1-7ae8ba971b03, addrs=[7, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/7:47500], discPort=47500, order=13, intOrder=13, lastExchangeTime=1488363160081, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=13, servers=13, clients=0, CPUs=544, heap=220.0GB] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=23f61699-e2c9-4ff6-8731-2483934e84c4, addrs=[0, 127.0.0.1], sockAddrs=[hostName/0:47500, /127.0.0.1:47500], discPort=47500, order=14, intOrder=14, lastExchangeTime=1488363160091, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=14, servers=14, clients=0, CPUs=584, heap=230.0GB] 17/03/01 04:12:40 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=6, minorTopVer=0], evt=NODE_JOINED, node=d4a9fe7f-de19-4df7-874c-a084da78562f] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=95f164b5-4b73-438f-804f-62854d615b5b, addrs=[9, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/9:47500], discPort=47500, order=15, intOrder=15, lastExchangeTime=1488363160101, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=15, servers=15, clients=0, CPUs=624, heap=250.0GB] 17/03/01 04:12:41 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=7, minorTopVer=0], evt=NODE_JOINED, node=5bc51e21-1dcf-498a-b87e-6dd24f7e36ad] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=c4f4f6bb-b71a-4a29-9575-afee2ddc1b2d, addrs=[6, 127.0.0.1], sockAddrs=[hostName/6:47500, /127.0.0.1:47500], discPort=47500, order=16, intOrder=16, lastExchangeTime=1488363160101, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=16, servers=16, clients=0, CPUs=664, heap=260.0GB] 17/03/01 04:12:41 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=8, minorTopVer=0], evt=NODE_JOINED, node=daed0152-83fc-4828-ada6-64c74787b190] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=ddc47224-d030-4d1f-ba66-08f61368a395, addrs=[4, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/4:47500], discPort=47500, order=17, intOrder=17, lastExchangeTime=1488363160111, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=17, servers=17, clients=0, CPUs=704, heap=280.0GB] 17/03/01 04:12:41 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=9, minorTopVer=0], evt=NODE_JOINED, node=29716cf1-ed55-4550-82bd-cf980a0aee2c] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=47c1a0d8-9d4d-4d0d-9b27-388bd7f49278, addrs=[1, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/1:47500], discPort=47500, order=18, intOrder=18, lastExchangeTime=1488363160111, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=18, servers=18, clients=0, CPUs=744, heap=290.0GB] 17/03/01 04:12:41 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=10, minorTopVer=0], evt=NODE_JOINED, node=717de453-fc6b-4a46-91b2-b5c54ab8a4be] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=e87f12ce-5981-4418-8468-f6bfed0a0cd8, addrs=[6, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/6:47500], discPort=47500, order=19, intOrder=19, lastExchangeTime=1488363160121, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=19, servers=19, clients=0, CPUs=784, heap=310.0GB] 17/03/01 04:12:41 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=11, minorTopVer=0], evt=NODE_JOINED, node=ffe19475-7849-4027-8648-ce56598ff50f] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=e2cba212-89dd-48dd-8d7e-821b5725fe03, addrs=[8, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/8:47500], discPort=47500, order=20, intOrder=20, lastExchangeTime=1488363160141, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=20, servers=20, clients=0, CPUs=816, heap=320.0GB] 17/03/01 04:12:41 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=12, minorTopVer=0], evt=NODE_JOINED, node=8be1bd05-d62c-4f1a-83f2-91dcb3f3b62a] 17/03/01 04:12:41 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=13, minorTopVer=0], evt=NODE_JOINED, node=133c388f-3399-4cc8-b2f1-7ae8ba971b03] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=f9ce8dd7-2060-4c34-b597-d7bee86ebedb, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=21, intOrder=21, lastExchangeTime=1488363160172, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=21, servers=21, clients=0, CPUs=856, heap=340.0GB] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=14, minorTopVer=0], evt=NODE_JOINED, node=23f61699-e2c9-4ff6-8731-2483934e84c4] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=6b1889dd-9de5-4f1b-8ec9-c123c7df8ea2, addrs=[, 127.0.0.1], sockAddrs=[hostName/:47500, /127.0.0.1:47500], discPort=47500, order=22, intOrder=22, lastExchangeTime=1488363160232, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=22, servers=22, clients=0, CPUs=896, heap=350.0GB] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=15, minorTopVer=0], evt=NODE_JOINED, node=95f164b5-4b73-438f-804f-62854d615b5b] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=9fb6e583-cea0-4f78-b403-b403a8bc9a0e, addrs=[7, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/7:47500], discPort=47500, order=23, intOrder=23, lastExchangeTime=1488363160242, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=23, servers=23, clients=0, CPUs=936, heap=370.0GB] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=20860cae-2881-4311-a3f5-edaa160ef37f, addrs=[7, 127.0.0.1], sockAddrs=[hostName/7:47500, /127.0.0.1:47500], discPort=47500, order=24, intOrder=24, lastExchangeTime=1488363160252, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=24, servers=24, clients=0, CPUs=976, heap=380.0GB] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=16, minorTopVer=0], evt=NODE_JOINED, node=c4f4f6bb-b71a-4a29-9575-afee2ddc1b2d] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=0d675d57-b9b9-4cff-a994-77337d618bbe, addrs=[4, 127.0.0.1], sockAddrs=[hostName/4:47500, /127.0.0.1:47500], discPort=47500, order=25, intOrder=25, lastExchangeTime=1488363160252, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=25, servers=25, clients=0, CPUs=1016, heap=400.0GB] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=17, minorTopVer=0], evt=NODE_JOINED, node=ddc47224-d030-4d1f-ba66-08f61368a395] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=a6343860-6e84-4d9c-9b87-84ffd76280cd, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=26, intOrder=26, lastExchangeTime=1488363160262, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=26, servers=26, clients=0, CPUs=1056, heap=410.0GB] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=18, minorTopVer=0], evt=NODE_JOINED, node=47c1a0d8-9d4d-4d0d-9b27-388bd7f49278] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=19, minorTopVer=0], evt=NODE_JOINED, node=e87f12ce-5981-4418-8468-f6bfed0a0cd8] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=479b18e6-54af-4313-85f7-c7525f6229a4, addrs=[, 127.0.0.1], sockAddrs=[hostName/:47500, /127.0.0.1:47500], discPort=47500, order=27, intOrder=27, lastExchangeTime=1488363160353, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=27, servers=27, clients=0, CPUs=1104, heap=430.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=20, minorTopVer=0], evt=NODE_JOINED, node=e2cba212-89dd-48dd-8d7e-821b5725fe03] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=058a99e8-3b65-4ec9-84b0-6f3502c2afce, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=28, intOrder=28, lastExchangeTime=1488363160636, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=28, servers=28, clients=0, CPUs=1144, heap=440.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=21, minorTopVer=0], evt=NODE_JOINED, node=f9ce8dd7-2060-4c34-b597-d7bee86ebedb] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=57c09d88-a4dc-4179-98b4-1144fd97d8cc, addrs=[35, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/35:47500], discPort=47500, order=29, intOrder=29, lastExchangeTime=1488363160676, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=29, servers=29, clients=0, CPUs=1192, heap=460.0GB] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=58298821-7aa9-4b58-ba15-e7f1ef2830fb, addrs=[3, 127.0.0.1], sockAddrs=[hostName/3:47500, /127.0.0.1:47500], discPort=47500, order=30, intOrder=30, lastExchangeTime=1488363160676, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=30, servers=30, clients=0, CPUs=1232, heap=470.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=22, minorTopVer=0], evt=NODE_JOINED, node=6b1889dd-9de5-4f1b-8ec9-c123c7df8ea2] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4d5de2f3-d975-4b28-b593-0cc0481cdc74, addrs=[03, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/03:47500], discPort=47500, order=31, intOrder=31, lastExchangeTime=1488363160787, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=31, servers=31, clients=0, CPUs=1280, heap=490.0GB] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=fa09caab-f4dc-43b6-ac8b-4a4bae6e7da6, addrs=[01, 127.0.0.1], sockAddrs=[hostName/01:47500, /127.0.0.1:47500], discPort=47500, order=32, intOrder=32, lastExchangeTime=1488363161452, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=32, servers=32, clients=0, CPUs=1320, heap=500.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=23, minorTopVer=0], evt=NODE_JOINED, node=9fb6e583-cea0-4f78-b403-b403a8bc9a0e] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=24, minorTopVer=0], evt=NODE_JOINED, node=20860cae-2881-4311-a3f5-edaa160ef37f] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=af5837f0-25ec-4f3d-a1c1-90c09dc424cb, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=33, intOrder=33, lastExchangeTime=1488363161583, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=33, servers=33, clients=0, CPUs=1360, heap=520.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=25, minorTopVer=0], evt=NODE_JOINED, node=0d675d57-b9b9-4cff-a994-77337d618bbe] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=e9e49d2d-5eeb-474f-8757-e447efc8ca8f, addrs=[6, 127.0.0.1], sockAddrs=[hostName/6:47500, /127.0.0.1:47500], discPort=47500, order=34, intOrder=34, lastExchangeTime=1488363161593, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=34, servers=34, clients=0, CPUs=1400, heap=530.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=26, minorTopVer=0], evt=NODE_JOINED, node=a6343860-6e84-4d9c-9b87-84ffd76280cd] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4b90e5a3-253a-435b-84ca-6b592610cf0c, addrs=[4, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/4:47500], discPort=47500, order=35, intOrder=35, lastExchangeTime=1488363161593, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=35, servers=35, clients=0, CPUs=1432, heap=550.0GB] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=8fd4eea2-2a45-4563-ae87-1848fd388a98, addrs=[3, 127.0.0.1], sockAddrs=[hostName/3:47500, /127.0.0.1:47500], discPort=47500, order=36, intOrder=36, lastExchangeTime=1488363161593, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=36, servers=36, clients=0, CPUs=1472, heap=560.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=27, minorTopVer=0], evt=NODE_JOINED, node=479b18e6-54af-4313-85f7-c7525f6229a4] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=28, minorTopVer=0], evt=NODE_JOINED, node=058a99e8-3b65-4ec9-84b0-6f3502c2afce] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=d7b45a02-0411-4028-acdf-f004e592f294, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=37, intOrder=37, lastExchangeTime=1488363161895, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=37, servers=37, clients=0, CPUs=1512, heap=580.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=29, minorTopVer=0], evt=NODE_JOINED, node=57c09d88-a4dc-4179-98b4-1144fd97d8cc] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=cf4e6e83-207e-42da-a55c-5621bc20b891, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=38, intOrder=38, lastExchangeTime=1488363162650, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=38, servers=38, clients=0, CPUs=1552, heap=590.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=30, minorTopVer=0], evt=NODE_JOINED, node=58298821-7aa9-4b58-ba15-e7f1ef2830fb] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=d8926a2c-2c00-4445-beb4-633c2d656c41, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=39, intOrder=39, lastExchangeTime=1488363162661, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=39, servers=39, clients=0, CPUs=1584, heap=610.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=31, minorTopVer=0], evt=NODE_JOINED, node=4d5de2f3-d975-4b28-b593-0cc0481cdc74] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4136a0c9-14d5-42b3-9a60-81689c800438, addrs=[3, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/3:47500], discPort=47500, order=40, intOrder=40, lastExchangeTime=1488363162883, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=40, servers=40, clients=0, CPUs=1624, heap=620.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=32, minorTopVer=0], evt=NODE_JOINED, node=fa09caab-f4dc-43b6-ac8b-4a4bae6e7da6] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=694a80b8-02a3-44c9-a2dd-45bed7d20a50, addrs=[1, 127.0.0.1], sockAddrs=[hostName/1:47500, /127.0.0.1:47500], discPort=47500, order=41, intOrder=41, lastExchangeTime=1488363162893, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=41, servers=41, clients=0, CPUs=1664, heap=640.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=33, minorTopVer=0], evt=NODE_JOINED, node=af5837f0-25ec-4f3d-a1c1-90c09dc424cb] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=34, minorTopVer=0], evt=NODE_JOINED, node=e9e49d2d-5eeb-474f-8757-e447efc8ca8f] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=35, minorTopVer=0], evt=NODE_JOINED, node=4b90e5a3-253a-435b-84ca-6b592610cf0c] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=36, minorTopVer=0], evt=NODE_JOINED, node=8fd4eea2-2a45-4563-ae87-1848fd388a98] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=37, minorTopVer=0], evt=NODE_JOINED, node=d7b45a02-0411-4028-acdf-f004e592f294] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=38, minorTopVer=0], evt=NODE_JOINED, node=cf4e6e83-207e-42da-a55c-5621bc20b891] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=39, minorTopVer=0], evt=NODE_JOINED, node=d8926a2c-2c00-4445-beb4-633c2d656c41] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=40, minorTopVer=0], evt=NODE_JOINED, node=4136a0c9-14d5-42b3-9a60-81689c800438] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-sys-cache, waitList=[]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-marshaller-sys-cache, waitList=[]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-atomics-sys-cache, waitList=[ignite-sys-cache, ignite-marshaller-sys-cache]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=WCAIgniteCache, waitList=[ignite-sys-cache, ignite-marshaller-sys-cache, ignite-atomics-sys-cache]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Rebalancing required [top=AffinityTopologyVersion [topVer=41, minorTopVer=0], evt=NODE_JOINED, node=694a80b8-02a3-44c9-a2dd-45bed7d20a50] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-marshaller-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=20, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=36] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=100, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=36] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-marshaller-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=21 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=21 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-atomics-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=27, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=36] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-atomics-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=0 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=WCAIgniteCache, mode=ASYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=27, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=36] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=WCAIgniteCache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=0 ms] 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: >>> +----------------------------------------------------------------------+ >>> Ignite ver. 1.8.0#20161205-sha1:9ca40dbeb7d559fcb299bdb6f5c90cdf8ce7e533 >>> +----------------------------------------------------------------------+ >>> OS name: Linux 2.6.32-431.5.1.el6.x86_64 amd64 >>> CPU(s): 40 >>> Heap: 15.0GB >>> VM name: 4053@hostName >>> Grid name: WCA >>> Local node [ID=D4A9FE7F-DE19-4DF7-874C-A084DA78562F, order=6, clientMode=false] >>> Local node addresses: [hostName/4, /127.0.0.1] >>> Local ports: TCP:11211 TCP:47100 TCP:47500 TCP:48100 17/03/01 04:12:47 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=6, servers=6, clients=0, CPUs=272, heap=110.0GB] 17/03/01 04:12:47 INFO resolver.CompanyResolverSparkTest: Started ignite node on executor 17/03/01 04:12:47 INFO executor.Executor: Finished task 17.0 in stage 4.0 (TID 139). 931 bytes result sent to driver 17/03/01 04:12:49 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=41, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, node=6172ee3a-eb33-4bf5-9080-c255f52caed8] 17/03/01 04:12:52 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 192 17/03/01 04:12:52 INFO executor.Executor: Running task 19.0 in stage 5.0 (TID 192) 17/03/01 04:12:52 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 128 17/03/01 04:12:52 INFO storage.MemoryStore: ensureFreeSpace(7311) called with curMem=0, maxMem=8334920908 17/03/01 04:12:52 INFO storage.MemoryStore: Block broadcast_128_piece0 stored as bytes in memory (estimated size 7.1 KB, free 7.8 GB) 17/03/01 04:12:52 INFO broadcast.TorrentBroadcast: Reading broadcast variable 128 took 11 ms 17/03/01 04:12:52 INFO storage.MemoryStore: ensureFreeSpace(28168) called with curMem=7311, maxMem=8334920908 17/03/01 04:12:52 INFO storage.MemoryStore: Block broadcast_128 stored as values in memory (estimated size 27.5 KB, free 7.8 GB) 17/03/01 04:12:53 INFO rdd.HadoopRDD: Input split: avro path/part-r-00026-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:37540068+37540069 17/03/01 04:12:53 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 97 17/03/01 04:12:53 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=35479, maxMem=8334920908 17/03/01 04:12:53 INFO storage.MemoryStore: Block broadcast_97_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:12:53 INFO broadcast.TorrentBroadcast: Reading broadcast variable 97 took 10 ms 17/03/01 04:12:53 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=60122, maxMem=8334920908 17/03/01 04:12:53 INFO storage.MemoryStore: Block broadcast_97 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:12:54 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 17/03/01 04:12:54 INFO Configuration.deprecation: mapred.tip.id is deprecated. Instead, use mapreduce.task.id 17/03/01 04:12:54 INFO Configuration.deprecation: mapred.task.id is deprecated. Instead, use mapreduce.task.attempt.id 17/03/01 04:12:54 INFO Configuration.deprecation: mapred.task.is.map is deprecated. Instead, use mapreduce.task.ismap 17/03/01 04:12:54 INFO Configuration.deprecation: mapred.task.partition is deprecated. Instead, use mapreduce.task.partition 17/03/01 04:12:54 INFO Configuration.deprecation: mapred.job.id is deprecated. Instead, use mapreduce.job.id 17/03/01 04:12:54 WARN security.UserGroupInformation: PriviledgedActionException as:userName (auth:SIMPLE) cause:org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:12:54 WARN ipc.Client: Exception encountered while connecting to the server : org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:12:54 WARN security.UserGroupInformation: PriviledgedActionException as:userName (auth:SIMPLE) cause:org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:13:01 INFO executor.Executor: Finished task 19.0 in stage 5.0 (TID 192). 2098 bytes result sent to driver 17/03/01 04:13:47 INFO internal.IgniteKernal%WCA: Metrics for local node (to disable set 'metricsLogFrequency' to 0) ^-- Node [id=d4a9fe7f, name=WCA, uptime=00:01:00:002] ^-- H/N/C [hosts=41, nodes=41, CPUs=1664] ^-- CPU [cur=2.33%, avg=2.81%, GC=0%] ^-- Heap [used=2925MB, free=80.44%, comm=14954MB] ^-- Non heap [used=115MB, free=-1%, comm=117MB] ^-- Public thread pool [active=0, idle=0, qSize=0] ^-- System thread pool [active=0, idle=80, qSize=0] ^-- Outbound messages queue [size=0] 17/03/01 04:13:50 INFO cluster.GridUpdateNotifier: Update status is not available. 17/03/01 04:14:00 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 243 17/03/01 04:14:00 INFO executor.Executor: Running task 1.0 in stage 6.0 (TID 243) 17/03/01 04:14:00 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 130 17/03/01 04:14:00 INFO storage.MemoryStore: ensureFreeSpace(1829) called with curMem=407194, maxMem=8334920908 17/03/01 04:14:00 INFO storage.MemoryStore: Block broadcast_130_piece0 stored as bytes in memory (estimated size 1829.0 B, free 7.8 GB) 17/03/01 04:14:00 INFO broadcast.TorrentBroadcast: Reading broadcast variable 130 took 29 ms 17/03/01 04:14:00 INFO storage.MemoryStore: ensureFreeSpace(3160) called with curMem=409023, maxMem=8334920908 17/03/01 04:14:00 INFO storage.MemoryStore: Block broadcast_130 stored as values in memory (estimated size 3.1 KB, free 7.8 GB) 17/03/01 04:14:00 INFO rdd.HadoopRDD: Input split: hdfs://Venus/project/ecpcibermuda/companyNamesample/test.txt:8229+8229 17/03/01 04:14:00 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 129 17/03/01 04:14:00 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=412183, maxMem=8334920908 17/03/01 04:14:00 INFO storage.MemoryStore: Block broadcast_129_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:14:00 INFO broadcast.TorrentBroadcast: Reading broadcast variable 129 took 27 ms 17/03/01 04:14:00 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=436826, maxMem=8334920908 17/03/01 04:14:00 INFO storage.MemoryStore: Block broadcast_129 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:14:00 ERROR lzo.GPLNativeCodeLoader: Could not load native gpl library java.lang.UnsatisfiedLinkError: no gplcompression in java.library.path at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1864) at java.lang.Runtime.loadLibrary0(Runtime.java:870) at java.lang.System.loadLibrary(System.java:1122) at com.hadoop.compression.lzo.GPLNativeCodeLoader.(GPLNativeCodeLoader.java:32) at com.hadoop.compression.lzo.LzoCodec.(LzoCodec.java:71) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:348) at org.apache.hadoop.conf.Configuration.getClassByNameOrNull(Configuration.java:2138) at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2103) at org.apache.hadoop.io.compress.CompressionCodecFactory.getCodecClasses(CompressionCodecFactory.java:128) at org.apache.hadoop.io.compress.CompressionCodecFactory.(CompressionCodecFactory.java:175) at org.apache.hadoop.mapred.TextInputFormat.configure(TextInputFormat.java:45) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:106) at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:75) at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:133) at org.apache.spark.rdd.HadoopRDD.getInputFormat(HadoopRDD.scala:190) at org.apache.spark.rdd.HadoopRDD$$anon$1.(HadoopRDD.scala:236) at org.apache.spark.rdd.HadoopRDD.compute(HadoopRDD.scala:216) at org.apache.spark.rdd.HadoopRDD.compute(HadoopRDD.scala:101) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:297) at org.apache.spark.rdd.RDD.iterator(RDD.scala:264) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:38) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:297) at org.apache.spark.rdd.RDD.iterator(RDD.scala:264) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:66) at org.apache.spark.scheduler.Task.run(Task.scala:88) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:214) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 17/03/01 04:14:00 ERROR lzo.LzoCodec: Cannot load native-lzo without native-hadoop 17/03/01 04:14:00 INFO executor.Executor: Finished task 1.0 in stage 6.0 (TID 243). 10441 bytes result sent to driver 17/03/01 04:14:00 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 266 17/03/01 04:14:00 INFO executor.Executor: Running task 22.0 in stage 7.0 (TID 266) 17/03/01 04:14:00 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 131 17/03/01 04:14:00 INFO storage.MemoryStore: ensureFreeSpace(2732) called with curMem=783898, maxMem=8334920908 17/03/01 04:14:00 INFO storage.MemoryStore: Block broadcast_131_piece0 stored as bytes in memory (estimated size 2.7 KB, free 7.8 GB) 17/03/01 04:14:00 INFO broadcast.TorrentBroadcast: Reading broadcast variable 131 took 18 ms 17/03/01 04:14:00 INFO storage.MemoryStore: ensureFreeSpace(7336) called with curMem=786630, maxMem=8334920908 17/03/01 04:14:00 INFO storage.MemoryStore: Block broadcast_131 stored as values in memory (estimated size 7.2 KB, free 7.8 GB) 17/03/01 04:14:00 INFO dao.CompanyDAO: input company name inside Contains searchFRIENDSHIP VILLAGE OF COLUMBUS OHIO 17/03/01 04:14:10 ERROR executor.Executor: Exception in task 22.0 in stage 7.0 (TID 266) javax.cache.CacheException: class org.apache.ignite.IgniteCheckedException: Query execution failed: GridCacheQueryBean [qry=GridCacheQueryAdapter [type=TEXT, clsName=CompanyVO1, clause=FRIENDSHIP VILLAGE OF COLUMBUS OHIO, filter=null, transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=true, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=d4a9fe7f-de19-4df7-874c-a084da78562f, taskHash=0], rdc=null, trans=null] at org.apache.ignite.internal.processors.cache.GridCacheUtils.convertToCacheException(GridCacheUtils.java:1440) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.next(GridCacheQueryFutureAdapter.java:174) at org.apache.ignite.internal.processors.cache.IgniteCacheProxy$5.onHasNext(IgniteCacheProxy.java:600) at org.apache.ignite.internal.util.GridCloseableIteratorAdapter.hasNextX(GridCloseableIteratorAdapter.java:53) at org.apache.ignite.internal.util.lang.GridIteratorAdapter.hasNext(GridIteratorAdapter.java:45) at un.api.resolver.dao.CompanyDAO.getVarCompContains(CompanyDAO.scala:242) at un.api.resolver.accessor.CompanyAccessor.getVarCompContains(CompanyAccessor.scala:27) at un.api.resolver.CompanyResolverSparkTest$$anonfun$main$7.apply(CompanyResolverSparkTest.scala:291) at un.api.resolver.CompanyResolverSparkTest$$anonfun$main$7.apply(CompanyResolverSparkTest.scala:289) at scala.collection.Iterator$$anon$11.next(Iterator.scala:328) at org.apache.spark.util.Utils$.getIteratorSize(Utils.scala:1554) at org.apache.spark.rdd.RDD$$anonfun$count$1.apply(RDD.scala:1121) at org.apache.spark.rdd.RDD$$anonfun$count$1.apply(RDD.scala:1121) at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1850) at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1850) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:66) at org.apache.spark.scheduler.Task.run(Task.scala:88) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:214) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: class org.apache.ignite.IgniteCheckedException: Query execution failed: GridCacheQueryBean [qry=GridCacheQueryAdapter [type=TEXT, clsName=CompanyVO1, clause=FRIENDSHIP VILLAGE OF COLUMBUS OHIO, filter=null, transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=true, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=d4a9fe7f-de19-4df7-874c-a084da78562f, taskHash=0], rdc=null, trans=null] at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.checkError(GridCacheQueryFutureAdapter.java:260) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.internalIterator(GridCacheQueryFutureAdapter.java:318) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.next(GridCacheQueryFutureAdapter.java:164) ... 19 more Caused by: class org.apache.ignite.IgniteCheckedException: Failed to execute query on node [query=GridCacheQueryBean [qry=GridCacheQueryAdapter [type=TEXT, clsName=CompanyVO1, clause=FRIENDSHIP VILLAGE OF COLUMBUS OHIO, filter=null, transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=true, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=d4a9fe7f-de19-4df7-874c-a084da78562f, taskHash=0], rdc=null, trans=null], nodeId=20860cae-2881-4311-a3f5-edaa160ef37f] at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.onPage(GridCacheQueryFutureAdapter.java:383) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.processQueryResponse(GridCacheDistributedQueryManager.java:398) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.access$000(GridCacheDistributedQueryManager.java:63) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$1.apply(GridCacheDistributedQueryManager.java:93) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$1.apply(GridCacheDistributedQueryManager.java:91) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.processMessage(GridCacheIoManager.java:827) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.onMessage0(GridCacheIoManager.java:369) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.access$400(GridCacheIoManager.java:95) at org.apache.ignite.internal.processors.cache.GridCacheIoManager$OrderedMessageListener.onMessage(GridCacheIoManager.java:1345) at org.apache.ignite.internal.managers.communication.GridIoManager.invokeListener(GridIoManager.java:1082) at org.apache.ignite.internal.managers.communication.GridIoManager.access$1600(GridIoManager.java:102) at org.apache.ignite.internal.managers.communication.GridIoManager$GridCommunicationMessageSet.unwind(GridIoManager.java:2332) at org.apache.ignite.internal.managers.communication.GridIoManager.unwindMessageSet(GridIoManager.java:1042) at org.apache.ignite.internal.managers.communication.GridIoManager.access$1900(GridIoManager.java:102) at org.apache.ignite.internal.managers.communication.GridIoManager$6.run(GridIoManager.java:1011) ... 3 more Caused by: java.lang.NullPointerException 17/03/01 04:14:10 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=9fb6e583-cea0-4f78-b403-b403a8bc9a0e, res=GridCacheQueryResponse [finished=false, reqId=382, err=null, fields=false, metadata=null]] 17/03/01 04:14:10 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=ffe19475-7849-4027-8648-ce56598ff50f, res=GridCacheQueryResponse [finished=true, reqId=382, err=null, fields=false, metadata=null]] 17/03/01 04:14:10 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=d8926a2c-2c00-4445-beb4-633c2d656c41, res=GridCacheQueryResponse [finished=true, reqId=382, err=null, fields=false, metadata=null]] 17/03/01 04:14:10 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=57c09d88-a4dc-4179-98b4-1144fd97d8cc, res=GridCacheQueryResponse [finished=false, reqId=382, err=null, fields=false, metadata=null]] 17/03/01 04:14:10 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=5bc51e21-1dcf-498a-b87e-6dd24f7e36ad, res=GridCacheQueryResponse [finished=false, reqId=382, err=null, fields=false, metadata=null]] 17/03/01 04:14:10 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=90532831-88fb-4eb8-adc9-db7a86744869, res=GridCacheQueryResponse [finished=false, reqId=382, err=null, fields=false, metadata=null]] 17/03/01 04:14:10 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=40d089f0-7c80-4f1f-8659-350791f57a4c, res=GridCacheQueryResponse [finished=false, reqId=382, err=null, fields=false, metadata=null]] 17/03/01 04:14:11 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=4136a0c9-14d5-42b3-9a60-81689c800438, res=GridCacheQueryResponse [finished=false, reqId=382, err=null, fields=false, metadata=null]] 17/03/01 04:14:11 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 290 17/03/01 04:14:11 INFO executor.Executor: Running task 22.1 in stage 7.0 (TID 290) 17/03/01 04:14:17 INFO executor.Executor: Finished task 22.1 in stage 7.0 (TID 290). 969 bytes result sent to driver 17/03/01 04:14:47 INFO internal.IgniteKernal%WCA: Metrics for local node (to disable set 'metricsLogFrequency' to 0) ^-- Node [id=d4a9fe7f, name=WCA, uptime=00:02:00:020] ^-- H/N/C [hosts=41, nodes=41, CPUs=1664] ^-- CPU [cur=0.2%, avg=2.45%, GC=0%] ^-- Heap [used=1265MB, free=91.35%, comm=14642MB] ^-- Non heap [used=119MB, free=-1%, comm=121MB] ^-- Public thread pool [active=0, idle=0, qSize=0] ^-- System thread pool [active=0, idle=80, qSize=0] ^-- Outbound messages queue [size=0] 17/03/01 04:14:49 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 324 17/03/01 04:14:49 INFO executor.Executor: Running task 11.0 in stage 8.0 (TID 324) 17/03/01 04:14:49 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 132 17/03/01 04:14:49 INFO storage.MemoryStore: ensureFreeSpace(887) called with curMem=417262, maxMem=8334920908 17/03/01 04:14:49 INFO storage.MemoryStore: Block broadcast_132_piece0 stored as bytes in memory (estimated size 887.0 B, free 7.8 GB) 17/03/01 04:14:49 INFO broadcast.TorrentBroadcast: Reading broadcast variable 132 took 69 ms 17/03/01 04:14:49 INFO storage.MemoryStore: ensureFreeSpace(1216) called with curMem=418149, maxMem=8334920908 17/03/01 04:14:49 INFO storage.MemoryStore: Block broadcast_132 stored as values in memory (estimated size 1216.0 B, free 7.8 GB) 17/03/01 04:14:49 INFO tcp.GridTcpRestProtocol: Command protocol successfully stopped: TCP binary 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=4136a0c9-14d5-42b3-9a60-81689c800438, addrs=[3, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/3:47500], discPort=47500, order=40, intOrder=40, lastExchangeTime=1488363162883, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=42, servers=40, clients=0, CPUs=1624, heap=620.0GB] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=cf4e6e83-207e-42da-a55c-5621bc20b891, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=38, intOrder=38, lastExchangeTime=1488363162650, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=43, servers=39, clients=0, CPUs=1584, heap=610.0GB] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=d8926a2c-2c00-4445-beb4-633c2d656c41, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=39, intOrder=39, lastExchangeTime=1488363162661, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=44, servers=38, clients=0, CPUs=1552, heap=590.0GB] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=e9e49d2d-5eeb-474f-8757-e447efc8ca8f, addrs=[6, 127.0.0.1], sockAddrs=[hostName/6:47500, /127.0.0.1:47500], discPort=47500, order=34, intOrder=34, lastExchangeTime=1488363161593, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=45, servers=37, clients=0, CPUs=1512, heap=580.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=57c09d88-a4dc-4179-98b4-1144fd97d8cc, addrs=[35, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/35:47500], discPort=47500, order=29, intOrder=29, lastExchangeTime=1488363160676, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=46, servers=36, clients=0, CPUs=1464, heap=560.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=0d675d57-b9b9-4cff-a994-77337d618bbe, addrs=[4, 127.0.0.1], sockAddrs=[hostName/4:47500, /127.0.0.1:47500], discPort=47500, order=25, intOrder=25, lastExchangeTime=1488363160252, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=47, servers=35, clients=0, CPUs=1424, heap=550.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=a6343860-6e84-4d9c-9b87-84ffd76280cd, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=26, intOrder=26, lastExchangeTime=1488363160262, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=48, servers=34, clients=0, CPUs=1384, heap=530.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=9fb6e583-cea0-4f78-b403-b403a8bc9a0e, addrs=[7, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/7:47500], discPort=47500, order=23, intOrder=23, lastExchangeTime=1488363160242, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=49, servers=33, clients=0, CPUs=1344, heap=520.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=23f61699-e2c9-4ff6-8731-2483934e84c4, addrs=[0, 127.0.0.1], sockAddrs=[hostName/0:47500, /127.0.0.1:47500], discPort=47500, order=14, intOrder=14, lastExchangeTime=1488363160091, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=50, servers=32, clients=0, CPUs=1304, heap=500.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=ddc47224-d030-4d1f-ba66-08f61368a395, addrs=[4, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/4:47500], discPort=47500, order=17, intOrder=17, lastExchangeTime=1488363160111, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=51, servers=31, clients=0, CPUs=1264, heap=490.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=e87f12ce-5981-4418-8468-f6bfed0a0cd8, addrs=[6, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/6:47500], discPort=47500, order=19, intOrder=19, lastExchangeTime=1488363160121, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=52, servers=30, clients=0, CPUs=1224, heap=470.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=40d089f0-7c80-4f1f-8659-350791f57a4c, addrs=[37, 127.0.0.1], sockAddrs=[hostName/37:47500, /127.0.0.1:47500], discPort=47500, order=4, intOrder=4, lastExchangeTime=1488363159950, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=53, servers=29, clients=0, CPUs=1176, heap=460.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=29716cf1-ed55-4550-82bd-cf980a0aee2c, addrs=[, 127.0.0.1], sockAddrs=[hostName/:47501, /127.0.0.1:47501], discPort=47501, order=9, intOrder=9, lastExchangeTime=1488363160041, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=54, servers=28, clients=0, CPUs=1136, heap=440.0GB] 17/03/01 04:14:51 WARN tcp.TcpDiscoverySpi: Failed to ping node (status check will be initiated): 8fd4eea2-2a45-4563-ae87-1848fd388a98 17/03/01 04:14:52 INFO cache.GridCacheProcessor: Stopped cache: ignite-marshaller-sys-cache 17/03/01 04:14:52 INFO cache.GridCacheProcessor: Stopped cache: ignite-sys-cache 17/03/01 04:14:52 INFO cache.GridCacheProcessor: Stopped cache: ignite-atomics-sys-cache 17/03/01 04:14:52 INFO cache.GridCacheProcessor: Stopped cache: WCAIgniteCache 17/03/01 04:14:53 INFO internal.IgniteKernal%WCA: >>> +---------------------------------------------------------------------------------+ >>> Ignite ver. 1.8.0#20161205-sha1:9ca40dbeb7d559fcb299bdb6f5c90cdf8ce7e533 stopped OK >>> +---------------------------------------------------------------------------------+ >>> Grid name: WCA >>> Grid uptime: 00:02:05:562 17/03/01 04:14:53 INFO executor.Executor: Finished task 11.0 in stage 8.0 (TID 324). 931 bytes result sent to driver 17/03/01 04:14:53 INFO executor.CoarseGrainedExecutorBackend: Driver commanded a shutdown 17/03/01 04:14:53 INFO storage.MemoryStore: MemoryStore cleared 17/03/01 04:14:53 INFO storage.BlockManager: BlockManager stopped 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Shutting down remote daemon. 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remote daemon shut down; proceeding with flushing remote transports. 17/03/01 04:14:53 INFO Remoting: Remoting shut down 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remoting shut down. 17/03/01 04:14:53 INFO util.ShutdownHookManager: Shutdown hook called LogType:stdout Log Upload Time:Wed Mar 01 04:14:58 -0600 2017 LogLength:5248 Log Contents: rEnd of the programe - [04:12:38] __________ ________________ [04:12:38] / _/ ___/ |/ / _/_ __/ __/ [04:12:38] _/ // (7 7 // / / / / _/ [04:12:38] /___/\___/_/|_/___/ /_/ /___/ [04:12:38] [04:12:38] ver. 1.8.0#20161205-sha1:9ca40dbe [04:12:38] 2016 Copyright(C) Apache Software Foundation [04:12:38] [04:12:38] Ignite documentation: http://ignite.apache.org [04:12:38] [04:12:38] Quiet mode. [04:12:38] ^-- To see **FULL** console log here add -DIGNITE_QUIET=false or "-v" to ignite.{sh|bat} [04:12:38] [04:12:38] OS: Linux 2.6.32-431.5.1.el6.x86_64 amd64 [04:12:38] VM information: Java(TM) SE Runtime Environment 1.8.0_60-b27 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.60-b23 [04:12:38] Configured plugins: [04:12:38] ^-- None [04:12:38] [04:12:38] Security status [authentication=off, tls/ssl=off] [04:12:40] Topology snapshot [ver=7, servers=7, clients=0, CPUs=312, heap=130.0GB] [04:12:40] Topology snapshot [ver=8, servers=8, clients=0, CPUs=352, heap=140.0GB] [04:12:40] Topology snapshot [ver=9, servers=9, clients=0, CPUs=392, heap=160.0GB] [04:12:40] Topology snapshot [ver=10, servers=10, clients=0, CPUs=432, heap=170.0GB] [04:12:40] Topology snapshot [ver=11, servers=11, clients=0, CPUs=472, heap=190.0GB] [04:12:40] Topology snapshot [ver=12, servers=12, clients=0, CPUs=504, heap=200.0GB] [04:12:40] Topology snapshot [ver=13, servers=13, clients=0, CPUs=544, heap=220.0GB] [04:12:40] Topology snapshot [ver=14, servers=14, clients=0, CPUs=584, heap=230.0GB] [04:12:41] Topology snapshot [ver=15, servers=15, clients=0, CPUs=624, heap=250.0GB] [04:12:41] Topology snapshot [ver=16, servers=16, clients=0, CPUs=664, heap=260.0GB] [04:12:41] Topology snapshot [ver=17, servers=17, clients=0, CPUs=704, heap=280.0GB] [04:12:41] Topology snapshot [ver=18, servers=18, clients=0, CPUs=744, heap=290.0GB] [04:12:41] Topology snapshot [ver=19, servers=19, clients=0, CPUs=784, heap=310.0GB] [04:12:41] Topology snapshot [ver=20, servers=20, clients=0, CPUs=816, heap=320.0GB] [04:12:41] Topology snapshot [ver=21, servers=21, clients=0, CPUs=856, heap=340.0GB] [04:12:42] Topology snapshot [ver=22, servers=22, clients=0, CPUs=896, heap=350.0GB] [04:12:42] Topology snapshot [ver=23, servers=23, clients=0, CPUs=936, heap=370.0GB] [04:12:42] Topology snapshot [ver=24, servers=24, clients=0, CPUs=976, heap=380.0GB] [04:12:42] Topology snapshot [ver=25, servers=25, clients=0, CPUs=1016, heap=400.0GB] [04:12:42] Topology snapshot [ver=26, servers=26, clients=0, CPUs=1056, heap=410.0GB] [04:12:42] Topology snapshot [ver=27, servers=27, clients=0, CPUs=1104, heap=430.0GB] [04:12:43] Topology snapshot [ver=28, servers=28, clients=0, CPUs=1144, heap=440.0GB] [04:12:43] Topology snapshot [ver=29, servers=29, clients=0, CPUs=1192, heap=460.0GB] [04:12:43] Topology snapshot [ver=30, servers=30, clients=0, CPUs=1232, heap=470.0GB] [04:12:43] Topology snapshot [ver=31, servers=31, clients=0, CPUs=1280, heap=490.0GB] [04:12:43] Topology snapshot [ver=32, servers=32, clients=0, CPUs=1320, heap=500.0GB] [04:12:43] Topology snapshot [ver=33, servers=33, clients=0, CPUs=1360, heap=520.0GB] [04:12:44] Topology snapshot [ver=34, servers=34, clients=0, CPUs=1400, heap=530.0GB] [04:12:44] Topology snapshot [ver=35, servers=35, clients=0, CPUs=1432, heap=550.0GB] [04:12:44] Topology snapshot [ver=36, servers=36, clients=0, CPUs=1472, heap=560.0GB] [04:12:44] Topology snapshot [ver=37, servers=37, clients=0, CPUs=1512, heap=580.0GB] [04:12:44] Topology snapshot [ver=38, servers=38, clients=0, CPUs=1552, heap=590.0GB] [04:12:45] Topology snapshot [ver=39, servers=39, clients=0, CPUs=1584, heap=610.0GB] [04:12:45] Topology snapshot [ver=40, servers=40, clients=0, CPUs=1624, heap=620.0GB] [04:12:45] Topology snapshot [ver=41, servers=41, clients=0, CPUs=1664, heap=640.0GB] [04:12:47] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [04:12:47] [04:12:47] Ignite node started OK (id=d4a9fe7f, grid=WCA) [04:12:47] Topology snapshot [ver=6, servers=6, clients=0, CPUs=272, heap=110.0GB] [04:14:49] Topology snapshot [ver=42, servers=40, clients=0, CPUs=1624, heap=620.0GB] [04:14:49] Topology snapshot [ver=43, servers=39, clients=0, CPUs=1584, heap=610.0GB] [04:14:49] Topology snapshot [ver=44, servers=38, clients=0, CPUs=1552, heap=590.0GB] [04:14:49] Topology snapshot [ver=45, servers=37, clients=0, CPUs=1512, heap=580.0GB] [04:14:51] Topology snapshot [ver=46, servers=36, clients=0, CPUs=1464, heap=560.0GB] [04:14:51] Topology snapshot [ver=47, servers=35, clients=0, CPUs=1424, heap=550.0GB] [04:14:51] Topology snapshot [ver=48, servers=34, clients=0, CPUs=1384, heap=530.0GB] [04:14:51] Topology snapshot [ver=49, servers=33, clients=0, CPUs=1344, heap=520.0GB] [04:14:51] Topology snapshot [ver=50, servers=32, clients=0, CPUs=1304, heap=500.0GB] [04:14:51] Topology snapshot [ver=51, servers=31, clients=0, CPUs=1264, heap=490.0GB] [04:14:51] Topology snapshot [ver=52, servers=30, clients=0, CPUs=1224, heap=470.0GB] [04:14:51] Topology snapshot [ver=53, servers=29, clients=0, CPUs=1176, heap=460.0GB] [04:14:51] Topology snapshot [ver=54, servers=28, clients=0, CPUs=1136, heap=440.0GB] [04:14:53] Ignite node stopped OK [name=WCA, uptime=00:02:05:562] Container: container_e76_1487862040010_131981_01_000017 on hostName_8041 =========================================================================================== LogType:stderr Log Upload Time:Wed Mar 01 04:14:58 -0600 2017 LogLength:62086 Log Contents: 17/03/01 04:10:59 INFO executor.CoarseGrainedExecutorBackend: Registered signal handlers for [TERM, HUP, INT] 17/03/01 04:11:00 INFO spark.SecurityManager: Changing view acls to: userName 17/03/01 04:11:00 INFO spark.SecurityManager: Changing modify acls to: userName 17/03/01 04:11:00 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(userName); users with modify permissions: Set(userName) 17/03/01 04:11:00 INFO slf4j.Slf4jLogger: Slf4jLogger started 17/03/01 04:11:00 INFO Remoting: Starting remoting 17/03/01 04:11:00 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://driverPropsFetcher@hostName:59968] 17/03/01 04:11:00 INFO Remoting: Remoting now listens on addresses: [akka.tcp://driverPropsFetcher@hostName:59968] 17/03/01 04:11:00 INFO util.Utils: Successfully started service 'driverPropsFetcher' on port 59968. 17/03/01 04:11:00 INFO spark.SecurityManager: Changing view acls to: userName 17/03/01 04:11:00 INFO spark.SecurityManager: Changing modify acls to: userName 17/03/01 04:11:00 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(userName); users with modify permissions: Set(userName) 17/03/01 04:11:00 INFO remote.RemoteActorRefProvider$RemotingTerminator: Shutting down remote daemon. 17/03/01 04:11:00 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remote daemon shut down; proceeding with flushing remote transports. 17/03/01 04:11:00 INFO Remoting: Remoting shut down 17/03/01 04:11:00 INFO slf4j.Slf4jLogger: Slf4jLogger started 17/03/01 04:11:00 INFO Remoting: Starting remoting 17/03/01 04:11:00 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remoting shut down. 17/03/01 04:11:00 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://sparkExecutor@hostName:44482] 17/03/01 04:11:00 INFO Remoting: Remoting now listens on addresses: [akka.tcp://sparkExecutor@hostName:44482] 17/03/01 04:11:00 INFO util.Utils: Successfully started service 'sparkExecutor' on port 44482. 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/1/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-3a024b49-de62-4e70-9db1-93c980b9e2f3 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/2/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-baa491fc-5ec8-4a46-a527-b53bf0e5cc3a 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/3/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-102a5e88-cad4-4999-933e-55c2f877f8fa 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/4/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-fab4682b-467c-4f0b-ae82-e4200026e671 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/5/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-0b70dbe6-95a1-4983-8e1b-523466c6b351 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/6/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-ba3bf661-d62b-4c49-be69-f98b2792ef79 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/7/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-3ff08db7-6d55-4798-b81b-d125f720cf1a 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/8/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-3b124d7b-3aa8-4beb-8bc0-6d95edea0b91 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/9/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-d8fbb086-30b6-4991-956d-f272f424d7cd 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/10/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-94548134-d9e7-483e-90af-39437abad422 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/11/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-175bdb3c-f761-4527-9a52-8041c543e30f 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/12/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-e4caac87-35d9-41c2-9b4a-8dd522e59fe1 17/03/01 04:11:00 INFO storage.MemoryStore: MemoryStore started with capacity 7.8 GB 17/03/01 04:11:01 INFO executor.CoarseGrainedExecutorBackend: Connecting to driver: akka.tcp://sparkDriver@ipaddress:38995/user/CoarseGrainedScheduler 17/03/01 04:11:01 INFO executor.CoarseGrainedExecutorBackend: Successfully registered with driver 17/03/01 04:11:01 INFO executor.Executor: Starting executor ID 14 on host hostName 17/03/01 04:11:01 INFO util.Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 41952. 17/03/01 04:11:01 INFO netty.NettyBlockTransferService: Server created on 41952 17/03/01 04:11:01 INFO storage.BlockManagerMaster: Trying to register BlockManager 17/03/01 04:11:01 INFO storage.BlockManagerMaster: Registered BlockManager 17/03/01 04:11:02 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 18 17/03/01 04:11:02 INFO executor.Executor: Running task 18.0 in stage 0.0 (TID 18) 17/03/01 04:11:02 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 0 17/03/01 04:11:02 INFO storage.MemoryStore: ensureFreeSpace(1310) called with curMem=0, maxMem=8334920908 17/03/01 04:11:02 INFO storage.MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 1310.0 B, free 7.8 GB) 17/03/01 04:11:02 INFO broadcast.TorrentBroadcast: Reading broadcast variable 0 took 236 ms 17/03/01 04:11:02 INFO storage.MemoryStore: ensureFreeSpace(2064) called with curMem=1310, maxMem=8334920908 17/03/01 04:11:02 INFO storage.MemoryStore: Block broadcast_0 stored as values in memory (estimated size 2.0 KB, free 7.8 GB) 17/03/01 04:11:02 INFO resolver.CompanyResolverSparkTest: Ranjit exec test 17/03/01 04:11:02 INFO executor.Executor: Finished task 18.0 in stage 0.0 (TID 18). 972 bytes result sent to driver 17/03/01 04:12:38 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 140 17/03/01 04:12:38 INFO executor.Executor: Running task 18.0 in stage 4.0 (TID 140) 17/03/01 04:12:38 INFO spark.MapOutputTrackerWorker: Updating epoch to 1 and clearing cache 17/03/01 04:12:38 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 86 17/03/01 04:12:38 INFO storage.MemoryStore: ensureFreeSpace(2290) called with curMem=3374, maxMem=8334920908 17/03/01 04:12:38 INFO storage.MemoryStore: Block broadcast_86_piece0 stored as bytes in memory (estimated size 2.2 KB, free 7.8 GB) 17/03/01 04:12:38 INFO broadcast.TorrentBroadcast: Reading broadcast variable 86 took 9 ms 17/03/01 04:12:38 INFO storage.MemoryStore: ensureFreeSpace(6544) called with curMem=5664, maxMem=8334920908 17/03/01 04:12:38 INFO storage.MemoryStore: Block broadcast_86 stored as values in memory (estimated size 6.4 KB, free 7.8 GB) 17/03/01 04:12:38 INFO resolver.CompanyResolverSparkTest: testing worker[ipaddress:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509] 17/03/01 04:12:38 ERROR : Failed to resolve default logging config file: config/java.util.logging.properties Console logging handler is not configured. 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: >>> __________ ________________ >>> / _/ ___/ |/ / _/_ __/ __/ >>> _/ // (7 7 // / / / / _/ >>> /___/\___/_/|_/___/ /_/ /___/ >>> >>> ver. 1.8.0#20161205-sha1:9ca40dbe >>> 2016 Copyright(C) Apache Software Foundation >>> >>> Ignite documentation: http://ignite.apache.org 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Config URL: n/a 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Daemon mode: off 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: OS: Linux 2.6.32-431.5.1.el6.x86_64 amd64 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: OS user: userName 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: PID: 28153 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Language runtime: Java Platform API Specification ver. 1.8 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM information: Java(TM) SE Runtime Environment 1.8.0_60-b27 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.60-b23 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM total memory: 14.0GB 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Remote Management [restart: off, REST: on, JMX (remote: off)] 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: IGNITE_HOME=null 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM arguments: [-XX:OnOutOfMemoryError=kill %p, -Xms15360m, -Xmx15360m, -Djava.io.tmpdir=/data/9/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/container_e76_1487862040010_131981_01_000017/tmp, -Dspark.driver.port=38995, -Dspark.ui.port=0, -Dspark.yarn.app.container.log.dir=/data/12/yarn/log/container/application_1487862040010_131981/container_e76_1487862040010_131981_01_000017] 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Configured caches ['ignite-marshaller-sys-cache', 'ignite-sys-cache', 'ignite-atomics-sys-cache'] 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: Configured plugins: 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: ^-- None 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: IPC shared memory server endpoint started [port=48100, tokDir=/data/9/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/container_e76_1487862040010_131981_01_000017/tmp/ignite/work/ipc/shmem/c4f4f6bb-b71a-4a29-9575-afee2ddc1b2d-28153] 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: Successfully bound shared memory communication to TCP port [port=48100, locHost=0.0.0.0/0.0.0.0] 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: Successfully bound to TCP port [port=47100, locHost=0.0.0.0/0.0.0.0] 17/03/01 04:12:38 WARN noop.NoopCheckpointSpi: Checkpoints are disabled (to enable configure any GridCheckpointSpi implementation) 17/03/01 04:12:38 WARN collision.GridCollisionManager: Collision resolution is disabled (all jobs will be activated upon arrival). 17/03/01 04:12:38 WARN noop.NoopSwapSpaceSpi: Swap space is disabled. To enable use FileSwapSpaceSpi. 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Security status [authentication=off, tls/ssl=off] 17/03/01 04:12:39 INFO tcp.GridTcpRestProtocol: Command protocol successfully started [name=TCP binary, host=0.0.0.0/0.0.0.0, port=11211] 17/03/01 04:12:39 INFO internal.IgniteKernal%WCA: Non-loopback local IPs: 6 17/03/01 04:12:39 INFO internal.IgniteKernal%WCA: Enabled local MACs: 44A842102F58 17/03/01 04:12:39 INFO tcp.TcpDiscoverySpi: Successfully bound to TCP port [port=47500, localHost=0.0.0.0/0.0.0.0, locNodeId=c4f4f6bb-b71a-4a29-9575-afee2ddc1b2d] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=ddc47224-d030-4d1f-ba66-08f61368a395, addrs=[4, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/4:47500], discPort=47500, order=17, intOrder=17, lastExchangeTime=1488363161114, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=17, servers=17, clients=0, CPUs=704, heap=280.0GB] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=47c1a0d8-9d4d-4d0d-9b27-388bd7f49278, addrs=[1, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/1:47500], discPort=47500, order=18, intOrder=18, lastExchangeTime=1488363161124, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=18, servers=18, clients=0, CPUs=744, heap=290.0GB] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=e87f12ce-5981-4418-8468-f6bfed0a0cd8, addrs=[6, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/6:47500], discPort=47500, order=19, intOrder=19, lastExchangeTime=1488363161134, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=19, servers=19, clients=0, CPUs=784, heap=310.0GB] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=e2cba212-89dd-48dd-8d7e-821b5725fe03, addrs=[8, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/8:47500], discPort=47500, order=20, intOrder=20, lastExchangeTime=1488363161154, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=20, servers=20, clients=0, CPUs=816, heap=320.0GB] 17/03/01 04:12:41 INFO cache.GridCacheProcessor: Started cache [name=ignite-sys-cache, mode=REPLICATED] 17/03/01 04:12:41 INFO cache.GridCacheProcessor: Started cache [name=ignite-atomics-sys-cache, mode=PARTITIONED] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=f9ce8dd7-2060-4c34-b597-d7bee86ebedb, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=21, intOrder=21, lastExchangeTime=1488363161164, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=21, servers=21, clients=0, CPUs=856, heap=340.0GB] 17/03/01 04:12:42 INFO cache.GridCacheProcessor: Started cache [name=WCAIgniteCache, mode=PARTITIONED] 17/03/01 04:12:42 INFO cache.GridCacheProcessor: Started cache [name=ignite-marshaller-sys-cache, mode=REPLICATED] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=6b1889dd-9de5-4f1b-8ec9-c123c7df8ea2, addrs=[, 127.0.0.1], sockAddrs=[hostName/:47500, /127.0.0.1:47500], discPort=47500, order=22, intOrder=22, lastExchangeTime=1488363161175, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=22, servers=22, clients=0, CPUs=896, heap=350.0GB] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=9fb6e583-cea0-4f78-b403-b403a8bc9a0e, addrs=[7, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/7:47500], discPort=47500, order=23, intOrder=23, lastExchangeTime=1488363161185, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=23, servers=23, clients=0, CPUs=936, heap=370.0GB] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=20860cae-2881-4311-a3f5-edaa160ef37f, addrs=[7, 127.0.0.1], sockAddrs=[hostName/7:47500, /127.0.0.1:47500], discPort=47500, order=24, intOrder=24, lastExchangeTime=1488363161185, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=24, servers=24, clients=0, CPUs=976, heap=380.0GB] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=16, minorTopVer=0], evt=NODE_JOINED, node=c4f4f6bb-b71a-4a29-9575-afee2ddc1b2d] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=0d675d57-b9b9-4cff-a994-77337d618bbe, addrs=[4, 127.0.0.1], sockAddrs=[hostName/4:47500, /127.0.0.1:47500], discPort=47500, order=25, intOrder=25, lastExchangeTime=1488363161195, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=25, servers=25, clients=0, CPUs=1016, heap=400.0GB] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=17, minorTopVer=0], evt=NODE_JOINED, node=ddc47224-d030-4d1f-ba66-08f61368a395] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=a6343860-6e84-4d9c-9b87-84ffd76280cd, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=26, intOrder=26, lastExchangeTime=1488363161195, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=26, servers=26, clients=0, CPUs=1056, heap=410.0GB] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=18, minorTopVer=0], evt=NODE_JOINED, node=47c1a0d8-9d4d-4d0d-9b27-388bd7f49278] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=19, minorTopVer=0], evt=NODE_JOINED, node=e87f12ce-5981-4418-8468-f6bfed0a0cd8] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=479b18e6-54af-4313-85f7-c7525f6229a4, addrs=[, 127.0.0.1], sockAddrs=[hostName/:47500, /127.0.0.1:47500], discPort=47500, order=27, intOrder=27, lastExchangeTime=1488363161215, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=27, servers=27, clients=0, CPUs=1104, heap=430.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=20, minorTopVer=0], evt=NODE_JOINED, node=e2cba212-89dd-48dd-8d7e-821b5725fe03] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=058a99e8-3b65-4ec9-84b0-6f3502c2afce, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=28, intOrder=28, lastExchangeTime=1488363161225, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=28, servers=28, clients=0, CPUs=1144, heap=440.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=21, minorTopVer=0], evt=NODE_JOINED, node=f9ce8dd7-2060-4c34-b597-d7bee86ebedb] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=57c09d88-a4dc-4179-98b4-1144fd97d8cc, addrs=[35, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/35:47500], discPort=47500, order=29, intOrder=29, lastExchangeTime=1488363161235, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=29, servers=29, clients=0, CPUs=1192, heap=460.0GB] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=58298821-7aa9-4b58-ba15-e7f1ef2830fb, addrs=[3, 127.0.0.1], sockAddrs=[hostName/3:47500, /127.0.0.1:47500], discPort=47500, order=30, intOrder=30, lastExchangeTime=1488363161245, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=30, servers=30, clients=0, CPUs=1232, heap=470.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=22, minorTopVer=0], evt=NODE_JOINED, node=6b1889dd-9de5-4f1b-8ec9-c123c7df8ea2] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4d5de2f3-d975-4b28-b593-0cc0481cdc74, addrs=[03, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/03:47500], discPort=47500, order=31, intOrder=31, lastExchangeTime=1488363161245, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=31, servers=31, clients=0, CPUs=1280, heap=490.0GB] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=fa09caab-f4dc-43b6-ac8b-4a4bae6e7da6, addrs=[01, 127.0.0.1], sockAddrs=[hostName/01:47500, /127.0.0.1:47500], discPort=47500, order=32, intOrder=32, lastExchangeTime=1488363161517, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=32, servers=32, clients=0, CPUs=1320, heap=500.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=23, minorTopVer=0], evt=NODE_JOINED, node=9fb6e583-cea0-4f78-b403-b403a8bc9a0e] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=24, minorTopVer=0], evt=NODE_JOINED, node=20860cae-2881-4311-a3f5-edaa160ef37f] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=af5837f0-25ec-4f3d-a1c1-90c09dc424cb, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=33, intOrder=33, lastExchangeTime=1488363161648, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=33, servers=33, clients=0, CPUs=1360, heap=520.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=25, minorTopVer=0], evt=NODE_JOINED, node=0d675d57-b9b9-4cff-a994-77337d618bbe] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=e9e49d2d-5eeb-474f-8757-e447efc8ca8f, addrs=[6, 127.0.0.1], sockAddrs=[hostName/6:47500, /127.0.0.1:47500], discPort=47500, order=34, intOrder=34, lastExchangeTime=1488363161648, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=34, servers=34, clients=0, CPUs=1400, heap=530.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=26, minorTopVer=0], evt=NODE_JOINED, node=a6343860-6e84-4d9c-9b87-84ffd76280cd] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4b90e5a3-253a-435b-84ca-6b592610cf0c, addrs=[4, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/4:47500], discPort=47500, order=35, intOrder=35, lastExchangeTime=1488363161659, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=35, servers=35, clients=0, CPUs=1432, heap=550.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=27, minorTopVer=0], evt=NODE_JOINED, node=479b18e6-54af-4313-85f7-c7525f6229a4] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=8fd4eea2-2a45-4563-ae87-1848fd388a98, addrs=[3, 127.0.0.1], sockAddrs=[hostName/3:47500, /127.0.0.1:47500], discPort=47500, order=36, intOrder=36, lastExchangeTime=1488363161669, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=36, servers=36, clients=0, CPUs=1472, heap=560.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=28, minorTopVer=0], evt=NODE_JOINED, node=058a99e8-3b65-4ec9-84b0-6f3502c2afce] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=d7b45a02-0411-4028-acdf-f004e592f294, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=37, intOrder=37, lastExchangeTime=1488363161952, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=37, servers=37, clients=0, CPUs=1512, heap=580.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=29, minorTopVer=0], evt=NODE_JOINED, node=57c09d88-a4dc-4179-98b4-1144fd97d8cc] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=cf4e6e83-207e-42da-a55c-5621bc20b891, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=38, intOrder=38, lastExchangeTime=1488363162710, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=38, servers=38, clients=0, CPUs=1552, heap=590.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=30, minorTopVer=0], evt=NODE_JOINED, node=58298821-7aa9-4b58-ba15-e7f1ef2830fb] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=d8926a2c-2c00-4445-beb4-633c2d656c41, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=39, intOrder=39, lastExchangeTime=1488363162721, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=39, servers=39, clients=0, CPUs=1584, heap=610.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=31, minorTopVer=0], evt=NODE_JOINED, node=4d5de2f3-d975-4b28-b593-0cc0481cdc74] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4136a0c9-14d5-42b3-9a60-81689c800438, addrs=[3, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/3:47500], discPort=47500, order=40, intOrder=40, lastExchangeTime=1488363162933, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=40, servers=40, clients=0, CPUs=1624, heap=620.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=32, minorTopVer=0], evt=NODE_JOINED, node=fa09caab-f4dc-43b6-ac8b-4a4bae6e7da6] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=694a80b8-02a3-44c9-a2dd-45bed7d20a50, addrs=[1, 127.0.0.1], sockAddrs=[hostName/1:47500, /127.0.0.1:47500], discPort=47500, order=41, intOrder=41, lastExchangeTime=1488363162943, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=41, servers=41, clients=0, CPUs=1664, heap=640.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=33, minorTopVer=0], evt=NODE_JOINED, node=af5837f0-25ec-4f3d-a1c1-90c09dc424cb] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=34, minorTopVer=0], evt=NODE_JOINED, node=e9e49d2d-5eeb-474f-8757-e447efc8ca8f] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=35, minorTopVer=0], evt=NODE_JOINED, node=4b90e5a3-253a-435b-84ca-6b592610cf0c] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=36, minorTopVer=0], evt=NODE_JOINED, node=8fd4eea2-2a45-4563-ae87-1848fd388a98] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=37, minorTopVer=0], evt=NODE_JOINED, node=d7b45a02-0411-4028-acdf-f004e592f294] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=38, minorTopVer=0], evt=NODE_JOINED, node=cf4e6e83-207e-42da-a55c-5621bc20b891] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=39, minorTopVer=0], evt=NODE_JOINED, node=d8926a2c-2c00-4445-beb4-633c2d656c41] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=40, minorTopVer=0], evt=NODE_JOINED, node=4136a0c9-14d5-42b3-9a60-81689c800438] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-sys-cache, waitList=[]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-marshaller-sys-cache, waitList=[]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-atomics-sys-cache, waitList=[ignite-sys-cache, ignite-marshaller-sys-cache]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=WCAIgniteCache, waitList=[ignite-sys-cache, ignite-marshaller-sys-cache, ignite-atomics-sys-cache]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Rebalancing required [top=AffinityTopologyVersion [topVer=41, minorTopVer=0], evt=NODE_JOINED, node=694a80b8-02a3-44c9-a2dd-45bed7d20a50] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-marshaller-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=20, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=26] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=100, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=26] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-marshaller-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=21 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=21 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-atomics-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=21, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=26] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-atomics-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=0 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=WCAIgniteCache, mode=ASYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=21, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=26] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=WCAIgniteCache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=10 ms] 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: >>> +----------------------------------------------------------------------+ >>> Ignite ver. 1.8.0#20161205-sha1:9ca40dbeb7d559fcb299bdb6f5c90cdf8ce7e533 >>> +----------------------------------------------------------------------+ >>> OS name: Linux 2.6.32-431.5.1.el6.x86_64 amd64 >>> CPU(s): 40 >>> Heap: 15.0GB >>> VM name: 28153@hostName >>> Grid name: WCA >>> Local node [ID=C4F4F6BB-B71A-4A29-9575-AFEE2DDC1B2D, order=16, clientMode=false] >>> Local node addresses: [hostName/6, /127.0.0.1] >>> Local ports: TCP:11211 TCP:47100 TCP:47500 TCP:48100 17/03/01 04:12:47 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=16, servers=16, clients=0, CPUs=664, heap=260.0GB] 17/03/01 04:12:47 INFO resolver.CompanyResolverSparkTest: Started ignite node on executor 17/03/01 04:12:47 INFO executor.Executor: Finished task 18.0 in stage 4.0 (TID 140). 931 bytes result sent to driver 17/03/01 04:12:49 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=41, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, node=6172ee3a-eb33-4bf5-9080-c255f52caed8] 17/03/01 04:13:47 INFO internal.IgniteKernal%WCA: Metrics for local node (to disable set 'metricsLogFrequency' to 0) ^-- Node [id=c4f4f6bb, name=WCA, uptime=00:01:00:005] ^-- H/N/C [hosts=41, nodes=41, CPUs=1664] ^-- CPU [cur=1.57%, avg=2.36%, GC=0%] ^-- Heap [used=1701MB, free=88.42%, comm=14699MB] ^-- Non heap [used=86MB, free=-1%, comm=88MB] ^-- Public thread pool [active=0, idle=0, qSize=0] ^-- System thread pool [active=0, idle=80, qSize=0] ^-- Outbound messages queue [size=0] 17/03/01 04:13:51 INFO cluster.GridUpdateNotifier: Update status is not available. 17/03/01 04:14:00 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 257 17/03/01 04:14:00 INFO executor.Executor: Running task 13.0 in stage 7.0 (TID 257) 17/03/01 04:14:00 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 131 17/03/01 04:14:00 INFO storage.MemoryStore: ensureFreeSpace(2732) called with curMem=0, maxMem=8334920908 17/03/01 04:14:00 INFO storage.MemoryStore: Block broadcast_131_piece0 stored as bytes in memory (estimated size 2.7 KB, free 7.8 GB) 17/03/01 04:14:00 INFO broadcast.TorrentBroadcast: Reading broadcast variable 131 took 30 ms 17/03/01 04:14:00 INFO storage.MemoryStore: ensureFreeSpace(7336) called with curMem=2732, maxMem=8334920908 17/03/01 04:14:00 INFO storage.MemoryStore: Block broadcast_131 stored as values in memory (estimated size 7.2 KB, free 7.8 GB) 17/03/01 04:14:00 INFO dao.CompanyDAO: testing[ipaddress:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509] 17/03/01 04:14:00 INFO dao.CompanyDAO: input company name inside Contains searchFRANKLIN LEDDY RANCH CORP 17/03/01 04:14:11 ERROR executor.Executor: Exception in task 13.0 in stage 7.0 (TID 257) javax.cache.CacheException: class org.apache.ignite.IgniteCheckedException: Query execution failed: GridCacheQueryBean [qry=GridCacheQueryAdapter [type=TEXT, clsName=CompanyVO1, clause=FRANKLIN LEDDY RANCH CORP, filter=null, transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=true, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=c4f4f6bb-b71a-4a29-9575-afee2ddc1b2d, taskHash=0], rdc=null, trans=null] at org.apache.ignite.internal.processors.cache.GridCacheUtils.convertToCacheException(GridCacheUtils.java:1440) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.next(GridCacheQueryFutureAdapter.java:174) at org.apache.ignite.internal.processors.cache.IgniteCacheProxy$5.onHasNext(IgniteCacheProxy.java:600) at org.apache.ignite.internal.util.GridCloseableIteratorAdapter.hasNextX(GridCloseableIteratorAdapter.java:53) at org.apache.ignite.internal.util.lang.GridIteratorAdapter.hasNext(GridIteratorAdapter.java:45) at un.api.resolver.dao.CompanyDAO.getVarCompContains(CompanyDAO.scala:242) at un.api.resolver.accessor.CompanyAccessor.getVarCompContains(CompanyAccessor.scala:27) at un.api.resolver.CompanyResolverSparkTest$$anonfun$main$7.apply(CompanyResolverSparkTest.scala:291) at un.api.resolver.CompanyResolverSparkTest$$anonfun$main$7.apply(CompanyResolverSparkTest.scala:289) at scala.collection.Iterator$$anon$11.next(Iterator.scala:328) at org.apache.spark.util.Utils$.getIteratorSize(Utils.scala:1554) at org.apache.spark.rdd.RDD$$anonfun$count$1.apply(RDD.scala:1121) at org.apache.spark.rdd.RDD$$anonfun$count$1.apply(RDD.scala:1121) at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1850) at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1850) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:66) at org.apache.spark.scheduler.Task.run(Task.scala:88) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:214) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: class org.apache.ignite.IgniteCheckedException: Query execution failed: GridCacheQueryBean [qry=GridCacheQueryAdapter [type=TEXT, clsName=CompanyVO1, clause=FRANKLIN LEDDY RANCH CORP, filter=null, transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=true, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=c4f4f6bb-b71a-4a29-9575-afee2ddc1b2d, taskHash=0], rdc=null, trans=null] at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.checkError(GridCacheQueryFutureAdapter.java:260) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.internalIterator(GridCacheQueryFutureAdapter.java:318) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.next(GridCacheQueryFutureAdapter.java:164) ... 19 more Caused by: class org.apache.ignite.IgniteCheckedException: Failed to execute query on node [query=GridCacheQueryBean [qry=GridCacheQueryAdapter [type=TEXT, clsName=CompanyVO1, clause=FRANKLIN LEDDY RANCH CORP, filter=null, transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=true, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=c4f4f6bb-b71a-4a29-9575-afee2ddc1b2d, taskHash=0], rdc=null, trans=null], nodeId=23f61699-e2c9-4ff6-8731-2483934e84c4] at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.onPage(GridCacheQueryFutureAdapter.java:383) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.processQueryResponse(GridCacheDistributedQueryManager.java:398) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.access$000(GridCacheDistributedQueryManager.java:63) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$1.apply(GridCacheDistributedQueryManager.java:93) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$1.apply(GridCacheDistributedQueryManager.java:91) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.processMessage(GridCacheIoManager.java:827) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.onMessage0(GridCacheIoManager.java:369) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.access$400(GridCacheIoManager.java:95) at org.apache.ignite.internal.processors.cache.GridCacheIoManager$OrderedMessageListener.onMessage(GridCacheIoManager.java:1345) at org.apache.ignite.internal.managers.communication.GridIoManager.invokeListener(GridIoManager.java:1082) at org.apache.ignite.internal.managers.communication.GridIoManager.access$1600(GridIoManager.java:102) at org.apache.ignite.internal.managers.communication.GridIoManager$GridCommunicationMessageSet.unwind(GridIoManager.java:2332) at org.apache.ignite.internal.managers.communication.GridIoManager.unwindMessageSet(GridIoManager.java:1042) at org.apache.ignite.internal.managers.communication.GridIoManager.access$1900(GridIoManager.java:102) at org.apache.ignite.internal.managers.communication.GridIoManager$6.run(GridIoManager.java:1011) ... 3 more Caused by: java.lang.NullPointerException 17/03/01 04:14:11 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=8be1bd05-d62c-4f1a-83f2-91dcb3f3b62a, res=GridCacheQueryResponse [finished=false, reqId=289, err=null, fields=false, metadata=null]] 17/03/01 04:14:11 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=4d5de2f3-d975-4b28-b593-0cc0481cdc74, res=GridCacheQueryResponse [finished=false, reqId=289, err=null, fields=false, metadata=null]] 17/03/01 04:14:11 WARN query.GridCacheDistributedQueryManager: Received response for finished or unknown query [rmtNodeId=57c09d88-a4dc-4179-98b4-1144fd97d8cc, res=GridCacheQueryResponse [finished=false, reqId=289, err=null, fields=false, metadata=null]] 17/03/01 04:14:11 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 301 17/03/01 04:14:11 INFO executor.Executor: Running task 5.1 in stage 7.0 (TID 301) 17/03/01 04:14:23 INFO executor.Executor: Finished task 5.1 in stage 7.0 (TID 301). 969 bytes result sent to driver 17/03/01 04:14:47 INFO internal.IgniteKernal%WCA: Metrics for local node (to disable set 'metricsLogFrequency' to 0) ^-- Node [id=c4f4f6bb, name=WCA, uptime=00:02:00:015] ^-- H/N/C [hosts=41, nodes=41, CPUs=1664] ^-- CPU [cur=0.2%, avg=3%, GC=0%] ^-- Heap [used=3799MB, free=73.85%, comm=14530MB] ^-- Non heap [used=91MB, free=-1%, comm=93MB] ^-- Public thread pool [active=0, idle=0, qSize=0] ^-- System thread pool [active=0, idle=80, qSize=0] ^-- Outbound messages queue [size=0] 17/03/01 04:14:49 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 328 17/03/01 04:14:49 INFO executor.Executor: Running task 15.0 in stage 8.0 (TID 328) 17/03/01 04:14:49 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 132 17/03/01 04:14:49 INFO storage.MemoryStore: ensureFreeSpace(887) called with curMem=10068, maxMem=8334920908 17/03/01 04:14:49 INFO storage.MemoryStore: Block broadcast_132_piece0 stored as bytes in memory (estimated size 887.0 B, free 7.8 GB) 17/03/01 04:14:49 INFO broadcast.TorrentBroadcast: Reading broadcast variable 132 took 83 ms 17/03/01 04:14:49 INFO storage.MemoryStore: ensureFreeSpace(1216) called with curMem=10955, maxMem=8334920908 17/03/01 04:14:49 INFO storage.MemoryStore: Block broadcast_132 stored as values in memory (estimated size 1216.0 B, free 7.8 GB) 17/03/01 04:14:49 INFO tcp.GridTcpRestProtocol: Command protocol successfully stopped: TCP binary 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=4136a0c9-14d5-42b3-9a60-81689c800438, addrs=[3, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/3:47500], discPort=47500, order=40, intOrder=40, lastExchangeTime=1488363162933, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=42, servers=40, clients=0, CPUs=1624, heap=620.0GB] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=cf4e6e83-207e-42da-a55c-5621bc20b891, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=38, intOrder=38, lastExchangeTime=1488363162710, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=43, servers=39, clients=0, CPUs=1584, heap=610.0GB] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=d8926a2c-2c00-4445-beb4-633c2d656c41, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=39, intOrder=39, lastExchangeTime=1488363162721, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=44, servers=38, clients=0, CPUs=1552, heap=590.0GB] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=e9e49d2d-5eeb-474f-8757-e447efc8ca8f, addrs=[6, 127.0.0.1], sockAddrs=[hostName/6:47500, /127.0.0.1:47500], discPort=47500, order=34, intOrder=34, lastExchangeTime=1488363161648, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=45, servers=37, clients=0, CPUs=1512, heap=580.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=57c09d88-a4dc-4179-98b4-1144fd97d8cc, addrs=[35, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/35:47500], discPort=47500, order=29, intOrder=29, lastExchangeTime=1488363161235, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=46, servers=36, clients=0, CPUs=1464, heap=560.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=0d675d57-b9b9-4cff-a994-77337d618bbe, addrs=[4, 127.0.0.1], sockAddrs=[hostName/4:47500, /127.0.0.1:47500], discPort=47500, order=25, intOrder=25, lastExchangeTime=1488363161195, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=47, servers=35, clients=0, CPUs=1424, heap=550.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=a6343860-6e84-4d9c-9b87-84ffd76280cd, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=26, intOrder=26, lastExchangeTime=1488363161195, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=48, servers=34, clients=0, CPUs=1384, heap=530.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=9fb6e583-cea0-4f78-b403-b403a8bc9a0e, addrs=[7, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/7:47500], discPort=47500, order=23, intOrder=23, lastExchangeTime=1488363161185, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=49, servers=33, clients=0, CPUs=1344, heap=520.0GB] 17/03/01 04:14:51 WARN tcp.TcpDiscoverySpi: Failed to ping node (status check will be initiated): 8fd4eea2-2a45-4563-ae87-1848fd388a98 17/03/01 04:14:52 INFO cache.GridCacheProcessor: Stopped cache: ignite-marshaller-sys-cache 17/03/01 04:14:52 INFO cache.GridCacheProcessor: Stopped cache: ignite-sys-cache 17/03/01 04:14:52 INFO cache.GridCacheProcessor: Stopped cache: ignite-atomics-sys-cache 17/03/01 04:14:52 INFO cache.GridCacheProcessor: Stopped cache: WCAIgniteCache 17/03/01 04:14:52 INFO internal.IgniteKernal%WCA: >>> +---------------------------------------------------------------------------------+ >>> Ignite ver. 1.8.0#20161205-sha1:9ca40dbeb7d559fcb299bdb6f5c90cdf8ce7e533 stopped OK >>> +---------------------------------------------------------------------------------+ >>> Grid name: WCA >>> Grid uptime: 00:02:05:344 17/03/01 04:14:52 INFO executor.Executor: Finished task 15.0 in stage 8.0 (TID 328). 931 bytes result sent to driver 17/03/01 04:14:53 INFO executor.CoarseGrainedExecutorBackend: Driver commanded a shutdown 17/03/01 04:14:53 INFO storage.MemoryStore: MemoryStore cleared 17/03/01 04:14:53 INFO storage.BlockManager: BlockManager stopped 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Shutting down remote daemon. 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remote daemon shut down; proceeding with flushing remote transports. 17/03/01 04:14:53 INFO Remoting: Remoting shut down 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remoting shut down. 17/03/01 04:14:53 INFO util.ShutdownHookManager: Shutdown hook called LogType:stdout Log Upload Time:Wed Mar 01 04:14:58 -0600 2017 LogLength:3976 Log Contents: rEnd of the programe - [04:12:38] __________ ________________ [04:12:38] / _/ ___/ |/ / _/_ __/ __/ [04:12:38] _/ // (7 7 // / / / / _/ [04:12:38] /___/\___/_/|_/___/ /_/ /___/ [04:12:38] [04:12:38] ver. 1.8.0#20161205-sha1:9ca40dbe [04:12:38] 2016 Copyright(C) Apache Software Foundation [04:12:38] [04:12:38] Ignite documentation: http://ignite.apache.org [04:12:38] [04:12:38] Quiet mode. [04:12:38] ^-- To see **FULL** console log here add -DIGNITE_QUIET=false or "-v" to ignite.{sh|bat} [04:12:38] [04:12:38] OS: Linux 2.6.32-431.5.1.el6.x86_64 amd64 [04:12:38] VM information: Java(TM) SE Runtime Environment 1.8.0_60-b27 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.60-b23 [04:12:38] Configured plugins: [04:12:38] ^-- None [04:12:38] [04:12:38] Security status [authentication=off, tls/ssl=off] [04:12:41] Topology snapshot [ver=17, servers=17, clients=0, CPUs=704, heap=280.0GB] [04:12:41] Topology snapshot [ver=18, servers=18, clients=0, CPUs=744, heap=290.0GB] [04:12:41] Topology snapshot [ver=19, servers=19, clients=0, CPUs=784, heap=310.0GB] [04:12:41] Topology snapshot [ver=20, servers=20, clients=0, CPUs=816, heap=320.0GB] [04:12:41] Topology snapshot [ver=21, servers=21, clients=0, CPUs=856, heap=340.0GB] [04:12:42] Topology snapshot [ver=22, servers=22, clients=0, CPUs=896, heap=350.0GB] [04:12:42] Topology snapshot [ver=23, servers=23, clients=0, CPUs=936, heap=370.0GB] [04:12:42] Topology snapshot [ver=24, servers=24, clients=0, CPUs=976, heap=380.0GB] [04:12:42] Topology snapshot [ver=25, servers=25, clients=0, CPUs=1016, heap=400.0GB] [04:12:42] Topology snapshot [ver=26, servers=26, clients=0, CPUs=1056, heap=410.0GB] [04:12:42] Topology snapshot [ver=27, servers=27, clients=0, CPUs=1104, heap=430.0GB] [04:12:43] Topology snapshot [ver=28, servers=28, clients=0, CPUs=1144, heap=440.0GB] [04:12:43] Topology snapshot [ver=29, servers=29, clients=0, CPUs=1192, heap=460.0GB] [04:12:43] Topology snapshot [ver=30, servers=30, clients=0, CPUs=1232, heap=470.0GB] [04:12:43] Topology snapshot [ver=31, servers=31, clients=0, CPUs=1280, heap=490.0GB] [04:12:43] Topology snapshot [ver=32, servers=32, clients=0, CPUs=1320, heap=500.0GB] [04:12:43] Topology snapshot [ver=33, servers=33, clients=0, CPUs=1360, heap=520.0GB] [04:12:44] Topology snapshot [ver=34, servers=34, clients=0, CPUs=1400, heap=530.0GB] [04:12:44] Topology snapshot [ver=35, servers=35, clients=0, CPUs=1432, heap=550.0GB] [04:12:44] Topology snapshot [ver=36, servers=36, clients=0, CPUs=1472, heap=560.0GB] [04:12:44] Topology snapshot [ver=37, servers=37, clients=0, CPUs=1512, heap=580.0GB] [04:12:44] Topology snapshot [ver=38, servers=38, clients=0, CPUs=1552, heap=590.0GB] [04:12:45] Topology snapshot [ver=39, servers=39, clients=0, CPUs=1584, heap=610.0GB] [04:12:45] Topology snapshot [ver=40, servers=40, clients=0, CPUs=1624, heap=620.0GB] [04:12:45] Topology snapshot [ver=41, servers=41, clients=0, CPUs=1664, heap=640.0GB] [04:12:47] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [04:12:47] [04:12:47] Ignite node started OK (id=c4f4f6bb, grid=WCA) [04:12:47] Topology snapshot [ver=16, servers=16, clients=0, CPUs=664, heap=260.0GB] [04:14:49] Topology snapshot [ver=42, servers=40, clients=0, CPUs=1624, heap=620.0GB] [04:14:49] Topology snapshot [ver=43, servers=39, clients=0, CPUs=1584, heap=610.0GB] [04:14:49] Topology snapshot [ver=44, servers=38, clients=0, CPUs=1552, heap=590.0GB] [04:14:49] Topology snapshot [ver=45, servers=37, clients=0, CPUs=1512, heap=580.0GB] [04:14:51] Topology snapshot [ver=46, servers=36, clients=0, CPUs=1464, heap=560.0GB] [04:14:51] Topology snapshot [ver=47, servers=35, clients=0, CPUs=1424, heap=550.0GB] [04:14:51] Topology snapshot [ver=48, servers=34, clients=0, CPUs=1384, heap=530.0GB] [04:14:51] Topology snapshot [ver=49, servers=33, clients=0, CPUs=1344, heap=520.0GB] [04:14:52] Ignite node stopped OK [name=WCA, uptime=00:02:05:344] Container: container_e76_1487862040010_131981_01_000016 on hostName_8041 =========================================================================================== LogType:stderr Log Upload Time:Wed Mar 01 04:14:58 -0600 2017 LogLength:127757 Log Contents: 17/03/01 04:10:59 INFO executor.CoarseGrainedExecutorBackend: Registered signal handlers for [TERM, HUP, INT] 17/03/01 04:10:59 INFO spark.SecurityManager: Changing view acls to: userName 17/03/01 04:10:59 INFO spark.SecurityManager: Changing modify acls to: userName 17/03/01 04:10:59 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(userName); users with modify permissions: Set(userName) 17/03/01 04:11:00 INFO slf4j.Slf4jLogger: Slf4jLogger started 17/03/01 04:11:00 INFO Remoting: Starting remoting 17/03/01 04:11:00 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://driverPropsFetcher@hostName:57751] 17/03/01 04:11:00 INFO Remoting: Remoting now listens on addresses: [akka.tcp://driverPropsFetcher@hostName:57751] 17/03/01 04:11:00 INFO util.Utils: Successfully started service 'driverPropsFetcher' on port 57751. 17/03/01 04:11:00 INFO spark.SecurityManager: Changing view acls to: userName 17/03/01 04:11:00 INFO spark.SecurityManager: Changing modify acls to: userName 17/03/01 04:11:00 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(userName); users with modify permissions: Set(userName) 17/03/01 04:11:00 INFO remote.RemoteActorRefProvider$RemotingTerminator: Shutting down remote daemon. 17/03/01 04:11:00 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remote daemon shut down; proceeding with flushing remote transports. 17/03/01 04:11:00 INFO slf4j.Slf4jLogger: Slf4jLogger started 17/03/01 04:11:00 INFO Remoting: Starting remoting 17/03/01 04:11:00 INFO Remoting: Remoting shut down 17/03/01 04:11:00 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remoting shut down. 17/03/01 04:11:00 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://sparkExecutor@hostName:42437] 17/03/01 04:11:00 INFO Remoting: Remoting now listens on addresses: [akka.tcp://sparkExecutor@hostName:42437] 17/03/01 04:11:00 INFO util.Utils: Successfully started service 'sparkExecutor' on port 42437. 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/1/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-ecee342b-2c38-40b2-a93f-2c4ecae0ba68 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/2/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-23b1395c-068c-4c3a-9403-5ccdd7c8c641 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/3/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-119e4cea-6efa-4a3d-b58c-ebbc6975bf9d 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/4/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-0077be1c-1a6a-4482-ba13-03ce6a087c63 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/5/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-f7beaa59-9e56-4e71-9287-1d4797b01da2 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/6/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-347de9d8-08bd-4e2f-a644-2e137e251e37 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/7/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-4d41558f-4e5c-412f-8bed-852df0ff5d15 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/8/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-763fb1c9-a223-4fa9-a146-682eb31fe191 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/9/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-8dc899b0-73d0-4ae7-ba2d-fd7e86b59693 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/10/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-3f731c0a-6229-4acb-b3d6-0dfaf42b9205 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/11/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-ca487e27-c532-4159-8101-c0c465f3e30b 17/03/01 04:11:00 INFO storage.DiskBlockManager: Created local directory at /data/12/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-79582dbd-c7fd-4a13-91de-e531ab6f1356 17/03/01 04:11:00 INFO storage.MemoryStore: MemoryStore started with capacity 7.8 GB 17/03/01 04:11:01 INFO executor.CoarseGrainedExecutorBackend: Connecting to driver: akka.tcp://sparkDriver@ipaddress:38995/user/CoarseGrainedScheduler 17/03/01 04:11:01 INFO executor.CoarseGrainedExecutorBackend: Successfully registered with driver 17/03/01 04:11:01 INFO executor.Executor: Starting executor ID 13 on host hostName 17/03/01 04:11:01 INFO util.Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 34517. 17/03/01 04:11:01 INFO netty.NettyBlockTransferService: Server created on 34517 17/03/01 04:11:01 INFO storage.BlockManagerMaster: Trying to register BlockManager 17/03/01 04:11:01 INFO storage.BlockManagerMaster: Registered BlockManager 17/03/01 04:11:02 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 14 17/03/01 04:11:02 INFO executor.Executor: Running task 14.0 in stage 0.0 (TID 14) 17/03/01 04:11:02 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 0 17/03/01 04:11:02 INFO storage.MemoryStore: ensureFreeSpace(1310) called with curMem=0, maxMem=8334920908 17/03/01 04:11:02 INFO storage.MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 1310.0 B, free 7.8 GB) 17/03/01 04:11:02 INFO broadcast.TorrentBroadcast: Reading broadcast variable 0 took 236 ms 17/03/01 04:11:02 INFO storage.MemoryStore: ensureFreeSpace(2064) called with curMem=1310, maxMem=8334920908 17/03/01 04:11:02 INFO storage.MemoryStore: Block broadcast_0 stored as values in memory (estimated size 2.0 KB, free 7.8 GB) 17/03/01 04:11:02 INFO resolver.CompanyResolverSparkTest: Ranjit exec test 17/03/01 04:11:02 INFO executor.Executor: Finished task 14.0 in stage 0.0 (TID 14). 972 bytes result sent to driver 17/03/01 04:12:03 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 56 17/03/01 04:12:03 INFO executor.Executor: Running task 15.0 in stage 2.0 (TID 56) 17/03/01 04:12:03 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 84 17/03/01 04:12:03 INFO storage.MemoryStore: ensureFreeSpace(9240) called with curMem=3374, maxMem=8334920908 17/03/01 04:12:03 INFO storage.MemoryStore: Block broadcast_84_piece0 stored as bytes in memory (estimated size 9.0 KB, free 7.8 GB) 17/03/01 04:12:03 INFO broadcast.TorrentBroadcast: Reading broadcast variable 84 took 9 ms 17/03/01 04:12:03 INFO storage.MemoryStore: ensureFreeSpace(32704) called with curMem=12614, maxMem=8334920908 17/03/01 04:12:03 INFO storage.MemoryStore: Block broadcast_84 stored as values in memory (estimated size 31.9 KB, free 7.8 GB) 17/03/01 04:12:04 INFO codegen.GenerateMutableProjection: Code generated in 96.146972 ms 17/03/01 04:12:04 INFO codegen.GenerateUnsafeProjection: Code generated in 10.755949 ms 17/03/01 04:12:04 INFO codegen.GenerateMutableProjection: Code generated in 13.673371 ms 17/03/01 04:12:04 INFO codegen.GenerateUnsafeRowJoiner: Code generated in 9.115869 ms 17/03/01 04:12:04 INFO codegen.GenerateUnsafeProjection: Code generated in 8.001096 ms 17/03/01 04:12:04 INFO rdd.HadoopRDD: Input split: avro path/part-r-00001-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:37465164+37465165 17/03/01 04:12:04 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 51 17/03/01 04:12:04 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=45318, maxMem=8334920908 17/03/01 04:12:04 INFO storage.MemoryStore: Block broadcast_51_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:12:04 INFO broadcast.TorrentBroadcast: Reading broadcast variable 51 took 9 ms 17/03/01 04:12:04 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=69961, maxMem=8334920908 17/03/01 04:12:04 INFO storage.MemoryStore: Block broadcast_51 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:12:04 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 17/03/01 04:12:04 INFO Configuration.deprecation: mapred.tip.id is deprecated. Instead, use mapreduce.task.id 17/03/01 04:12:04 INFO Configuration.deprecation: mapred.task.id is deprecated. Instead, use mapreduce.task.attempt.id 17/03/01 04:12:04 INFO Configuration.deprecation: mapred.task.is.map is deprecated. Instead, use mapreduce.task.ismap 17/03/01 04:12:04 INFO Configuration.deprecation: mapred.task.partition is deprecated. Instead, use mapreduce.task.partition 17/03/01 04:12:04 INFO Configuration.deprecation: mapred.job.id is deprecated. Instead, use mapreduce.job.id 17/03/01 04:12:04 WARN security.UserGroupInformation: PriviledgedActionException as:userName (auth:SIMPLE) cause:org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:12:04 WARN ipc.Client: Exception encountered while connecting to the server : org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:12:04 WARN security.UserGroupInformation: PriviledgedActionException as:userName (auth:SIMPLE) cause:org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:12:07 INFO executor.Executor: Finished task 15.0 in stage 2.0 (TID 56). 2495 bytes result sent to driver 17/03/01 04:12:38 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 135 17/03/01 04:12:38 INFO executor.Executor: Running task 13.0 in stage 4.0 (TID 135) 17/03/01 04:12:38 INFO spark.MapOutputTrackerWorker: Updating epoch to 1 and clearing cache 17/03/01 04:12:38 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 86 17/03/01 04:12:38 INFO storage.MemoryStore: ensureFreeSpace(2290) called with curMem=417033, maxMem=8334920908 17/03/01 04:12:38 INFO storage.MemoryStore: Block broadcast_86_piece0 stored as bytes in memory (estimated size 2.2 KB, free 7.8 GB) 17/03/01 04:12:38 INFO broadcast.TorrentBroadcast: Reading broadcast variable 86 took 8 ms 17/03/01 04:12:38 INFO storage.MemoryStore: ensureFreeSpace(6544) called with curMem=419323, maxMem=8334920908 17/03/01 04:12:38 INFO storage.MemoryStore: Block broadcast_86 stored as values in memory (estimated size 6.4 KB, free 7.8 GB) 17/03/01 04:12:38 INFO resolver.CompanyResolverSparkTest: testing worker[ipaddress:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509] 17/03/01 04:12:38 ERROR : Failed to resolve default logging config file: config/java.util.logging.properties Console logging handler is not configured. 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: >>> __________ ________________ >>> / _/ ___/ |/ / _/_ __/ __/ >>> _/ // (7 7 // / / / / _/ >>> /___/\___/_/|_/___/ /_/ /___/ >>> >>> ver. 1.8.0#20161205-sha1:9ca40dbe >>> 2016 Copyright(C) Apache Software Foundation >>> >>> Ignite documentation: http://ignite.apache.org 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Config URL: n/a 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Daemon mode: off 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: OS: Linux 2.6.32-431.5.1.el6.x86_64 amd64 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: OS user: userName 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: PID: 26351 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Language runtime: Java Platform API Specification ver. 1.8 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM information: Java(TM) SE Runtime Environment 1.8.0_60-b27 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.60-b23 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM total memory: 14.0GB 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Remote Management [restart: off, REST: on, JMX (remote: off)] 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: IGNITE_HOME=null 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM arguments: [-XX:OnOutOfMemoryError=kill %p, -Xms15360m, -Xmx15360m, -Djava.io.tmpdir=/data/4/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/container_e76_1487862040010_131981_01_000016/tmp, -Dspark.driver.port=38995, -Dspark.ui.port=0, -Dspark.yarn.app.container.log.dir=/data/12/yarn/log/container/application_1487862040010_131981/container_e76_1487862040010_131981_01_000016] 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Configured caches ['ignite-marshaller-sys-cache', 'ignite-sys-cache', 'ignite-atomics-sys-cache'] 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: Configured plugins: 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: ^-- None 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: IPC shared memory server endpoint started [port=48100, tokDir=/data/4/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/container_e76_1487862040010_131981_01_000016/tmp/ignite/work/ipc/shmem/90532831-88fb-4eb8-adc9-db7a86744869-26351] 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: Successfully bound shared memory communication to TCP port [port=48100, locHost=0.0.0.0/0.0.0.0] 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: Successfully bound to TCP port [port=47100, locHost=0.0.0.0/0.0.0.0] 17/03/01 04:12:38 WARN noop.NoopCheckpointSpi: Checkpoints are disabled (to enable configure any GridCheckpointSpi implementation) 17/03/01 04:12:38 WARN collision.GridCollisionManager: Collision resolution is disabled (all jobs will be activated upon arrival). 17/03/01 04:12:38 WARN noop.NoopSwapSpaceSpi: Swap space is disabled. To enable use FileSwapSpaceSpi. 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Security status [authentication=off, tls/ssl=off] 17/03/01 04:12:39 INFO tcp.GridTcpRestProtocol: Command protocol successfully started [name=TCP binary, host=0.0.0.0/0.0.0.0, port=11211] 17/03/01 04:12:39 INFO internal.IgniteKernal%WCA: Non-loopback local IPs: 0 17/03/01 04:12:39 INFO internal.IgniteKernal%WCA: Enabled local MACs: B083FEE16BE4 17/03/01 04:12:39 INFO tcp.TcpDiscoverySpi: Successfully bound to TCP port [port=47500, localHost=0.0.0.0/0.0.0.0, locNodeId=90532831-88fb-4eb8-adc9-db7a86744869] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=d4a9fe7f-de19-4df7-874c-a084da78562f, addrs=[4, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/4:47500], discPort=47500, order=6, intOrder=6, lastExchangeTime=1488363159843, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=6, servers=6, clients=0, CPUs=272, heap=110.0GB] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=5bc51e21-1dcf-498a-b87e-6dd24f7e36ad, addrs=[8, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/8:47500], discPort=47500, order=7, intOrder=7, lastExchangeTime=1488363159914, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=7, servers=7, clients=0, CPUs=312, heap=130.0GB] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=daed0152-83fc-4828-ada6-64c74787b190, addrs=[, 127.0.0.1], sockAddrs=[hostName/:47500, /127.0.0.1:47500], discPort=47500, order=8, intOrder=8, lastExchangeTime=1488363159934, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=8, servers=8, clients=0, CPUs=352, heap=140.0GB] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=29716cf1-ed55-4550-82bd-cf980a0aee2c, addrs=[, 127.0.0.1], sockAddrs=[hostName/:47501, /127.0.0.1:47501], discPort=47501, order=9, intOrder=9, lastExchangeTime=1488363159954, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=9, servers=9, clients=0, CPUs=392, heap=160.0GB] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=717de453-fc6b-4a46-91b2-b5c54ab8a4be, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=10, intOrder=10, lastExchangeTime=1488363159964, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=10, servers=10, clients=0, CPUs=432, heap=170.0GB] 17/03/01 04:12:40 INFO cache.GridCacheProcessor: Started cache [name=ignite-sys-cache, mode=REPLICATED] 17/03/01 04:12:40 INFO cache.GridCacheProcessor: Started cache [name=ignite-atomics-sys-cache, mode=PARTITIONED] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=ffe19475-7849-4027-8648-ce56598ff50f, addrs=[7, 127.0.0.1], sockAddrs=[/127.0.0.1:47501, hostName/7:47501], discPort=47501, order=11, intOrder=11, lastExchangeTime=1488363159974, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=11, servers=11, clients=0, CPUs=472, heap=190.0GB] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=8be1bd05-d62c-4f1a-83f2-91dcb3f3b62a, addrs=[07, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/07:47500], discPort=47500, order=12, intOrder=12, lastExchangeTime=1488363159974, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=12, servers=12, clients=0, CPUs=504, heap=200.0GB] 17/03/01 04:12:40 INFO cache.GridCacheProcessor: Started cache [name=WCAIgniteCache, mode=PARTITIONED] 17/03/01 04:12:40 INFO cache.GridCacheProcessor: Started cache [name=ignite-marshaller-sys-cache, mode=REPLICATED] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=133c388f-3399-4cc8-b2f1-7ae8ba971b03, addrs=[7, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/7:47500], discPort=47500, order=13, intOrder=13, lastExchangeTime=1488363160025, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:40 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=5, minorTopVer=0], evt=NODE_JOINED, node=90532831-88fb-4eb8-adc9-db7a86744869] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=13, servers=13, clients=0, CPUs=544, heap=220.0GB] 17/03/01 04:12:40 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=6, minorTopVer=0], evt=NODE_JOINED, node=d4a9fe7f-de19-4df7-874c-a084da78562f] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=23f61699-e2c9-4ff6-8731-2483934e84c4, addrs=[0, 127.0.0.1], sockAddrs=[hostName/0:47500, /127.0.0.1:47500], discPort=47500, order=14, intOrder=14, lastExchangeTime=1488363160025, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=14, servers=14, clients=0, CPUs=584, heap=230.0GB] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=95f164b5-4b73-438f-804f-62854d615b5b, addrs=[9, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/9:47500], discPort=47500, order=15, intOrder=15, lastExchangeTime=1488363160035, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=15, servers=15, clients=0, CPUs=624, heap=250.0GB] 17/03/01 04:12:41 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=7, minorTopVer=0], evt=NODE_JOINED, node=5bc51e21-1dcf-498a-b87e-6dd24f7e36ad] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=c4f4f6bb-b71a-4a29-9575-afee2ddc1b2d, addrs=[6, 127.0.0.1], sockAddrs=[hostName/6:47500, /127.0.0.1:47500], discPort=47500, order=16, intOrder=16, lastExchangeTime=1488363160047, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=16, servers=16, clients=0, CPUs=664, heap=260.0GB] 17/03/01 04:12:41 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=8, minorTopVer=0], evt=NODE_JOINED, node=daed0152-83fc-4828-ada6-64c74787b190] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=ddc47224-d030-4d1f-ba66-08f61368a395, addrs=[4, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/4:47500], discPort=47500, order=17, intOrder=17, lastExchangeTime=1488363160047, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=17, servers=17, clients=0, CPUs=704, heap=280.0GB] 17/03/01 04:12:41 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=9, minorTopVer=0], evt=NODE_JOINED, node=29716cf1-ed55-4550-82bd-cf980a0aee2c] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=47c1a0d8-9d4d-4d0d-9b27-388bd7f49278, addrs=[1, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/1:47500], discPort=47500, order=18, intOrder=18, lastExchangeTime=1488363160057, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=18, servers=18, clients=0, CPUs=744, heap=290.0GB] 17/03/01 04:12:41 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=10, minorTopVer=0], evt=NODE_JOINED, node=717de453-fc6b-4a46-91b2-b5c54ab8a4be] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=e87f12ce-5981-4418-8468-f6bfed0a0cd8, addrs=[6, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/6:47500], discPort=47500, order=19, intOrder=19, lastExchangeTime=1488363160057, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=19, servers=19, clients=0, CPUs=784, heap=310.0GB] 17/03/01 04:12:41 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=11, minorTopVer=0], evt=NODE_JOINED, node=ffe19475-7849-4027-8648-ce56598ff50f] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=e2cba212-89dd-48dd-8d7e-821b5725fe03, addrs=[8, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/8:47500], discPort=47500, order=20, intOrder=20, lastExchangeTime=1488363160137, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=20, servers=20, clients=0, CPUs=816, heap=320.0GB] 17/03/01 04:12:41 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=12, minorTopVer=0], evt=NODE_JOINED, node=8be1bd05-d62c-4f1a-83f2-91dcb3f3b62a] 17/03/01 04:12:41 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=13, minorTopVer=0], evt=NODE_JOINED, node=133c388f-3399-4cc8-b2f1-7ae8ba971b03] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=f9ce8dd7-2060-4c34-b597-d7bee86ebedb, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=21, intOrder=21, lastExchangeTime=1488363160160, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=21, servers=21, clients=0, CPUs=856, heap=340.0GB] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=14, minorTopVer=0], evt=NODE_JOINED, node=23f61699-e2c9-4ff6-8731-2483934e84c4] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=6b1889dd-9de5-4f1b-8ec9-c123c7df8ea2, addrs=[, 127.0.0.1], sockAddrs=[hostName/:47500, /127.0.0.1:47500], discPort=47500, order=22, intOrder=22, lastExchangeTime=1488363160231, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=22, servers=22, clients=0, CPUs=896, heap=350.0GB] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=15, minorTopVer=0], evt=NODE_JOINED, node=95f164b5-4b73-438f-804f-62854d615b5b] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=9fb6e583-cea0-4f78-b403-b403a8bc9a0e, addrs=[7, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/7:47500], discPort=47500, order=23, intOrder=23, lastExchangeTime=1488363160231, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=23, servers=23, clients=0, CPUs=936, heap=370.0GB] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=20860cae-2881-4311-a3f5-edaa160ef37f, addrs=[7, 127.0.0.1], sockAddrs=[hostName/7:47500, /127.0.0.1:47500], discPort=47500, order=24, intOrder=24, lastExchangeTime=1488363160241, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=24, servers=24, clients=0, CPUs=976, heap=380.0GB] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=16, minorTopVer=0], evt=NODE_JOINED, node=c4f4f6bb-b71a-4a29-9575-afee2ddc1b2d] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=0d675d57-b9b9-4cff-a994-77337d618bbe, addrs=[4, 127.0.0.1], sockAddrs=[hostName/4:47500, /127.0.0.1:47500], discPort=47500, order=25, intOrder=25, lastExchangeTime=1488363160241, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=25, servers=25, clients=0, CPUs=1016, heap=400.0GB] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=17, minorTopVer=0], evt=NODE_JOINED, node=ddc47224-d030-4d1f-ba66-08f61368a395] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=a6343860-6e84-4d9c-9b87-84ffd76280cd, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=26, intOrder=26, lastExchangeTime=1488363160241, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=26, servers=26, clients=0, CPUs=1056, heap=410.0GB] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=18, minorTopVer=0], evt=NODE_JOINED, node=47c1a0d8-9d4d-4d0d-9b27-388bd7f49278] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=19, minorTopVer=0], evt=NODE_JOINED, node=e87f12ce-5981-4418-8468-f6bfed0a0cd8] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=479b18e6-54af-4313-85f7-c7525f6229a4, addrs=[, 127.0.0.1], sockAddrs=[hostName/:47500, /127.0.0.1:47500], discPort=47500, order=27, intOrder=27, lastExchangeTime=1488363160342, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=27, servers=27, clients=0, CPUs=1104, heap=430.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=20, minorTopVer=0], evt=NODE_JOINED, node=e2cba212-89dd-48dd-8d7e-821b5725fe03] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=058a99e8-3b65-4ec9-84b0-6f3502c2afce, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=28, intOrder=28, lastExchangeTime=1488363160634, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=28, servers=28, clients=0, CPUs=1144, heap=440.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=21, minorTopVer=0], evt=NODE_JOINED, node=f9ce8dd7-2060-4c34-b597-d7bee86ebedb] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=57c09d88-a4dc-4179-98b4-1144fd97d8cc, addrs=[35, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/35:47500], discPort=47500, order=29, intOrder=29, lastExchangeTime=1488363160675, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=29, servers=29, clients=0, CPUs=1192, heap=460.0GB] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=58298821-7aa9-4b58-ba15-e7f1ef2830fb, addrs=[3, 127.0.0.1], sockAddrs=[hostName/3:47500, /127.0.0.1:47500], discPort=47500, order=30, intOrder=30, lastExchangeTime=1488363160675, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=30, servers=30, clients=0, CPUs=1232, heap=470.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=22, minorTopVer=0], evt=NODE_JOINED, node=6b1889dd-9de5-4f1b-8ec9-c123c7df8ea2] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4d5de2f3-d975-4b28-b593-0cc0481cdc74, addrs=[03, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/03:47500], discPort=47500, order=31, intOrder=31, lastExchangeTime=1488363160785, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=31, servers=31, clients=0, CPUs=1280, heap=490.0GB] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=fa09caab-f4dc-43b6-ac8b-4a4bae6e7da6, addrs=[01, 127.0.0.1], sockAddrs=[hostName/01:47500, /127.0.0.1:47500], discPort=47500, order=32, intOrder=32, lastExchangeTime=1488363161440, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=32, servers=32, clients=0, CPUs=1320, heap=500.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=23, minorTopVer=0], evt=NODE_JOINED, node=9fb6e583-cea0-4f78-b403-b403a8bc9a0e] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=24, minorTopVer=0], evt=NODE_JOINED, node=20860cae-2881-4311-a3f5-edaa160ef37f] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=af5837f0-25ec-4f3d-a1c1-90c09dc424cb, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=33, intOrder=33, lastExchangeTime=1488363161581, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=33, servers=33, clients=0, CPUs=1360, heap=520.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=25, minorTopVer=0], evt=NODE_JOINED, node=0d675d57-b9b9-4cff-a994-77337d618bbe] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=e9e49d2d-5eeb-474f-8757-e447efc8ca8f, addrs=[6, 127.0.0.1], sockAddrs=[hostName/6:47500, /127.0.0.1:47500], discPort=47500, order=34, intOrder=34, lastExchangeTime=1488363161581, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=34, servers=34, clients=0, CPUs=1400, heap=530.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=26, minorTopVer=0], evt=NODE_JOINED, node=a6343860-6e84-4d9c-9b87-84ffd76280cd] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4b90e5a3-253a-435b-84ca-6b592610cf0c, addrs=[4, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/4:47500], discPort=47500, order=35, intOrder=35, lastExchangeTime=1488363161591, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=35, servers=35, clients=0, CPUs=1432, heap=550.0GB] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=8fd4eea2-2a45-4563-ae87-1848fd388a98, addrs=[3, 127.0.0.1], sockAddrs=[hostName/3:47500, /127.0.0.1:47500], discPort=47500, order=36, intOrder=36, lastExchangeTime=1488363161591, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=36, servers=36, clients=0, CPUs=1472, heap=560.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=27, minorTopVer=0], evt=NODE_JOINED, node=479b18e6-54af-4313-85f7-c7525f6229a4] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=28, minorTopVer=0], evt=NODE_JOINED, node=058a99e8-3b65-4ec9-84b0-6f3502c2afce] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=d7b45a02-0411-4028-acdf-f004e592f294, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=37, intOrder=37, lastExchangeTime=1488363161894, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=37, servers=37, clients=0, CPUs=1512, heap=580.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=29, minorTopVer=0], evt=NODE_JOINED, node=57c09d88-a4dc-4179-98b4-1144fd97d8cc] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=cf4e6e83-207e-42da-a55c-5621bc20b891, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=38, intOrder=38, lastExchangeTime=1488363162649, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=38, servers=38, clients=0, CPUs=1552, heap=590.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=30, minorTopVer=0], evt=NODE_JOINED, node=58298821-7aa9-4b58-ba15-e7f1ef2830fb] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=d8926a2c-2c00-4445-beb4-633c2d656c41, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=39, intOrder=39, lastExchangeTime=1488363162649, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=39, servers=39, clients=0, CPUs=1584, heap=610.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=31, minorTopVer=0], evt=NODE_JOINED, node=4d5de2f3-d975-4b28-b593-0cc0481cdc74] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4136a0c9-14d5-42b3-9a60-81689c800438, addrs=[3, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/3:47500], discPort=47500, order=40, intOrder=40, lastExchangeTime=1488363162881, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=40, servers=40, clients=0, CPUs=1624, heap=620.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=32, minorTopVer=0], evt=NODE_JOINED, node=fa09caab-f4dc-43b6-ac8b-4a4bae6e7da6] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=694a80b8-02a3-44c9-a2dd-45bed7d20a50, addrs=[1, 127.0.0.1], sockAddrs=[hostName/1:47500, /127.0.0.1:47500], discPort=47500, order=41, intOrder=41, lastExchangeTime=1488363162891, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=41, servers=41, clients=0, CPUs=1664, heap=640.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=33, minorTopVer=0], evt=NODE_JOINED, node=af5837f0-25ec-4f3d-a1c1-90c09dc424cb] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=34, minorTopVer=0], evt=NODE_JOINED, node=e9e49d2d-5eeb-474f-8757-e447efc8ca8f] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=35, minorTopVer=0], evt=NODE_JOINED, node=4b90e5a3-253a-435b-84ca-6b592610cf0c] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=36, minorTopVer=0], evt=NODE_JOINED, node=8fd4eea2-2a45-4563-ae87-1848fd388a98] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=37, minorTopVer=0], evt=NODE_JOINED, node=d7b45a02-0411-4028-acdf-f004e592f294] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=38, minorTopVer=0], evt=NODE_JOINED, node=cf4e6e83-207e-42da-a55c-5621bc20b891] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=39, minorTopVer=0], evt=NODE_JOINED, node=d8926a2c-2c00-4445-beb4-633c2d656c41] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=40, minorTopVer=0], evt=NODE_JOINED, node=4136a0c9-14d5-42b3-9a60-81689c800438] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-sys-cache, waitList=[]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-marshaller-sys-cache, waitList=[]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-atomics-sys-cache, waitList=[ignite-sys-cache, ignite-marshaller-sys-cache]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=WCAIgniteCache, waitList=[ignite-sys-cache, ignite-marshaller-sys-cache, ignite-atomics-sys-cache]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Rebalancing required [top=AffinityTopologyVersion [topVer=41, minorTopVer=0], evt=NODE_JOINED, node=694a80b8-02a3-44c9-a2dd-45bed7d20a50] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-marshaller-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=20, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=37] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=100, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=37] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-marshaller-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=30 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=30 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-atomics-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=23, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=37] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-atomics-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=0 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=WCAIgniteCache, mode=ASYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=23, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=37] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=WCAIgniteCache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=0 ms] 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: >>> +----------------------------------------------------------------------+ >>> Ignite ver. 1.8.0#20161205-sha1:9ca40dbeb7d559fcb299bdb6f5c90cdf8ce7e533 >>> +----------------------------------------------------------------------+ >>> OS name: Linux 2.6.32-431.5.1.el6.x86_64 amd64 >>> CPU(s): 40 >>> Heap: 15.0GB >>> VM name: 26351@hostName >>> Grid name: WCA >>> Local node [ID=90532831-88FB-4EB8-ADC9-DB7A86744869, order=5, clientMode=false] >>> Local node addresses: [hostName/0, /127.0.0.1] >>> Local ports: TCP:11211 TCP:47100 TCP:47500 TCP:48100 17/03/01 04:12:47 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=5, servers=5, clients=0, CPUs=232, heap=96.0GB] 17/03/01 04:12:47 INFO resolver.CompanyResolverSparkTest: Started ignite node on executor 17/03/01 04:12:47 INFO executor.Executor: Finished task 13.0 in stage 4.0 (TID 135). 931 bytes result sent to driver 17/03/01 04:12:49 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 171 17/03/01 04:12:49 INFO executor.Executor: Running task 15.0 in stage 5.0 (TID 171) 17/03/01 04:12:49 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 128 17/03/01 04:12:49 INFO storage.MemoryStore: ensureFreeSpace(7311) called with curMem=12208, maxMem=8334920908 17/03/01 04:12:49 INFO storage.MemoryStore: Block broadcast_128_piece0 stored as bytes in memory (estimated size 7.1 KB, free 7.8 GB) 17/03/01 04:12:49 INFO broadcast.TorrentBroadcast: Reading broadcast variable 128 took 7 ms 17/03/01 04:12:49 INFO storage.MemoryStore: ensureFreeSpace(28168) called with curMem=19519, maxMem=8334920908 17/03/01 04:12:49 INFO storage.MemoryStore: Block broadcast_128 stored as values in memory (estimated size 27.5 KB, free 7.8 GB) 17/03/01 04:12:49 INFO rdd.HadoopRDD: Input split: avro path/part-r-00001-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:37465164+37465165 17/03/01 04:12:49 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 95 17/03/01 04:12:49 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=47687, maxMem=8334920908 17/03/01 04:12:49 INFO storage.MemoryStore: Block broadcast_95_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:12:49 INFO broadcast.TorrentBroadcast: Reading broadcast variable 95 took 7 ms 17/03/01 04:12:49 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=72330, maxMem=8334920908 17/03/01 04:12:49 INFO storage.MemoryStore: Block broadcast_95 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:12:49 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=41, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, node=6172ee3a-eb33-4bf5-9080-c255f52caed8] 17/03/01 04:12:56 INFO executor.Executor: Finished task 15.0 in stage 5.0 (TID 171). 2098 bytes result sent to driver 17/03/01 04:13:47 INFO internal.IgniteKernal%WCA: Metrics for local node (to disable set 'metricsLogFrequency' to 0) ^-- Node [id=90532831, name=WCA, uptime=00:01:00:003] ^-- H/N/C [hosts=41, nodes=41, CPUs=1664] ^-- CPU [cur=0.93%, avg=2.67%, GC=0%] ^-- Heap [used=1177MB, free=91.98%, comm=14670MB] ^-- Non heap [used=121MB, free=-1%, comm=123MB] ^-- Public thread pool [active=0, idle=0, qSize=0] ^-- System thread pool [active=0, idle=80, qSize=0] ^-- Outbound messages queue [size=0] 17/03/01 04:13:50 INFO cluster.GridUpdateNotifier: Update status is not available. 17/03/01 04:14:00 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 258 17/03/01 04:14:00 INFO executor.Executor: Running task 14.0 in stage 7.0 (TID 258) 17/03/01 04:14:00 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 131 17/03/01 04:14:00 INFO storage.MemoryStore: ensureFreeSpace(2732) called with curMem=407194, maxMem=8334920908 17/03/01 04:14:00 INFO storage.MemoryStore: Block broadcast_131_piece0 stored as bytes in memory (estimated size 2.7 KB, free 7.8 GB) 17/03/01 04:14:00 INFO broadcast.TorrentBroadcast: Reading broadcast variable 131 took 25 ms 17/03/01 04:14:00 INFO storage.MemoryStore: ensureFreeSpace(7336) called with curMem=409926, maxMem=8334920908 17/03/01 04:14:00 INFO storage.MemoryStore: Block broadcast_131 stored as values in memory (estimated size 7.2 KB, free 7.8 GB) 17/03/01 04:14:11 ERROR executor.Executor: Exception in task 14.0 in stage 7.0 (TID 258) javax.cache.CacheException: class org.apache.ignite.IgniteCheckedException: Query execution failed: GridCacheQueryBean [qry=GridCacheQueryAdapter [type=TEXT, clsName=CompanyVO1, clause=SANTA MARIA HOTEL, filter=null, transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=true, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=90532831-88fb-4eb8-adc9-db7a86744869, taskHash=0], rdc=null, trans=null] at org.apache.ignite.internal.processors.cache.GridCacheUtils.convertToCacheException(GridCacheUtils.java:1440) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.next(GridCacheQueryFutureAdapter.java:174) at org.apache.ignite.internal.processors.cache.IgniteCacheProxy$5.onHasNext(IgniteCacheProxy.java:600) at org.apache.ignite.internal.util.GridCloseableIteratorAdapter.hasNextX(GridCloseableIteratorAdapter.java:53) at org.apache.ignite.internal.util.lang.GridIteratorAdapter.hasNext(GridIteratorAdapter.java:45) at un.api.resolver.dao.CompanyDAO.getVarCompContains(CompanyDAO.scala:242) at un.api.resolver.accessor.CompanyAccessor.getVarCompContains(CompanyAccessor.scala:27) at un.api.resolver.CompanyResolverSparkTest$$anonfun$main$7.apply(CompanyResolverSparkTest.scala:291) at un.api.resolver.CompanyResolverSparkTest$$anonfun$main$7.apply(CompanyResolverSparkTest.scala:289) at scala.collection.Iterator$$anon$11.next(Iterator.scala:328) at org.apache.spark.util.Utils$.getIteratorSize(Utils.scala:1554) at org.apache.spark.rdd.RDD$$anonfun$count$1.apply(RDD.scala:1121) at org.apache.spark.rdd.RDD$$anonfun$count$1.apply(RDD.scala:1121) at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1850) at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1850) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:66) at org.apache.spark.scheduler.Task.run(Task.scala:88) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:214) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: class org.apache.ignite.IgniteCheckedException: Query execution failed: GridCacheQueryBean [qry=GridCacheQueryAdapter [type=TEXT, clsName=CompanyVO1, clause=SANTA MARIA HOTEL, filter=null, transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=true, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=90532831-88fb-4eb8-adc9-db7a86744869, taskHash=0], rdc=null, trans=null] at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.checkError(GridCacheQueryFutureAdapter.java:260) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.internalIterator(GridCacheQueryFutureAdapter.java:318) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.next(GridCacheQueryFutureAdapter.java:164) ... 19 more Caused by: class org.apache.ignite.IgniteCheckedException: Failed to execute query on node [query=GridCacheQueryBean [qry=GridCacheQueryAdapter [type=TEXT, clsName=CompanyVO1, clause=SANTA MARIA HOTEL, filter=null, transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=true, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=90532831-88fb-4eb8-adc9-db7a86744869, taskHash=0], rdc=null, trans=null], nodeId=23f61699-e2c9-4ff6-8731-2483934e84c4] at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.onPage(GridCacheQueryFutureAdapter.java:383) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.processQueryResponse(GridCacheDistributedQueryManager.java:398) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.access$000(GridCacheDistributedQueryManager.java:63) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$1.apply(GridCacheDistributedQueryManager.java:93) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$1.apply(GridCacheDistributedQueryManager.java:91) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.processMessage(GridCacheIoManager.java:827) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.onMessage0(GridCacheIoManager.java:369) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.access$400(GridCacheIoManager.java:95) at org.apache.ignite.internal.processors.cache.GridCacheIoManager$OrderedMessageListener.onMessage(GridCacheIoManager.java:1345) at org.apache.ignite.internal.managers.communication.GridIoManager.invokeListener(GridIoManager.java:1082) at org.apache.ignite.internal.managers.communication.GridIoManager.access$1600(GridIoManager.java:102) at org.apache.ignite.internal.managers.communication.GridIoManager$GridCommunicationMessageSet.unwind(GridIoManager.java:2332) at org.apache.ignite.internal.managers.communication.GridIoManager.unwindMessageSet(GridIoManager.java:1042) at org.apache.ignite.internal.managers.communication.GridIoManager.access$1900(GridIoManager.java:102) at org.apache.ignite.internal.managers.communication.GridIoManager$6.run(GridIoManager.java:1011) ... 3 more Caused by: java.lang.NullPointerException 17/03/01 04:14:11 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 292 17/03/01 04:14:11 INFO executor.Executor: Running task 14.1 in stage 7.0 (TID 292) 17/03/01 04:14:19 INFO executor.Executor: Finished task 14.1 in stage 7.0 (TID 292). 969 bytes result sent to driver 17/03/01 04:14:47 INFO internal.IgniteKernal%WCA: Metrics for local node (to disable set 'metricsLogFrequency' to 0) ^-- Node [id=90532831, name=WCA, uptime=00:02:00:023] ^-- H/N/C [hosts=41, nodes=41, CPUs=1664] ^-- CPU [cur=0.27%, avg=2.46%, GC=0%] ^-- Heap [used=2185MB, free=84.9%, comm=14476MB] ^-- Non heap [used=126MB, free=-1%, comm=127MB] ^-- Public thread pool [active=0, idle=0, qSize=0] ^-- System thread pool [active=0, idle=80, qSize=0] ^-- Outbound messages queue [size=0] 17/03/01 04:14:49 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 315 17/03/01 04:14:49 INFO executor.Executor: Running task 2.0 in stage 8.0 (TID 315) 17/03/01 04:14:49 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 132 17/03/01 04:14:49 INFO storage.MemoryStore: ensureFreeSpace(887) called with curMem=417262, maxMem=8334920908 17/03/01 04:14:49 INFO storage.MemoryStore: Block broadcast_132_piece0 stored as bytes in memory (estimated size 887.0 B, free 7.8 GB) 17/03/01 04:14:49 INFO broadcast.TorrentBroadcast: Reading broadcast variable 132 took 68 ms 17/03/01 04:14:49 INFO storage.MemoryStore: ensureFreeSpace(1216) called with curMem=418149, maxMem=8334920908 17/03/01 04:14:49 INFO storage.MemoryStore: Block broadcast_132 stored as values in memory (estimated size 1216.0 B, free 7.8 GB) 17/03/01 04:14:49 INFO tcp.GridTcpRestProtocol: Command protocol successfully stopped: TCP binary 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=4136a0c9-14d5-42b3-9a60-81689c800438, addrs=[3, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/3:47500], discPort=47500, order=40, intOrder=40, lastExchangeTime=1488363162881, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=42, servers=40, clients=0, CPUs=1624, heap=620.0GB] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=cf4e6e83-207e-42da-a55c-5621bc20b891, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=38, intOrder=38, lastExchangeTime=1488363162649, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=43, servers=39, clients=0, CPUs=1584, heap=610.0GB] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=d8926a2c-2c00-4445-beb4-633c2d656c41, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=39, intOrder=39, lastExchangeTime=1488363162649, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=44, servers=38, clients=0, CPUs=1552, heap=590.0GB] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=e9e49d2d-5eeb-474f-8757-e447efc8ca8f, addrs=[6, 127.0.0.1], sockAddrs=[hostName/6:47500, /127.0.0.1:47500], discPort=47500, order=34, intOrder=34, lastExchangeTime=1488363161581, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:49 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=45, servers=37, clients=0, CPUs=1512, heap=580.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=57c09d88-a4dc-4179-98b4-1144fd97d8cc, addrs=[35, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/35:47500], discPort=47500, order=29, intOrder=29, lastExchangeTime=1488363160675, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=46, servers=36, clients=0, CPUs=1464, heap=560.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=0d675d57-b9b9-4cff-a994-77337d618bbe, addrs=[4, 127.0.0.1], sockAddrs=[hostName/4:47500, /127.0.0.1:47500], discPort=47500, order=25, intOrder=25, lastExchangeTime=1488363160241, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=47, servers=35, clients=0, CPUs=1424, heap=550.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=a6343860-6e84-4d9c-9b87-84ffd76280cd, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=26, intOrder=26, lastExchangeTime=1488363160241, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=48, servers=34, clients=0, CPUs=1384, heap=530.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=9fb6e583-cea0-4f78-b403-b403a8bc9a0e, addrs=[7, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/7:47500], discPort=47500, order=23, intOrder=23, lastExchangeTime=1488363160231, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=49, servers=33, clients=0, CPUs=1344, heap=520.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=23f61699-e2c9-4ff6-8731-2483934e84c4, addrs=[0, 127.0.0.1], sockAddrs=[hostName/0:47500, /127.0.0.1:47500], discPort=47500, order=14, intOrder=14, lastExchangeTime=1488363160025, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=50, servers=32, clients=0, CPUs=1304, heap=500.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=ddc47224-d030-4d1f-ba66-08f61368a395, addrs=[4, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/4:47500], discPort=47500, order=17, intOrder=17, lastExchangeTime=1488363160047, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=51, servers=31, clients=0, CPUs=1264, heap=490.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=e87f12ce-5981-4418-8468-f6bfed0a0cd8, addrs=[6, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/6:47500], discPort=47500, order=19, intOrder=19, lastExchangeTime=1488363160057, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=52, servers=30, clients=0, CPUs=1224, heap=470.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=40d089f0-7c80-4f1f-8659-350791f57a4c, addrs=[37, 127.0.0.1], sockAddrs=[hostName/37:47500, /127.0.0.1:47500], discPort=47500, order=4, intOrder=4, lastExchangeTime=1488363159833, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=53, servers=29, clients=0, CPUs=1176, heap=460.0GB] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Node left topology: TcpDiscoveryNode [id=29716cf1-ed55-4550-82bd-cf980a0aee2c, addrs=[, 127.0.0.1], sockAddrs=[hostName/:47501, /127.0.0.1:47501], discPort=47501, order=9, intOrder=9, lastExchangeTime=1488363159954, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:14:51 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=54, servers=28, clients=0, CPUs=1136, heap=440.0GB] 17/03/01 04:14:51 WARN tcp.TcpDiscoverySpi: Failed to ping node (status check will be initiated): 8fd4eea2-2a45-4563-ae87-1848fd388a98 17/03/01 04:14:53 INFO cache.GridCacheProcessor: Stopped cache: ignite-marshaller-sys-cache 17/03/01 04:14:53 INFO cache.GridCacheProcessor: Stopped cache: ignite-sys-cache 17/03/01 04:14:53 INFO cache.GridCacheProcessor: Stopped cache: ignite-atomics-sys-cache 17/03/01 04:14:53 INFO cache.GridCacheProcessor: Stopped cache: WCAIgniteCache 17/03/01 04:14:53 INFO internal.IgniteKernal%WCA: >>> +---------------------------------------------------------------------------------+ >>> Ignite ver. 1.8.0#20161205-sha1:9ca40dbeb7d559fcb299bdb6f5c90cdf8ce7e533 stopped OK >>> +---------------------------------------------------------------------------------+ >>> Grid name: WCA >>> Grid uptime: 00:02:05:639 17/03/01 04:14:53 INFO executor.Executor: Finished task 2.0 in stage 8.0 (TID 315). 931 bytes result sent to driver 17/03/01 04:14:53 INFO executor.CoarseGrainedExecutorBackend: Driver commanded a shutdown 17/03/01 04:14:53 INFO storage.MemoryStore: MemoryStore cleared 17/03/01 04:14:53 INFO storage.BlockManager: BlockManager stopped 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Shutting down remote daemon. 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remote daemon shut down; proceeding with flushing remote transports. 17/03/01 04:14:53 INFO Remoting: Remoting shut down 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remoting shut down. 17/03/01 04:14:53 INFO util.ShutdownHookManager: Shutdown hook called LogType:stdout Log Upload Time:Wed Mar 01 04:14:58 -0600 2017 LogLength:5330 Log Contents: rEnd of the programe - [04:12:38] __________ ________________ [04:12:38] / _/ ___/ |/ / _/_ __/ __/ [04:12:38] _/ // (7 7 // / / / / _/ [04:12:38] /___/\___/_/|_/___/ /_/ /___/ [04:12:38] [04:12:38] ver. 1.8.0#20161205-sha1:9ca40dbe [04:12:38] 2016 Copyright(C) Apache Software Foundation [04:12:38] [04:12:38] Ignite documentation: http://ignite.apache.org [04:12:38] [04:12:38] Quiet mode. [04:12:38] ^-- To see **FULL** console log here add -DIGNITE_QUIET=false or "-v" to ignite.{sh|bat} [04:12:38] [04:12:38] OS: Linux 2.6.32-431.5.1.el6.x86_64 amd64 [04:12:38] VM information: Java(TM) SE Runtime Environment 1.8.0_60-b27 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.60-b23 [04:12:38] Configured plugins: [04:12:38] ^-- None [04:12:38] [04:12:38] Security status [authentication=off, tls/ssl=off] [04:12:40] Topology snapshot [ver=6, servers=6, clients=0, CPUs=272, heap=110.0GB] [04:12:40] Topology snapshot [ver=7, servers=7, clients=0, CPUs=312, heap=130.0GB] [04:12:40] Topology snapshot [ver=8, servers=8, clients=0, CPUs=352, heap=140.0GB] [04:12:40] Topology snapshot [ver=9, servers=9, clients=0, CPUs=392, heap=160.0GB] [04:12:40] Topology snapshot [ver=10, servers=10, clients=0, CPUs=432, heap=170.0GB] [04:12:40] Topology snapshot [ver=11, servers=11, clients=0, CPUs=472, heap=190.0GB] [04:12:40] Topology snapshot [ver=12, servers=12, clients=0, CPUs=504, heap=200.0GB] [04:12:40] Topology snapshot [ver=13, servers=13, clients=0, CPUs=544, heap=220.0GB] [04:12:40] Topology snapshot [ver=14, servers=14, clients=0, CPUs=584, heap=230.0GB] [04:12:41] Topology snapshot [ver=15, servers=15, clients=0, CPUs=624, heap=250.0GB] [04:12:41] Topology snapshot [ver=16, servers=16, clients=0, CPUs=664, heap=260.0GB] [04:12:41] Topology snapshot [ver=17, servers=17, clients=0, CPUs=704, heap=280.0GB] [04:12:41] Topology snapshot [ver=18, servers=18, clients=0, CPUs=744, heap=290.0GB] [04:12:41] Topology snapshot [ver=19, servers=19, clients=0, CPUs=784, heap=310.0GB] [04:12:41] Topology snapshot [ver=20, servers=20, clients=0, CPUs=816, heap=320.0GB] [04:12:41] Topology snapshot [ver=21, servers=21, clients=0, CPUs=856, heap=340.0GB] [04:12:42] Topology snapshot [ver=22, servers=22, clients=0, CPUs=896, heap=350.0GB] [04:12:42] Topology snapshot [ver=23, servers=23, clients=0, CPUs=936, heap=370.0GB] [04:12:42] Topology snapshot [ver=24, servers=24, clients=0, CPUs=976, heap=380.0GB] [04:12:42] Topology snapshot [ver=25, servers=25, clients=0, CPUs=1016, heap=400.0GB] [04:12:42] Topology snapshot [ver=26, servers=26, clients=0, CPUs=1056, heap=410.0GB] [04:12:42] Topology snapshot [ver=27, servers=27, clients=0, CPUs=1104, heap=430.0GB] [04:12:43] Topology snapshot [ver=28, servers=28, clients=0, CPUs=1144, heap=440.0GB] [04:12:43] Topology snapshot [ver=29, servers=29, clients=0, CPUs=1192, heap=460.0GB] [04:12:43] Topology snapshot [ver=30, servers=30, clients=0, CPUs=1232, heap=470.0GB] [04:12:43] Topology snapshot [ver=31, servers=31, clients=0, CPUs=1280, heap=490.0GB] [04:12:43] Topology snapshot [ver=32, servers=32, clients=0, CPUs=1320, heap=500.0GB] [04:12:43] Topology snapshot [ver=33, servers=33, clients=0, CPUs=1360, heap=520.0GB] [04:12:44] Topology snapshot [ver=34, servers=34, clients=0, CPUs=1400, heap=530.0GB] [04:12:44] Topology snapshot [ver=35, servers=35, clients=0, CPUs=1432, heap=550.0GB] [04:12:44] Topology snapshot [ver=36, servers=36, clients=0, CPUs=1472, heap=560.0GB] [04:12:44] Topology snapshot [ver=37, servers=37, clients=0, CPUs=1512, heap=580.0GB] [04:12:44] Topology snapshot [ver=38, servers=38, clients=0, CPUs=1552, heap=590.0GB] [04:12:45] Topology snapshot [ver=39, servers=39, clients=0, CPUs=1584, heap=610.0GB] [04:12:45] Topology snapshot [ver=40, servers=40, clients=0, CPUs=1624, heap=620.0GB] [04:12:45] Topology snapshot [ver=41, servers=41, clients=0, CPUs=1664, heap=640.0GB] [04:12:47] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [04:12:47] [04:12:47] Ignite node started OK (id=90532831, grid=WCA) [04:12:47] Topology snapshot [ver=5, servers=5, clients=0, CPUs=232, heap=96.0GB] [04:14:49] Topology snapshot [ver=42, servers=40, clients=0, CPUs=1624, heap=620.0GB] [04:14:49] Topology snapshot [ver=43, servers=39, clients=0, CPUs=1584, heap=610.0GB] [04:14:49] Topology snapshot [ver=44, servers=38, clients=0, CPUs=1552, heap=590.0GB] [04:14:49] Topology snapshot [ver=45, servers=37, clients=0, CPUs=1512, heap=580.0GB] [04:14:51] Topology snapshot [ver=46, servers=36, clients=0, CPUs=1464, heap=560.0GB] [04:14:51] Topology snapshot [ver=47, servers=35, clients=0, CPUs=1424, heap=550.0GB] [04:14:51] Topology snapshot [ver=48, servers=34, clients=0, CPUs=1384, heap=530.0GB] [04:14:51] Topology snapshot [ver=49, servers=33, clients=0, CPUs=1344, heap=520.0GB] [04:14:51] Topology snapshot [ver=50, servers=32, clients=0, CPUs=1304, heap=500.0GB] [04:14:51] Topology snapshot [ver=51, servers=31, clients=0, CPUs=1264, heap=490.0GB] [04:14:51] Topology snapshot [ver=52, servers=30, clients=0, CPUs=1224, heap=470.0GB] [04:14:51] Topology snapshot [ver=53, servers=29, clients=0, CPUs=1176, heap=460.0GB] [04:14:51] Topology snapshot [ver=54, servers=28, clients=0, CPUs=1136, heap=440.0GB] [04:14:53] Ignite node stopped OK [name=WCA, uptime=00:02:05:639] Container: container_e76_1487862040010_131981_01_000032 on hostName_8041 =========================================================================================== LogType:stderr Log Upload Time:Wed Mar 01 04:14:58 -0600 2017 LogLength:79054 Log Contents: 17/03/01 04:10:59 INFO executor.CoarseGrainedExecutorBackend: Registered signal handlers for [TERM, HUP, INT] 17/03/01 04:11:00 INFO spark.SecurityManager: Changing view acls to: userName 17/03/01 04:11:00 INFO spark.SecurityManager: Changing modify acls to: userName 17/03/01 04:11:00 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(userName); users with modify permissions: Set(userName) 17/03/01 04:11:00 INFO slf4j.Slf4jLogger: Slf4jLogger started 17/03/01 04:11:00 INFO Remoting: Starting remoting 17/03/01 04:11:00 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://driverPropsFetcher@hostName:56036] 17/03/01 04:11:00 INFO Remoting: Remoting now listens on addresses: [akka.tcp://driverPropsFetcher@hostName:56036] 17/03/01 04:11:00 INFO util.Utils: Successfully started service 'driverPropsFetcher' on port 56036. 17/03/01 04:11:00 INFO spark.SecurityManager: Changing view acls to: userName 17/03/01 04:11:00 INFO spark.SecurityManager: Changing modify acls to: userName 17/03/01 04:11:00 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(userName); users with modify permissions: Set(userName) 17/03/01 04:11:00 INFO remote.RemoteActorRefProvider$RemotingTerminator: Shutting down remote daemon. 17/03/01 04:11:00 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remote daemon shut down; proceeding with flushing remote transports. 17/03/01 04:11:00 INFO slf4j.Slf4jLogger: Slf4jLogger started 17/03/01 04:11:00 INFO Remoting: Remoting shut down 17/03/01 04:11:00 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remoting shut down. 17/03/01 04:11:00 INFO Remoting: Starting remoting 17/03/01 04:11:01 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://sparkExecutor@hostName:49066] 17/03/01 04:11:01 INFO Remoting: Remoting now listens on addresses: [akka.tcp://sparkExecutor@hostName:49066] 17/03/01 04:11:01 INFO util.Utils: Successfully started service 'sparkExecutor' on port 49066. 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/1/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-9ea06347-9d6e-4f8d-868c-939d7ad8824b 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/2/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-5a8c1cfd-b0bb-4f78-bd93-89301dbc86d7 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/3/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-82729bd7-4116-4f3a-bf11-4068a3f4aef3 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/4/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-1af93f56-1432-41dd-97db-7eac7adfff6c 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/5/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-fcb8b7e5-4af1-4234-83b3-52b68c97fc3c 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/6/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-536a6ab5-4795-4f13-8290-afb7aad38dd0 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/7/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-b1fdd610-cb0a-4c3e-8ef4-193702e4c73a 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/8/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-cc83519c-9b41-41b8-8c02-fc88d43b5eeb 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/9/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-05f8317a-a777-4d31-9940-3f267714019f 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/10/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-e703fa65-c085-4c5b-9e1e-8f7ee9321dfc 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/11/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-0ddd27e2-d7bf-41b0-82e4-153ca1dce537 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/12/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-094ca00b-c283-4f1b-98bf-032adf7cbae5 17/03/01 04:11:01 INFO storage.MemoryStore: MemoryStore started with capacity 7.8 GB 17/03/01 04:11:01 INFO executor.CoarseGrainedExecutorBackend: Connecting to driver: akka.tcp://sparkDriver@ipaddress:38995/user/CoarseGrainedScheduler 17/03/01 04:11:01 INFO executor.CoarseGrainedExecutorBackend: Successfully registered with driver 17/03/01 04:11:01 INFO executor.Executor: Starting executor ID 29 on host hostName 17/03/01 04:11:01 INFO util.Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 37357. 17/03/01 04:11:01 INFO netty.NettyBlockTransferService: Server created on 37357 17/03/01 04:11:01 INFO storage.BlockManagerMaster: Trying to register BlockManager 17/03/01 04:11:01 INFO storage.BlockManagerMaster: Registered BlockManager 17/03/01 04:11:02 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 4 17/03/01 04:11:02 INFO executor.Executor: Running task 4.0 in stage 0.0 (TID 4) 17/03/01 04:11:02 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 0 17/03/01 04:11:02 INFO storage.MemoryStore: ensureFreeSpace(1310) called with curMem=0, maxMem=8334920908 17/03/01 04:11:02 INFO storage.MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 1310.0 B, free 7.8 GB) 17/03/01 04:11:02 INFO broadcast.TorrentBroadcast: Reading broadcast variable 0 took 234 ms 17/03/01 04:11:02 INFO storage.MemoryStore: ensureFreeSpace(2064) called with curMem=1310, maxMem=8334920908 17/03/01 04:11:02 INFO storage.MemoryStore: Block broadcast_0 stored as values in memory (estimated size 2.0 KB, free 7.8 GB) 17/03/01 04:11:02 INFO resolver.CompanyResolverSparkTest: Ranjit exec test 17/03/01 04:11:02 INFO executor.Executor: Finished task 4.0 in stage 0.0 (TID 4). 972 bytes result sent to driver 17/03/01 04:12:38 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 161 17/03/01 04:12:38 INFO executor.Executor: Running task 39.0 in stage 4.0 (TID 161) 17/03/01 04:12:38 INFO spark.MapOutputTrackerWorker: Updating epoch to 1 and clearing cache 17/03/01 04:12:38 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 86 17/03/01 04:12:38 INFO storage.MemoryStore: ensureFreeSpace(2290) called with curMem=3374, maxMem=8334920908 17/03/01 04:12:38 INFO storage.MemoryStore: Block broadcast_86_piece0 stored as bytes in memory (estimated size 2.2 KB, free 7.8 GB) 17/03/01 04:12:38 INFO broadcast.TorrentBroadcast: Reading broadcast variable 86 took 8 ms 17/03/01 04:12:38 INFO storage.MemoryStore: ensureFreeSpace(6544) called with curMem=5664, maxMem=8334920908 17/03/01 04:12:38 INFO storage.MemoryStore: Block broadcast_86 stored as values in memory (estimated size 6.4 KB, free 7.8 GB) 17/03/01 04:12:38 INFO resolver.CompanyResolverSparkTest: testing worker[ipaddress:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509] 17/03/01 04:12:38 ERROR : Failed to resolve default logging config file: config/java.util.logging.properties Console logging handler is not configured. 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: >>> __________ ________________ >>> / _/ ___/ |/ / _/_ __/ __/ >>> _/ // (7 7 // / / / / _/ >>> /___/\___/_/|_/___/ /_/ /___/ >>> >>> ver. 1.8.0#20161205-sha1:9ca40dbe >>> 2016 Copyright(C) Apache Software Foundation >>> >>> Ignite documentation: http://ignite.apache.org 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Config URL: n/a 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Daemon mode: off 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: OS: Linux 2.6.32-431.5.1.el6.x86_64 amd64 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: OS user: userName 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: PID: 30440 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Language runtime: Java Platform API Specification ver. 1.8 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM information: Java(TM) SE Runtime Environment 1.8.0_60-b27 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.60-b23 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM total memory: 14.0GB 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Remote Management [restart: off, REST: on, JMX (remote: off)] 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: IGNITE_HOME=null 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM arguments: [-XX:OnOutOfMemoryError=kill %p, -Xms15360m, -Xmx15360m, -Djava.io.tmpdir=/data/11/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/container_e76_1487862040010_131981_01_000032/tmp, -Dspark.driver.port=38995, -Dspark.ui.port=0, -Dspark.yarn.app.container.log.dir=/data/8/yarn/log/container/application_1487862040010_131981/container_e76_1487862040010_131981_01_000032] 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Configured caches ['ignite-marshaller-sys-cache', 'ignite-sys-cache', 'ignite-atomics-sys-cache'] 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: Configured plugins: 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: ^-- None 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: IPC shared memory server endpoint started [port=48100, tokDir=/data/11/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/container_e76_1487862040010_131981_01_000032/tmp/ignite/work/ipc/shmem/e87f12ce-5981-4418-8468-f6bfed0a0cd8-30440] 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: Successfully bound shared memory communication to TCP port [port=48100, locHost=0.0.0.0/0.0.0.0] 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: Successfully bound to TCP port [port=47100, locHost=0.0.0.0/0.0.0.0] 17/03/01 04:12:38 WARN noop.NoopCheckpointSpi: Checkpoints are disabled (to enable configure any GridCheckpointSpi implementation) 17/03/01 04:12:38 WARN collision.GridCollisionManager: Collision resolution is disabled (all jobs will be activated upon arrival). 17/03/01 04:12:39 WARN noop.NoopSwapSpaceSpi: Swap space is disabled. To enable use FileSwapSpaceSpi. 17/03/01 04:12:39 INFO internal.IgniteKernal%WCA: Security status [authentication=off, tls/ssl=off] 17/03/01 04:12:39 INFO tcp.GridTcpRestProtocol: Command protocol successfully started [name=TCP binary, host=0.0.0.0/0.0.0.0, port=11211] 17/03/01 04:12:39 INFO internal.IgniteKernal%WCA: Non-loopback local IPs: 6 17/03/01 04:12:39 INFO internal.IgniteKernal%WCA: Enabled local MACs: 44A84210536A 17/03/01 04:12:39 INFO tcp.TcpDiscoverySpi: Successfully bound to TCP port [port=47500, localHost=0.0.0.0/0.0.0.0, locNodeId=e87f12ce-5981-4418-8468-f6bfed0a0cd8] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=e2cba212-89dd-48dd-8d7e-821b5725fe03, addrs=[8, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/8:47500], discPort=47500, order=20, intOrder=20, lastExchangeTime=1488363161542, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=20, servers=20, clients=0, CPUs=816, heap=320.0GB] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=f9ce8dd7-2060-4c34-b597-d7bee86ebedb, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=21, intOrder=21, lastExchangeTime=1488363161552, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=21, servers=21, clients=0, CPUs=856, heap=340.0GB] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=6b1889dd-9de5-4f1b-8ec9-c123c7df8ea2, addrs=[, 127.0.0.1], sockAddrs=[hostName/:47500, /127.0.0.1:47500], discPort=47500, order=22, intOrder=22, lastExchangeTime=1488363161562, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=22, servers=22, clients=0, CPUs=896, heap=350.0GB] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=9fb6e583-cea0-4f78-b403-b403a8bc9a0e, addrs=[7, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/7:47500], discPort=47500, order=23, intOrder=23, lastExchangeTime=1488363161572, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=23, servers=23, clients=0, CPUs=936, heap=370.0GB] 17/03/01 04:12:42 INFO cache.GridCacheProcessor: Started cache [name=ignite-sys-cache, mode=REPLICATED] 17/03/01 04:12:42 INFO cache.GridCacheProcessor: Started cache [name=ignite-atomics-sys-cache, mode=PARTITIONED] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=20860cae-2881-4311-a3f5-edaa160ef37f, addrs=[7, 127.0.0.1], sockAddrs=[hostName/7:47500, /127.0.0.1:47500], discPort=47500, order=24, intOrder=24, lastExchangeTime=1488363161582, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=24, servers=24, clients=0, CPUs=976, heap=380.0GB] 17/03/01 04:12:42 INFO cache.GridCacheProcessor: Started cache [name=WCAIgniteCache, mode=PARTITIONED] 17/03/01 04:12:42 INFO cache.GridCacheProcessor: Started cache [name=ignite-marshaller-sys-cache, mode=REPLICATED] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=0d675d57-b9b9-4cff-a994-77337d618bbe, addrs=[4, 127.0.0.1], sockAddrs=[hostName/4:47500, /127.0.0.1:47500], discPort=47500, order=25, intOrder=25, lastExchangeTime=1488363161592, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=25, servers=25, clients=0, CPUs=1016, heap=400.0GB] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=a6343860-6e84-4d9c-9b87-84ffd76280cd, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=26, intOrder=26, lastExchangeTime=1488363161592, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=26, servers=26, clients=0, CPUs=1056, heap=410.0GB] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=19, minorTopVer=0], evt=NODE_JOINED, node=e87f12ce-5981-4418-8468-f6bfed0a0cd8] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=479b18e6-54af-4313-85f7-c7525f6229a4, addrs=[, 127.0.0.1], sockAddrs=[hostName/:47500, /127.0.0.1:47500], discPort=47500, order=27, intOrder=27, lastExchangeTime=1488363161612, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=27, servers=27, clients=0, CPUs=1104, heap=430.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=20, minorTopVer=0], evt=NODE_JOINED, node=e2cba212-89dd-48dd-8d7e-821b5725fe03] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=058a99e8-3b65-4ec9-84b0-6f3502c2afce, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=28, intOrder=28, lastExchangeTime=1488363161632, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=28, servers=28, clients=0, CPUs=1144, heap=440.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=21, minorTopVer=0], evt=NODE_JOINED, node=f9ce8dd7-2060-4c34-b597-d7bee86ebedb] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=57c09d88-a4dc-4179-98b4-1144fd97d8cc, addrs=[35, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/35:47500], discPort=47500, order=29, intOrder=29, lastExchangeTime=1488363161642, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=29, servers=29, clients=0, CPUs=1192, heap=460.0GB] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=58298821-7aa9-4b58-ba15-e7f1ef2830fb, addrs=[3, 127.0.0.1], sockAddrs=[hostName/3:47500, /127.0.0.1:47500], discPort=47500, order=30, intOrder=30, lastExchangeTime=1488363161642, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=30, servers=30, clients=0, CPUs=1232, heap=470.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=22, minorTopVer=0], evt=NODE_JOINED, node=6b1889dd-9de5-4f1b-8ec9-c123c7df8ea2] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4d5de2f3-d975-4b28-b593-0cc0481cdc74, addrs=[03, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/03:47500], discPort=47500, order=31, intOrder=31, lastExchangeTime=1488363161652, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=31, servers=31, clients=0, CPUs=1280, heap=490.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=23, minorTopVer=0], evt=NODE_JOINED, node=9fb6e583-cea0-4f78-b403-b403a8bc9a0e] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=fa09caab-f4dc-43b6-ac8b-4a4bae6e7da6, addrs=[01, 127.0.0.1], sockAddrs=[hostName/01:47500, /127.0.0.1:47500], discPort=47500, order=32, intOrder=32, lastExchangeTime=1488363161683, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=32, servers=32, clients=0, CPUs=1320, heap=500.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=24, minorTopVer=0], evt=NODE_JOINED, node=20860cae-2881-4311-a3f5-edaa160ef37f] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=af5837f0-25ec-4f3d-a1c1-90c09dc424cb, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=33, intOrder=33, lastExchangeTime=1488363161713, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=33, servers=33, clients=0, CPUs=1360, heap=520.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=25, minorTopVer=0], evt=NODE_JOINED, node=0d675d57-b9b9-4cff-a994-77337d618bbe] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=e9e49d2d-5eeb-474f-8757-e447efc8ca8f, addrs=[6, 127.0.0.1], sockAddrs=[hostName/6:47500, /127.0.0.1:47500], discPort=47500, order=34, intOrder=34, lastExchangeTime=1488363161713, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=34, servers=34, clients=0, CPUs=1400, heap=530.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=26, minorTopVer=0], evt=NODE_JOINED, node=a6343860-6e84-4d9c-9b87-84ffd76280cd] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4b90e5a3-253a-435b-84ca-6b592610cf0c, addrs=[4, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/4:47500], discPort=47500, order=35, intOrder=35, lastExchangeTime=1488363161723, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=35, servers=35, clients=0, CPUs=1432, heap=550.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=27, minorTopVer=0], evt=NODE_JOINED, node=479b18e6-54af-4313-85f7-c7525f6229a4] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=8fd4eea2-2a45-4563-ae87-1848fd388a98, addrs=[3, 127.0.0.1], sockAddrs=[hostName/3:47500, /127.0.0.1:47500], discPort=47500, order=36, intOrder=36, lastExchangeTime=1488363161723, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=36, servers=36, clients=0, CPUs=1472, heap=560.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=28, minorTopVer=0], evt=NODE_JOINED, node=058a99e8-3b65-4ec9-84b0-6f3502c2afce] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=d7b45a02-0411-4028-acdf-f004e592f294, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=37, intOrder=37, lastExchangeTime=1488363161975, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=37, servers=37, clients=0, CPUs=1512, heap=580.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=29, minorTopVer=0], evt=NODE_JOINED, node=57c09d88-a4dc-4179-98b4-1144fd97d8cc] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=cf4e6e83-207e-42da-a55c-5621bc20b891, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=38, intOrder=38, lastExchangeTime=1488363162732, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=38, servers=38, clients=0, CPUs=1552, heap=590.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=30, minorTopVer=0], evt=NODE_JOINED, node=58298821-7aa9-4b58-ba15-e7f1ef2830fb] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=d8926a2c-2c00-4445-beb4-633c2d656c41, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=39, intOrder=39, lastExchangeTime=1488363162743, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=39, servers=39, clients=0, CPUs=1584, heap=610.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=31, minorTopVer=0], evt=NODE_JOINED, node=4d5de2f3-d975-4b28-b593-0cc0481cdc74] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4136a0c9-14d5-42b3-9a60-81689c800438, addrs=[3, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/3:47500], discPort=47500, order=40, intOrder=40, lastExchangeTime=1488363162954, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=40, servers=40, clients=0, CPUs=1624, heap=620.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=32, minorTopVer=0], evt=NODE_JOINED, node=fa09caab-f4dc-43b6-ac8b-4a4bae6e7da6] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=694a80b8-02a3-44c9-a2dd-45bed7d20a50, addrs=[1, 127.0.0.1], sockAddrs=[hostName/1:47500, /127.0.0.1:47500], discPort=47500, order=41, intOrder=41, lastExchangeTime=1488363162964, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=41, servers=41, clients=0, CPUs=1664, heap=640.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=33, minorTopVer=0], evt=NODE_JOINED, node=af5837f0-25ec-4f3d-a1c1-90c09dc424cb] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=34, minorTopVer=0], evt=NODE_JOINED, node=e9e49d2d-5eeb-474f-8757-e447efc8ca8f] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=35, minorTopVer=0], evt=NODE_JOINED, node=4b90e5a3-253a-435b-84ca-6b592610cf0c] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=36, minorTopVer=0], evt=NODE_JOINED, node=8fd4eea2-2a45-4563-ae87-1848fd388a98] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=37, minorTopVer=0], evt=NODE_JOINED, node=d7b45a02-0411-4028-acdf-f004e592f294] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=38, minorTopVer=0], evt=NODE_JOINED, node=cf4e6e83-207e-42da-a55c-5621bc20b891] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=39, minorTopVer=0], evt=NODE_JOINED, node=d8926a2c-2c00-4445-beb4-633c2d656c41] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=40, minorTopVer=0], evt=NODE_JOINED, node=4136a0c9-14d5-42b3-9a60-81689c800438] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-sys-cache, waitList=[]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-marshaller-sys-cache, waitList=[]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-atomics-sys-cache, waitList=[ignite-sys-cache, ignite-marshaller-sys-cache]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=WCAIgniteCache, waitList=[ignite-sys-cache, ignite-marshaller-sys-cache, ignite-atomics-sys-cache]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Rebalancing required [top=AffinityTopologyVersion [topVer=41, minorTopVer=0], evt=NODE_JOINED, node=694a80b8-02a3-44c9-a2dd-45bed7d20a50] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-marshaller-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=20, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=23] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=100, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=23] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-marshaller-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=20 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=10 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-atomics-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=31, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=23] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-atomics-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=10 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=WCAIgniteCache, mode=ASYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=31, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=23] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=WCAIgniteCache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=0 ms] 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: >>> +----------------------------------------------------------------------+ >>> Ignite ver. 1.8.0#20161205-sha1:9ca40dbeb7d559fcb299bdb6f5c90cdf8ce7e533 >>> +----------------------------------------------------------------------+ >>> OS name: Linux 2.6.32-431.5.1.el6.x86_64 amd64 >>> CPU(s): 40 >>> Heap: 15.0GB >>> VM name: 30440@hostName >>> Grid name: WCA >>> Local node [ID=E87F12CE-5981-4418-8468-F6BFED0A0CD8, order=19, clientMode=false] >>> Local node addresses: [hostName/6, /127.0.0.1] >>> Local ports: TCP:11211 TCP:47100 TCP:47500 TCP:48100 17/03/01 04:12:47 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=19, servers=19, clients=0, CPUs=784, heap=310.0GB] 17/03/01 04:12:47 INFO resolver.CompanyResolverSparkTest: Started ignite node on executor 17/03/01 04:12:47 INFO executor.Executor: Finished task 39.0 in stage 4.0 (TID 161). 931 bytes result sent to driver 17/03/01 04:12:49 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=41, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, node=6172ee3a-eb33-4bf5-9080-c255f52caed8] 17/03/01 04:13:33 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 238 17/03/01 04:13:33 INFO executor.Executor: Running task 63.0 in stage 5.0 (TID 238) 17/03/01 04:13:33 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 128 17/03/01 04:13:33 INFO storage.MemoryStore: ensureFreeSpace(7311) called with curMem=0, maxMem=8334920908 17/03/01 04:13:33 INFO storage.MemoryStore: Block broadcast_128_piece0 stored as bytes in memory (estimated size 7.1 KB, free 7.8 GB) 17/03/01 04:13:33 INFO broadcast.TorrentBroadcast: Reading broadcast variable 128 took 32 ms 17/03/01 04:13:33 INFO storage.MemoryStore: ensureFreeSpace(28168) called with curMem=7311, maxMem=8334920908 17/03/01 04:13:33 INFO storage.MemoryStore: Block broadcast_128 stored as values in memory (estimated size 27.5 KB, free 7.8 GB) 17/03/01 04:13:35 INFO rdd.HadoopRDD: Input split: avro path/part-r-00008-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:85601542+85601542 17/03/01 04:13:35 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 119 17/03/01 04:13:35 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=35479, maxMem=8334920908 17/03/01 04:13:35 INFO storage.MemoryStore: Block broadcast_119_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:13:35 INFO broadcast.TorrentBroadcast: Reading broadcast variable 119 took 31 ms 17/03/01 04:13:35 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=60122, maxMem=8334920908 17/03/01 04:13:35 INFO storage.MemoryStore: Block broadcast_119 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:13:35 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 17/03/01 04:13:35 INFO Configuration.deprecation: mapred.tip.id is deprecated. Instead, use mapreduce.task.id 17/03/01 04:13:35 INFO Configuration.deprecation: mapred.task.id is deprecated. Instead, use mapreduce.task.attempt.id 17/03/01 04:13:35 INFO Configuration.deprecation: mapred.task.is.map is deprecated. Instead, use mapreduce.task.ismap 17/03/01 04:13:35 INFO Configuration.deprecation: mapred.task.partition is deprecated. Instead, use mapreduce.task.partition 17/03/01 04:13:35 INFO Configuration.deprecation: mapred.job.id is deprecated. Instead, use mapreduce.job.id 17/03/01 04:13:35 WARN security.UserGroupInformation: PriviledgedActionException as:userName (auth:SIMPLE) cause:org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:13:35 WARN ipc.Client: Exception encountered while connecting to the server : org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:13:35 WARN security.UserGroupInformation: PriviledgedActionException as:userName (auth:SIMPLE) cause:org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:13:47 INFO internal.IgniteKernal%WCA: Metrics for local node (to disable set 'metricsLogFrequency' to 0) ^-- Node [id=e87f12ce, name=WCA, uptime=00:01:00:007] ^-- H/N/C [hosts=41, nodes=41, CPUs=1664] ^-- CPU [cur=6.17%, avg=4.85%, GC=0%] ^-- Heap [used=4664MB, free=68.39%, comm=14756MB] ^-- Non heap [used=114MB, free=-1%, comm=117MB] ^-- Public thread pool [active=0, idle=0, qSize=0] ^-- System thread pool [active=0, idle=80, qSize=0] ^-- Outbound messages queue [size=0] 17/03/01 04:13:51 INFO cluster.GridUpdateNotifier: Update status is not available. 17/03/01 04:13:54 INFO executor.Executor: Finished task 63.0 in stage 5.0 (TID 238). 2098 bytes result sent to driver 17/03/01 04:14:00 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 260 17/03/01 04:14:00 INFO executor.Executor: Running task 16.0 in stage 7.0 (TID 260) 17/03/01 04:14:00 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 131 17/03/01 04:14:00 INFO storage.MemoryStore: ensureFreeSpace(2732) called with curMem=407194, maxMem=8334920908 17/03/01 04:14:00 INFO storage.MemoryStore: Block broadcast_131_piece0 stored as bytes in memory (estimated size 2.7 KB, free 7.8 GB) 17/03/01 04:14:00 INFO broadcast.TorrentBroadcast: Reading broadcast variable 131 took 16 ms 17/03/01 04:14:00 INFO storage.MemoryStore: ensureFreeSpace(7336) called with curMem=409926, maxMem=8334920908 17/03/01 04:14:00 INFO storage.MemoryStore: Block broadcast_131 stored as values in memory (estimated size 7.2 KB, free 7.8 GB) 17/03/01 04:14:00 INFO dao.CompanyDAO: testing[ipaddress:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509] 17/03/01 04:14:00 INFO dao.CompanyDAO: input company name inside Contains searchROYAL TIRE 17/03/01 04:14:11 ERROR executor.Executor: Exception in task 16.0 in stage 7.0 (TID 260) javax.cache.CacheException: class org.apache.ignite.IgniteCheckedException: Query execution failed: GridCacheQueryBean [qry=GridCacheQueryAdapter [type=TEXT, clsName=CompanyVO1, clause=ROYAL TIRE, filter=null, transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=true, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=e87f12ce-5981-4418-8468-f6bfed0a0cd8, taskHash=0], rdc=null, trans=null] at org.apache.ignite.internal.processors.cache.GridCacheUtils.convertToCacheException(GridCacheUtils.java:1440) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.next(GridCacheQueryFutureAdapter.java:174) at org.apache.ignite.internal.processors.cache.IgniteCacheProxy$5.onHasNext(IgniteCacheProxy.java:600) at org.apache.ignite.internal.util.GridCloseableIteratorAdapter.hasNextX(GridCloseableIteratorAdapter.java:53) at org.apache.ignite.internal.util.lang.GridIteratorAdapter.hasNext(GridIteratorAdapter.java:45) at un.api.resolver.dao.CompanyDAO.getVarCompContains(CompanyDAO.scala:242) at un.api.resolver.accessor.CompanyAccessor.getVarCompContains(CompanyAccessor.scala:27) at un.api.resolver.CompanyResolverSparkTest$$anonfun$main$7.apply(CompanyResolverSparkTest.scala:291) at un.api.resolver.CompanyResolverSparkTest$$anonfun$main$7.apply(CompanyResolverSparkTest.scala:289) at scala.collection.Iterator$$anon$11.next(Iterator.scala:328) at org.apache.spark.util.Utils$.getIteratorSize(Utils.scala:1554) at org.apache.spark.rdd.RDD$$anonfun$count$1.apply(RDD.scala:1121) at org.apache.spark.rdd.RDD$$anonfun$count$1.apply(RDD.scala:1121) at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1850) at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1850) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:66) at org.apache.spark.scheduler.Task.run(Task.scala:88) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:214) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: class org.apache.ignite.IgniteCheckedException: Query execution failed: GridCacheQueryBean [qry=GridCacheQueryAdapter [type=TEXT, clsName=CompanyVO1, clause=ROYAL TIRE, filter=null, transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=true, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=e87f12ce-5981-4418-8468-f6bfed0a0cd8, taskHash=0], rdc=null, trans=null] at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.checkError(GridCacheQueryFutureAdapter.java:260) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.internalIterator(GridCacheQueryFutureAdapter.java:318) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.next(GridCacheQueryFutureAdapter.java:164) ... 19 more Caused by: class org.apache.ignite.IgniteCheckedException: Failed to execute query on node [query=GridCacheQueryBean [qry=GridCacheQueryAdapter [type=TEXT, clsName=CompanyVO1, clause=ROYAL TIRE, filter=null, transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=true, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=e87f12ce-5981-4418-8468-f6bfed0a0cd8, taskHash=0], rdc=null, trans=null], nodeId=23f61699-e2c9-4ff6-8731-2483934e84c4] at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.onPage(GridCacheQueryFutureAdapter.java:383) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.processQueryResponse(GridCacheDistributedQueryManager.java:398) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.access$000(GridCacheDistributedQueryManager.java:63) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$1.apply(GridCacheDistributedQueryManager.java:93) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$1.apply(GridCacheDistributedQueryManager.java:91) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.processMessage(GridCacheIoManager.java:827) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.onMessage0(GridCacheIoManager.java:369) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.access$400(GridCacheIoManager.java:95) at org.apache.ignite.internal.processors.cache.GridCacheIoManager$OrderedMessageListener.onMessage(GridCacheIoManager.java:1345) at org.apache.ignite.internal.managers.communication.GridIoManager.invokeListener(GridIoManager.java:1082) at org.apache.ignite.internal.managers.communication.GridIoManager.access$1600(GridIoManager.java:102) at org.apache.ignite.internal.managers.communication.GridIoManager$GridCommunicationMessageSet.unwind(GridIoManager.java:2332) at org.apache.ignite.internal.managers.communication.GridIoManager.unwindMessageSet(GridIoManager.java:1042) at org.apache.ignite.internal.managers.communication.GridIoManager.access$1900(GridIoManager.java:102) at org.apache.ignite.internal.managers.communication.GridIoManager$6.run(GridIoManager.java:1011) ... 3 more Caused by: java.lang.NullPointerException 17/03/01 04:14:11 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 296 17/03/01 04:14:11 INFO executor.Executor: Running task 16.1 in stage 7.0 (TID 296) 17/03/01 04:14:27 INFO executor.Executor: Finished task 16.1 in stage 7.0 (TID 296). 969 bytes result sent to driver 17/03/01 04:14:47 INFO internal.IgniteKernal%WCA: Metrics for local node (to disable set 'metricsLogFrequency' to 0) ^-- Node [id=e87f12ce, name=WCA, uptime=00:02:00:029] ^-- H/N/C [hosts=41, nodes=41, CPUs=1664] ^-- CPU [cur=0.23%, avg=3.93%, GC=0%] ^-- Heap [used=4376MB, free=70.07%, comm=14620MB] ^-- Non heap [used=119MB, free=-1%, comm=121MB] ^-- Public thread pool [active=0, idle=0, qSize=0] ^-- System thread pool [active=0, idle=80, qSize=0] ^-- Outbound messages queue [size=0] 17/03/01 04:14:49 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 331 17/03/01 04:14:49 INFO executor.Executor: Running task 18.0 in stage 8.0 (TID 331) 17/03/01 04:14:49 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 132 17/03/01 04:14:49 INFO storage.MemoryStore: ensureFreeSpace(887) called with curMem=417262, maxMem=8334920908 17/03/01 04:14:49 INFO storage.MemoryStore: Block broadcast_132_piece0 stored as bytes in memory (estimated size 887.0 B, free 7.8 GB) 17/03/01 04:14:49 INFO broadcast.TorrentBroadcast: Reading broadcast variable 132 took 69 ms 17/03/01 04:14:49 INFO storage.MemoryStore: ensureFreeSpace(1216) called with curMem=418149, maxMem=8334920908 17/03/01 04:14:49 INFO storage.MemoryStore: Block broadcast_132 stored as values in memory (estimated size 1216.0 B, free 7.8 GB) 17/03/01 04:14:49 INFO tcp.GridTcpRestProtocol: Command protocol successfully stopped: TCP binary 17/03/01 04:14:51 INFO cache.GridCacheProcessor: Stopped cache: ignite-marshaller-sys-cache 17/03/01 04:14:51 INFO cache.GridCacheProcessor: Stopped cache: ignite-sys-cache 17/03/01 04:14:51 INFO cache.GridCacheProcessor: Stopped cache: ignite-atomics-sys-cache 17/03/01 04:14:51 INFO cache.GridCacheProcessor: Stopped cache: WCAIgniteCache 17/03/01 04:14:51 INFO internal.IgniteKernal%WCA: >>> +---------------------------------------------------------------------------------+ >>> Ignite ver. 1.8.0#20161205-sha1:9ca40dbeb7d559fcb299bdb6f5c90cdf8ce7e533 stopped OK >>> +---------------------------------------------------------------------------------+ >>> Grid name: WCA >>> Grid uptime: 00:02:04:241 17/03/01 04:14:51 INFO executor.Executor: Finished task 18.0 in stage 8.0 (TID 331). 931 bytes result sent to driver 17/03/01 04:14:53 INFO executor.CoarseGrainedExecutorBackend: Driver commanded a shutdown 17/03/01 04:14:53 INFO storage.MemoryStore: MemoryStore cleared 17/03/01 04:14:53 INFO storage.BlockManager: BlockManager stopped 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Shutting down remote daemon. 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remote daemon shut down; proceeding with flushing remote transports. 17/03/01 04:14:53 INFO Remoting: Remoting shut down 17/03/01 04:14:53 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remoting shut down. 17/03/01 04:14:53 INFO util.ShutdownHookManager: Shutdown hook called LogType:stdout Log Upload Time:Wed Mar 01 04:14:58 -0600 2017 LogLength:3033 Log Contents: rEnd of the programe - [04:12:38] __________ ________________ [04:12:38] / _/ ___/ |/ / _/_ __/ __/ [04:12:38] _/ // (7 7 // / / / / _/ [04:12:38] /___/\___/_/|_/___/ /_/ /___/ [04:12:38] [04:12:38] ver. 1.8.0#20161205-sha1:9ca40dbe [04:12:38] 2016 Copyright(C) Apache Software Foundation [04:12:38] [04:12:38] Ignite documentation: http://ignite.apache.org [04:12:38] [04:12:38] Quiet mode. [04:12:38] ^-- To see **FULL** console log here add -DIGNITE_QUIET=false or "-v" to ignite.{sh|bat} [04:12:38] [04:12:38] OS: Linux 2.6.32-431.5.1.el6.x86_64 amd64 [04:12:38] VM information: Java(TM) SE Runtime Environment 1.8.0_60-b27 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.60-b23 [04:12:38] Configured plugins: [04:12:38] ^-- None [04:12:38] [04:12:39] Security status [authentication=off, tls/ssl=off] [04:12:41] Topology snapshot [ver=20, servers=20, clients=0, CPUs=816, heap=320.0GB] [04:12:41] Topology snapshot [ver=21, servers=21, clients=0, CPUs=856, heap=340.0GB] [04:12:42] Topology snapshot [ver=22, servers=22, clients=0, CPUs=896, heap=350.0GB] [04:12:42] Topology snapshot [ver=23, servers=23, clients=0, CPUs=936, heap=370.0GB] [04:12:42] Topology snapshot [ver=24, servers=24, clients=0, CPUs=976, heap=380.0GB] [04:12:42] Topology snapshot [ver=25, servers=25, clients=0, CPUs=1016, heap=400.0GB] [04:12:42] Topology snapshot [ver=26, servers=26, clients=0, CPUs=1056, heap=410.0GB] [04:12:42] Topology snapshot [ver=27, servers=27, clients=0, CPUs=1104, heap=430.0GB] [04:12:43] Topology snapshot [ver=28, servers=28, clients=0, CPUs=1144, heap=440.0GB] [04:12:43] Topology snapshot [ver=29, servers=29, clients=0, CPUs=1192, heap=460.0GB] [04:12:43] Topology snapshot [ver=30, servers=30, clients=0, CPUs=1232, heap=470.0GB] [04:12:43] Topology snapshot [ver=31, servers=31, clients=0, CPUs=1280, heap=490.0GB] [04:12:43] Topology snapshot [ver=32, servers=32, clients=0, CPUs=1320, heap=500.0GB] [04:12:44] Topology snapshot [ver=33, servers=33, clients=0, CPUs=1360, heap=520.0GB] [04:12:44] Topology snapshot [ver=34, servers=34, clients=0, CPUs=1400, heap=530.0GB] [04:12:44] Topology snapshot [ver=35, servers=35, clients=0, CPUs=1432, heap=550.0GB] [04:12:44] Topology snapshot [ver=36, servers=36, clients=0, CPUs=1472, heap=560.0GB] [04:12:44] Topology snapshot [ver=37, servers=37, clients=0, CPUs=1512, heap=580.0GB] [04:12:44] Topology snapshot [ver=38, servers=38, clients=0, CPUs=1552, heap=590.0GB] [04:12:45] Topology snapshot [ver=39, servers=39, clients=0, CPUs=1584, heap=610.0GB] [04:12:45] Topology snapshot [ver=40, servers=40, clients=0, CPUs=1624, heap=620.0GB] [04:12:45] Topology snapshot [ver=41, servers=41, clients=0, CPUs=1664, heap=640.0GB] [04:12:47] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [04:12:47] [04:12:47] Ignite node started OK (id=e87f12ce, grid=WCA) [04:12:47] Topology snapshot [ver=19, servers=19, clients=0, CPUs=784, heap=310.0GB] [04:14:51] Ignite node stopped OK [name=WCA, uptime=00:02:04:241] Container: container_e76_1487862040010_131981_01_000028 on hostName_8041 =========================================================================================== LogType:stderr Log Upload Time:Wed Mar 01 04:14:58 -0600 2017 LogLength:79777 Log Contents: 17/03/01 04:11:00 INFO executor.CoarseGrainedExecutorBackend: Registered signal handlers for [TERM, HUP, INT] 17/03/01 04:11:00 INFO spark.SecurityManager: Changing view acls to: userName 17/03/01 04:11:00 INFO spark.SecurityManager: Changing modify acls to: userName 17/03/01 04:11:00 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(userName); users with modify permissions: Set(userName) 17/03/01 04:11:01 INFO slf4j.Slf4jLogger: Slf4jLogger started 17/03/01 04:11:01 INFO Remoting: Starting remoting 17/03/01 04:11:01 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://driverPropsFetcher@hostName:34993] 17/03/01 04:11:01 INFO Remoting: Remoting now listens on addresses: [akka.tcp://driverPropsFetcher@hostName:34993] 17/03/01 04:11:01 INFO util.Utils: Successfully started service 'driverPropsFetcher' on port 34993. 17/03/01 04:11:01 INFO spark.SecurityManager: Changing view acls to: userName 17/03/01 04:11:01 INFO spark.SecurityManager: Changing modify acls to: userName 17/03/01 04:11:01 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(userName); users with modify permissions: Set(userName) 17/03/01 04:11:01 INFO remote.RemoteActorRefProvider$RemotingTerminator: Shutting down remote daemon. 17/03/01 04:11:01 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remote daemon shut down; proceeding with flushing remote transports. 17/03/01 04:11:01 INFO slf4j.Slf4jLogger: Slf4jLogger started 17/03/01 04:11:01 INFO Remoting: Starting remoting 17/03/01 04:11:01 INFO Remoting: Remoting shut down 17/03/01 04:11:01 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remoting shut down. 17/03/01 04:11:01 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://sparkExecutor@hostName:55692] 17/03/01 04:11:01 INFO Remoting: Remoting now listens on addresses: [akka.tcp://sparkExecutor@hostName:55692] 17/03/01 04:11:01 INFO util.Utils: Successfully started service 'sparkExecutor' on port 55692. 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/1/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-dd9a51b9-5f66-493e-919a-75eb3164f9c6 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/2/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-203295a0-c805-4d17-89fc-14aa7665a3cc 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/3/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-b64513b1-4303-4b50-9dd3-56dd7bb586b2 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/4/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-bbc2de54-efb1-471f-aca0-aafcb6d93cb2 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/5/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-d0b95973-897e-4d26-aaf3-be5a002f58c5 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/6/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-817ca5d0-00cb-4c86-b803-214558588950 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/7/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-1031aec7-a86d-4b4b-8375-a6b5581f99f0 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/8/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-d2d722e5-b765-42dc-ae76-e23026fda9f4 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/9/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-f43a892c-baac-426e-a193-940645b9b8e2 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/10/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-5276d8b3-99fc-4b0a-99e1-14b2ee1120ce 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/11/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-8020020a-8a8a-4280-9a4c-0a709c162fef 17/03/01 04:11:01 INFO storage.DiskBlockManager: Created local directory at /data/12/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/blockmgr-ae26e80f-8f64-40b1-bdb5-185d51caa792 17/03/01 04:11:01 INFO storage.MemoryStore: MemoryStore started with capacity 7.8 GB 17/03/01 04:11:01 INFO executor.CoarseGrainedExecutorBackend: Connecting to driver: akka.tcp://sparkDriver@ipaddress:38995/user/CoarseGrainedScheduler 17/03/01 04:11:01 INFO executor.CoarseGrainedExecutorBackend: Successfully registered with driver 17/03/01 04:11:01 INFO executor.Executor: Starting executor ID 25 on host hostName 17/03/01 04:11:01 INFO util.Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 41809. 17/03/01 04:11:01 INFO netty.NettyBlockTransferService: Server created on 41809 17/03/01 04:11:01 INFO storage.BlockManagerMaster: Trying to register BlockManager 17/03/01 04:11:01 INFO storage.BlockManagerMaster: Registered BlockManager 17/03/01 04:11:02 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 5 17/03/01 04:11:02 INFO executor.Executor: Running task 5.0 in stage 0.0 (TID 5) 17/03/01 04:11:02 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 0 17/03/01 04:11:02 INFO storage.MemoryStore: ensureFreeSpace(1310) called with curMem=0, maxMem=8334920908 17/03/01 04:11:02 INFO storage.MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 1310.0 B, free 7.8 GB) 17/03/01 04:11:02 INFO broadcast.TorrentBroadcast: Reading broadcast variable 0 took 237 ms 17/03/01 04:11:02 INFO storage.MemoryStore: ensureFreeSpace(2064) called with curMem=1310, maxMem=8334920908 17/03/01 04:11:02 INFO storage.MemoryStore: Block broadcast_0 stored as values in memory (estimated size 2.0 KB, free 7.8 GB) 17/03/01 04:11:02 INFO resolver.CompanyResolverSparkTest: Ranjit exec test 17/03/01 04:11:02 INFO executor.Executor: Finished task 5.0 in stage 0.0 (TID 5). 972 bytes result sent to driver 17/03/01 04:12:03 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 48 17/03/01 04:12:03 INFO executor.Executor: Running task 52.0 in stage 2.0 (TID 48) 17/03/01 04:12:03 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 84 17/03/01 04:12:03 INFO storage.MemoryStore: ensureFreeSpace(9240) called with curMem=3374, maxMem=8334920908 17/03/01 04:12:03 INFO storage.MemoryStore: Block broadcast_84_piece0 stored as bytes in memory (estimated size 9.0 KB, free 7.8 GB) 17/03/01 04:12:03 INFO broadcast.TorrentBroadcast: Reading broadcast variable 84 took 45 ms 17/03/01 04:12:03 INFO storage.MemoryStore: ensureFreeSpace(32704) called with curMem=12614, maxMem=8334920908 17/03/01 04:12:03 INFO storage.MemoryStore: Block broadcast_84 stored as values in memory (estimated size 31.9 KB, free 7.8 GB) 17/03/01 04:12:04 INFO codegen.GenerateMutableProjection: Code generated in 95.139526 ms 17/03/01 04:12:04 INFO codegen.GenerateUnsafeProjection: Code generated in 9.418743 ms 17/03/01 04:12:04 INFO codegen.GenerateMutableProjection: Code generated in 13.477166 ms 17/03/01 04:12:04 INFO codegen.GenerateUnsafeRowJoiner: Code generated in 7.9889 ms 17/03/01 04:12:04 INFO codegen.GenerateUnsafeProjection: Code generated in 7.933669 ms 17/03/01 04:12:04 INFO rdd.HadoopRDD: Input split: avro path/part-r-00028-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:0+37517032 17/03/01 04:12:04 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 70 17/03/01 04:12:04 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=45318, maxMem=8334920908 17/03/01 04:12:04 INFO storage.MemoryStore: Block broadcast_70_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:12:04 INFO broadcast.TorrentBroadcast: Reading broadcast variable 70 took 9 ms 17/03/01 04:12:04 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=69961, maxMem=8334920908 17/03/01 04:12:04 INFO storage.MemoryStore: Block broadcast_70 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:12:04 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 17/03/01 04:12:04 INFO Configuration.deprecation: mapred.tip.id is deprecated. Instead, use mapreduce.task.id 17/03/01 04:12:04 INFO Configuration.deprecation: mapred.task.id is deprecated. Instead, use mapreduce.task.attempt.id 17/03/01 04:12:04 INFO Configuration.deprecation: mapred.task.is.map is deprecated. Instead, use mapreduce.task.ismap 17/03/01 04:12:04 INFO Configuration.deprecation: mapred.task.partition is deprecated. Instead, use mapreduce.task.partition 17/03/01 04:12:04 INFO Configuration.deprecation: mapred.job.id is deprecated. Instead, use mapreduce.job.id 17/03/01 04:12:04 WARN security.UserGroupInformation: PriviledgedActionException as:userName (auth:SIMPLE) cause:org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:12:04 WARN ipc.Client: Exception encountered while connecting to the server : org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:12:04 WARN security.UserGroupInformation: PriviledgedActionException as:userName (auth:SIMPLE) cause:org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error 17/03/01 04:12:07 INFO executor.Executor: Finished task 52.0 in stage 2.0 (TID 48). 2495 bytes result sent to driver 17/03/01 04:12:07 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 60 17/03/01 04:12:07 INFO executor.Executor: Running task 53.0 in stage 2.0 (TID 60) 17/03/01 04:12:07 INFO rdd.HadoopRDD: Input split: avro path/part-r-00028-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:37517032+37517032 17/03/01 04:12:08 INFO executor.Executor: Finished task 53.0 in stage 2.0 (TID 60). 2495 bytes result sent to driver 17/03/01 04:12:16 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 75 17/03/01 04:12:16 INFO executor.Executor: Running task 32.0 in stage 2.0 (TID 75) 17/03/01 04:12:16 INFO rdd.HadoopRDD: Input split: avro path/part-r-00032-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:0+42933668 17/03/01 04:12:16 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 60 17/03/01 04:12:16 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=417033, maxMem=8334920908 17/03/01 04:12:16 INFO storage.MemoryStore: Block broadcast_60_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:12:16 INFO broadcast.TorrentBroadcast: Reading broadcast variable 60 took 8 ms 17/03/01 04:12:16 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=441676, maxMem=8334920908 17/03/01 04:12:16 INFO storage.MemoryStore: Block broadcast_60 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:12:18 INFO executor.Executor: Finished task 32.0 in stage 2.0 (TID 75). 2495 bytes result sent to driver 17/03/01 04:12:38 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 160 17/03/01 04:12:38 INFO executor.Executor: Running task 38.0 in stage 4.0 (TID 160) 17/03/01 04:12:38 INFO spark.MapOutputTrackerWorker: Updating epoch to 1 and clearing cache 17/03/01 04:12:38 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 86 17/03/01 04:12:38 INFO storage.MemoryStore: ensureFreeSpace(2290) called with curMem=788748, maxMem=8334920908 17/03/01 04:12:38 INFO storage.MemoryStore: Block broadcast_86_piece0 stored as bytes in memory (estimated size 2.2 KB, free 7.8 GB) 17/03/01 04:12:38 INFO broadcast.TorrentBroadcast: Reading broadcast variable 86 took 7 ms 17/03/01 04:12:38 INFO storage.MemoryStore: ensureFreeSpace(6544) called with curMem=791038, maxMem=8334920908 17/03/01 04:12:38 INFO storage.MemoryStore: Block broadcast_86 stored as values in memory (estimated size 6.4 KB, free 7.8 GB) 17/03/01 04:12:38 INFO resolver.CompanyResolverSparkTest: testing worker[ipaddress:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509, hostName:47500..47509] 17/03/01 04:12:38 ERROR : Failed to resolve default logging config file: config/java.util.logging.properties Console logging handler is not configured. 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: >>> __________ ________________ >>> / _/ ___/ |/ / _/_ __/ __/ >>> _/ // (7 7 // / / / / _/ >>> /___/\___/_/|_/___/ /_/ /___/ >>> >>> ver. 1.8.0#20161205-sha1:9ca40dbe >>> 2016 Copyright(C) Apache Software Foundation >>> >>> Ignite documentation: http://ignite.apache.org 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Config URL: n/a 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Daemon mode: off 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: OS: Linux 2.6.32-431.5.1.el6.x86_64 amd64 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: OS user: userName 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: PID: 10216 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Language runtime: Java Platform API Specification ver. 1.8 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM information: Java(TM) SE Runtime Environment 1.8.0_60-b27 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.60-b23 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM total memory: 14.0GB 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Remote Management [restart: off, REST: on, JMX (remote: off)] 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: IGNITE_HOME=null 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: VM arguments: [-XX:OnOutOfMemoryError=kill %p, -Xms15360m, -Xmx15360m, -Djava.io.tmpdir=/data/1/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/container_e76_1487862040010_131981_01_000028/tmp, -Dspark.driver.port=38995, -Dspark.ui.port=0, -Dspark.yarn.app.container.log.dir=/data/7/yarn/log/container/application_1487862040010_131981/container_e76_1487862040010_131981_01_000028] 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Configured caches ['ignite-marshaller-sys-cache', 'ignite-sys-cache', 'ignite-atomics-sys-cache'] 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: Configured plugins: 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: ^-- None 17/03/01 04:12:38 INFO plugin.IgnitePluginProcessor: 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: IPC shared memory server endpoint started [port=48100, tokDir=/data/1/yarn/nm/usercache/userName/appcache/application_1487862040010_131981/container_e76_1487862040010_131981_01_000028/tmp/ignite/work/ipc/shmem/ffe19475-7849-4027-8648-ce56598ff50f-10216] 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: Successfully bound shared memory communication to TCP port [port=48100, locHost=0.0.0.0/0.0.0.0] 17/03/01 04:12:38 INFO tcp.TcpCommunicationSpi: Successfully bound to TCP port [port=47100, locHost=0.0.0.0/0.0.0.0] 17/03/01 04:12:38 WARN noop.NoopCheckpointSpi: Checkpoints are disabled (to enable configure any GridCheckpointSpi implementation) 17/03/01 04:12:38 WARN collision.GridCollisionManager: Collision resolution is disabled (all jobs will be activated upon arrival). 17/03/01 04:12:38 WARN noop.NoopSwapSpaceSpi: Swap space is disabled. To enable use FileSwapSpaceSpi. 17/03/01 04:12:38 INFO internal.IgniteKernal%WCA: Security status [authentication=off, tls/ssl=off] 17/03/01 04:12:39 INFO tcp.GridTcpRestProtocol: Command protocol successfully started [name=TCP binary, host=0.0.0.0/0.0.0.0, port=11211] 17/03/01 04:12:39 INFO internal.IgniteKernal%WCA: Non-loopback local IPs: 7 17/03/01 04:12:39 INFO internal.IgniteKernal%WCA: Enabled local MACs: 44A84210B1AC 17/03/01 04:12:39 INFO tcp.TcpDiscoverySpi: Successfully bound to TCP port [port=47501, localHost=0.0.0.0/0.0.0.0, locNodeId=ffe19475-7849-4027-8648-ce56598ff50f] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=8be1bd05-d62c-4f1a-83f2-91dcb3f3b62a, addrs=[07, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/07:47500], discPort=47500, order=12, intOrder=12, lastExchangeTime=1488363160489, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=12, servers=12, clients=0, CPUs=504, heap=200.0GB] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=133c388f-3399-4cc8-b2f1-7ae8ba971b03, addrs=[7, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/7:47500], discPort=47500, order=13, intOrder=13, lastExchangeTime=1488363160499, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=13, servers=13, clients=0, CPUs=544, heap=220.0GB] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=23f61699-e2c9-4ff6-8731-2483934e84c4, addrs=[0, 127.0.0.1], sockAddrs=[hostName/0:47500, /127.0.0.1:47500], discPort=47500, order=14, intOrder=14, lastExchangeTime=1488363160509, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:40 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=14, servers=14, clients=0, CPUs=584, heap=230.0GB] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=95f164b5-4b73-438f-804f-62854d615b5b, addrs=[9, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/9:47500], discPort=47500, order=15, intOrder=15, lastExchangeTime=1488363160519, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=15, servers=15, clients=0, CPUs=624, heap=250.0GB] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=c4f4f6bb-b71a-4a29-9575-afee2ddc1b2d, addrs=[6, 127.0.0.1], sockAddrs=[hostName/6:47500, /127.0.0.1:47500], discPort=47500, order=16, intOrder=16, lastExchangeTime=1488363160519, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=16, servers=16, clients=0, CPUs=664, heap=260.0GB] 17/03/01 04:12:41 INFO cache.GridCacheProcessor: Started cache [name=ignite-sys-cache, mode=REPLICATED] 17/03/01 04:12:41 INFO cache.GridCacheProcessor: Started cache [name=ignite-atomics-sys-cache, mode=PARTITIONED] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=ddc47224-d030-4d1f-ba66-08f61368a395, addrs=[4, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/4:47500], discPort=47500, order=17, intOrder=17, lastExchangeTime=1488363160529, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=17, servers=17, clients=0, CPUs=704, heap=280.0GB] 17/03/01 04:12:41 INFO cache.GridCacheProcessor: Started cache [name=WCAIgniteCache, mode=PARTITIONED] 17/03/01 04:12:41 INFO cache.GridCacheProcessor: Started cache [name=ignite-marshaller-sys-cache, mode=REPLICATED] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=47c1a0d8-9d4d-4d0d-9b27-388bd7f49278, addrs=[1, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/1:47500], discPort=47500, order=18, intOrder=18, lastExchangeTime=1488363160529, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=18, servers=18, clients=0, CPUs=744, heap=290.0GB] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=e87f12ce-5981-4418-8468-f6bfed0a0cd8, addrs=[6, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/6:47500], discPort=47500, order=19, intOrder=19, lastExchangeTime=1488363160539, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=19, servers=19, clients=0, CPUs=784, heap=310.0GB] 17/03/01 04:12:41 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=11, minorTopVer=0], evt=NODE_JOINED, node=ffe19475-7849-4027-8648-ce56598ff50f] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=e2cba212-89dd-48dd-8d7e-821b5725fe03, addrs=[8, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/8:47500], discPort=47500, order=20, intOrder=20, lastExchangeTime=1488363160559, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=20, servers=20, clients=0, CPUs=816, heap=320.0GB] 17/03/01 04:12:41 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=12, minorTopVer=0], evt=NODE_JOINED, node=8be1bd05-d62c-4f1a-83f2-91dcb3f3b62a] 17/03/01 04:12:41 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=13, minorTopVer=0], evt=NODE_JOINED, node=133c388f-3399-4cc8-b2f1-7ae8ba971b03] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=f9ce8dd7-2060-4c34-b597-d7bee86ebedb, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=21, intOrder=21, lastExchangeTime=1488363160569, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:41 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=21, servers=21, clients=0, CPUs=856, heap=340.0GB] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=14, minorTopVer=0], evt=NODE_JOINED, node=23f61699-e2c9-4ff6-8731-2483934e84c4] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=6b1889dd-9de5-4f1b-8ec9-c123c7df8ea2, addrs=[, 127.0.0.1], sockAddrs=[hostName/:47500, /127.0.0.1:47500], discPort=47500, order=22, intOrder=22, lastExchangeTime=1488363160569, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=22, servers=22, clients=0, CPUs=896, heap=350.0GB] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=15, minorTopVer=0], evt=NODE_JOINED, node=95f164b5-4b73-438f-804f-62854d615b5b] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=9fb6e583-cea0-4f78-b403-b403a8bc9a0e, addrs=[7, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/7:47500], discPort=47500, order=23, intOrder=23, lastExchangeTime=1488363160580, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=23, servers=23, clients=0, CPUs=936, heap=370.0GB] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=20860cae-2881-4311-a3f5-edaa160ef37f, addrs=[7, 127.0.0.1], sockAddrs=[hostName/7:47500, /127.0.0.1:47500], discPort=47500, order=24, intOrder=24, lastExchangeTime=1488363160580, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=24, servers=24, clients=0, CPUs=976, heap=380.0GB] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=16, minorTopVer=0], evt=NODE_JOINED, node=c4f4f6bb-b71a-4a29-9575-afee2ddc1b2d] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=0d675d57-b9b9-4cff-a994-77337d618bbe, addrs=[4, 127.0.0.1], sockAddrs=[hostName/4:47500, /127.0.0.1:47500], discPort=47500, order=25, intOrder=25, lastExchangeTime=1488363160590, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=25, servers=25, clients=0, CPUs=1016, heap=400.0GB] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=17, minorTopVer=0], evt=NODE_JOINED, node=ddc47224-d030-4d1f-ba66-08f61368a395] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=a6343860-6e84-4d9c-9b87-84ffd76280cd, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=26, intOrder=26, lastExchangeTime=1488363160590, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=26, servers=26, clients=0, CPUs=1056, heap=410.0GB] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=18, minorTopVer=0], evt=NODE_JOINED, node=47c1a0d8-9d4d-4d0d-9b27-388bd7f49278] 17/03/01 04:12:42 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=19, minorTopVer=0], evt=NODE_JOINED, node=e87f12ce-5981-4418-8468-f6bfed0a0cd8] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=479b18e6-54af-4313-85f7-c7525f6229a4, addrs=[, 127.0.0.1], sockAddrs=[hostName/:47500, /127.0.0.1:47500], discPort=47500, order=27, intOrder=27, lastExchangeTime=1488363160600, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:42 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=27, servers=27, clients=0, CPUs=1104, heap=430.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=20, minorTopVer=0], evt=NODE_JOINED, node=e2cba212-89dd-48dd-8d7e-821b5725fe03] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=058a99e8-3b65-4ec9-84b0-6f3502c2afce, addrs=[, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/:47500], discPort=47500, order=28, intOrder=28, lastExchangeTime=1488363160670, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=28, servers=28, clients=0, CPUs=1144, heap=440.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=21, minorTopVer=0], evt=NODE_JOINED, node=f9ce8dd7-2060-4c34-b597-d7bee86ebedb] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=57c09d88-a4dc-4179-98b4-1144fd97d8cc, addrs=[35, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/35:47500], discPort=47500, order=29, intOrder=29, lastExchangeTime=1488363160700, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=29, servers=29, clients=0, CPUs=1192, heap=460.0GB] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=58298821-7aa9-4b58-ba15-e7f1ef2830fb, addrs=[3, 127.0.0.1], sockAddrs=[hostName/3:47500, /127.0.0.1:47500], discPort=47500, order=30, intOrder=30, lastExchangeTime=1488363160700, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=30, servers=30, clients=0, CPUs=1232, heap=470.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=22, minorTopVer=0], evt=NODE_JOINED, node=6b1889dd-9de5-4f1b-8ec9-c123c7df8ea2] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4d5de2f3-d975-4b28-b593-0cc0481cdc74, addrs=[03, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/03:47500], discPort=47500, order=31, intOrder=31, lastExchangeTime=1488363160822, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=31, servers=31, clients=0, CPUs=1280, heap=490.0GB] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=fa09caab-f4dc-43b6-ac8b-4a4bae6e7da6, addrs=[01, 127.0.0.1], sockAddrs=[hostName/01:47500, /127.0.0.1:47500], discPort=47500, order=32, intOrder=32, lastExchangeTime=1488363161487, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=32, servers=32, clients=0, CPUs=1320, heap=500.0GB] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=23, minorTopVer=0], evt=NODE_JOINED, node=9fb6e583-cea0-4f78-b403-b403a8bc9a0e] 17/03/01 04:12:43 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=24, minorTopVer=0], evt=NODE_JOINED, node=20860cae-2881-4311-a3f5-edaa160ef37f] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=af5837f0-25ec-4f3d-a1c1-90c09dc424cb, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=33, intOrder=33, lastExchangeTime=1488363161618, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:43 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=33, servers=33, clients=0, CPUs=1360, heap=520.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=25, minorTopVer=0], evt=NODE_JOINED, node=0d675d57-b9b9-4cff-a994-77337d618bbe] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=e9e49d2d-5eeb-474f-8757-e447efc8ca8f, addrs=[6, 127.0.0.1], sockAddrs=[hostName/6:47500, /127.0.0.1:47500], discPort=47500, order=34, intOrder=34, lastExchangeTime=1488363161618, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=34, servers=34, clients=0, CPUs=1400, heap=530.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=26, minorTopVer=0], evt=NODE_JOINED, node=a6343860-6e84-4d9c-9b87-84ffd76280cd] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4b90e5a3-253a-435b-84ca-6b592610cf0c, addrs=[4, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/4:47500], discPort=47500, order=35, intOrder=35, lastExchangeTime=1488363161628, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=35, servers=35, clients=0, CPUs=1432, heap=550.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=27, minorTopVer=0], evt=NODE_JOINED, node=479b18e6-54af-4313-85f7-c7525f6229a4] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=8fd4eea2-2a45-4563-ae87-1848fd388a98, addrs=[3, 127.0.0.1], sockAddrs=[hostName/3:47500, /127.0.0.1:47500], discPort=47500, order=36, intOrder=36, lastExchangeTime=1488363161638, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=36, servers=36, clients=0, CPUs=1472, heap=560.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=28, minorTopVer=0], evt=NODE_JOINED, node=058a99e8-3b65-4ec9-84b0-6f3502c2afce] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=d7b45a02-0411-4028-acdf-f004e592f294, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=37, intOrder=37, lastExchangeTime=1488363161927, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=37, servers=37, clients=0, CPUs=1512, heap=580.0GB] 17/03/01 04:12:44 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=29, minorTopVer=0], evt=NODE_JOINED, node=57c09d88-a4dc-4179-98b4-1144fd97d8cc] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=cf4e6e83-207e-42da-a55c-5621bc20b891, addrs=[8, 127.0.0.1], sockAddrs=[hostName/8:47500, /127.0.0.1:47500], discPort=47500, order=38, intOrder=38, lastExchangeTime=1488363162675, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:44 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=38, servers=38, clients=0, CPUs=1552, heap=590.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=30, minorTopVer=0], evt=NODE_JOINED, node=58298821-7aa9-4b58-ba15-e7f1ef2830fb] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=d8926a2c-2c00-4445-beb4-633c2d656c41, addrs=[2, 127.0.0.1], sockAddrs=[hostName/2:47500, /127.0.0.1:47500], discPort=47500, order=39, intOrder=39, lastExchangeTime=1488363162685, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=39, servers=39, clients=0, CPUs=1584, heap=610.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=31, minorTopVer=0], evt=NODE_JOINED, node=4d5de2f3-d975-4b28-b593-0cc0481cdc74] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=4136a0c9-14d5-42b3-9a60-81689c800438, addrs=[3, 127.0.0.1], sockAddrs=[/127.0.0.1:47500, hostName/3:47500], discPort=47500, order=40, intOrder=40, lastExchangeTime=1488363162907, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=40, servers=40, clients=0, CPUs=1624, heap=620.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=32, minorTopVer=0], evt=NODE_JOINED, node=fa09caab-f4dc-43b6-ac8b-4a4bae6e7da6] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Added new node to topology: TcpDiscoveryNode [id=694a80b8-02a3-44c9-a2dd-45bed7d20a50, addrs=[1, 127.0.0.1], sockAddrs=[hostName/1:47500, /127.0.0.1:47500], discPort=47500, order=41, intOrder=41, lastExchangeTime=1488363162917, loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, isClient=false] 17/03/01 04:12:45 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=41, servers=41, clients=0, CPUs=1664, heap=640.0GB] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=33, minorTopVer=0], evt=NODE_JOINED, node=af5837f0-25ec-4f3d-a1c1-90c09dc424cb] 17/03/01 04:12:45 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=34, minorTopVer=0], evt=NODE_JOINED, node=e9e49d2d-5eeb-474f-8757-e447efc8ca8f] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=35, minorTopVer=0], evt=NODE_JOINED, node=4b90e5a3-253a-435b-84ca-6b592610cf0c] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=36, minorTopVer=0], evt=NODE_JOINED, node=8fd4eea2-2a45-4563-ae87-1848fd388a98] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=37, minorTopVer=0], evt=NODE_JOINED, node=d7b45a02-0411-4028-acdf-f004e592f294] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=38, minorTopVer=0], evt=NODE_JOINED, node=cf4e6e83-207e-42da-a55c-5621bc20b891] 17/03/01 04:12:46 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=39, minorTopVer=0], evt=NODE_JOINED, node=d8926a2c-2c00-4445-beb4-633c2d656c41] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=40, minorTopVer=0], evt=NODE_JOINED, node=4136a0c9-14d5-42b3-9a60-81689c800438] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-sys-cache, waitList=[]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-marshaller-sys-cache, waitList=[]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=ignite-atomics-sys-cache, waitList=[ignite-sys-cache, ignite-marshaller-sys-cache]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Cache rebalancing scheduled: [cache=WCAIgniteCache, waitList=[ignite-sys-cache, ignite-marshaller-sys-cache, ignite-atomics-sys-cache]] 17/03/01 04:12:47 INFO cache.GridCachePartitionExchangeManager: Rebalancing required [top=AffinityTopologyVersion [topVer=41, minorTopVer=0], evt=NODE_JOINED, node=694a80b8-02a3-44c9-a2dd-45bed7d20a50] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-marshaller-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=20, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=31] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=100, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=31] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-marshaller-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=20 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=20 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=ignite-atomics-sys-cache, mode=SYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=20, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=31] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=ignite-atomics-sys-cache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=10 ms] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Starting rebalancing [cache=WCAIgniteCache, mode=ASYNC, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, partitionsCount=20, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], updateSeq=31] 17/03/01 04:12:47 INFO preloader.GridDhtPartitionDemander: Completed (final) rebalancing [cache=WCAIgniteCache, fromNode=6172ee3a-eb33-4bf5-9080-c255f52caed8, topology=AffinityTopologyVersion [topVer=41, minorTopVer=0], time=0 ms] 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: 17/03/01 04:12:47 INFO internal.IgniteKernal%WCA: >>> +----------------------------------------------------------------------+ >>> Ignite ver. 1.8.0#20161205-sha1:9ca40dbeb7d559fcb299bdb6f5c90cdf8ce7e533 >>> +----------------------------------------------------------------------+ >>> OS name: Linux 2.6.32-431.5.1.el6.x86_64 amd64 >>> CPU(s): 40 >>> Heap: 15.0GB >>> VM name: 10216@hostName >>> Grid name: WCA >>> Local node [ID=FFE19475-7849-4027-8648-CE56598FF50F, order=11, clientMode=false] >>> Local node addresses: [hostName/7, /127.0.0.1] >>> Local ports: TCP:11211 TCP:47100 TCP:47501 TCP:48100 17/03/01 04:12:47 INFO discovery.GridDiscoveryManager: Topology snapshot [ver=11, servers=11, clients=0, CPUs=472, heap=190.0GB] 17/03/01 04:12:47 INFO resolver.CompanyResolverSparkTest: Started ignite node on executor 17/03/01 04:12:47 INFO executor.Executor: Finished task 38.0 in stage 4.0 (TID 160). 931 bytes result sent to driver 17/03/01 04:12:49 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 170 17/03/01 04:12:49 INFO executor.Executor: Running task 52.0 in stage 5.0 (TID 170) 17/03/01 04:12:49 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 128 17/03/01 04:12:49 INFO storage.MemoryStore: ensureFreeSpace(7311) called with curMem=12208, maxMem=8334920908 17/03/01 04:12:49 INFO storage.MemoryStore: Block broadcast_128_piece0 stored as bytes in memory (estimated size 7.1 KB, free 7.8 GB) 17/03/01 04:12:49 INFO broadcast.TorrentBroadcast: Reading broadcast variable 128 took 7 ms 17/03/01 04:12:49 INFO storage.MemoryStore: ensureFreeSpace(28168) called with curMem=19519, maxMem=8334920908 17/03/01 04:12:49 INFO storage.MemoryStore: Block broadcast_128 stored as values in memory (estimated size 27.5 KB, free 7.8 GB) 17/03/01 04:12:49 INFO rdd.HadoopRDD: Input split: avro path/part-r-00028-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:0+37517032 17/03/01 04:12:49 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 114 17/03/01 04:12:49 INFO storage.MemoryStore: ensureFreeSpace(24643) called with curMem=47687, maxMem=8334920908 17/03/01 04:12:49 INFO storage.MemoryStore: Block broadcast_114_piece0 stored as bytes in memory (estimated size 24.1 KB, free 7.8 GB) 17/03/01 04:12:49 INFO broadcast.TorrentBroadcast: Reading broadcast variable 114 took 6 ms 17/03/01 04:12:49 INFO storage.MemoryStore: ensureFreeSpace(347072) called with curMem=72330, maxMem=8334920908 17/03/01 04:12:49 INFO storage.MemoryStore: Block broadcast_114 stored as values in memory (estimated size 338.9 KB, free 7.8 GB) 17/03/01 04:12:49 INFO cache.GridCachePartitionExchangeManager: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=41, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, node=6172ee3a-eb33-4bf5-9080-c255f52caed8] 17/03/01 04:12:56 INFO executor.Executor: Finished task 52.0 in stage 5.0 (TID 170). 2098 bytes result sent to driver 17/03/01 04:12:56 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 196 17/03/01 04:12:56 INFO executor.Executor: Running task 53.0 in stage 5.0 (TID 196) 17/03/01 04:12:56 INFO rdd.HadoopRDD: Input split: avro path/part-r-00028-e2d588f7-4d78-408b-a7ae-960ebf9472b5.avro:37517032+37517032 17/03/01 04:13:01 INFO executor.Executor: Finished task 53.0 in stage 5.0 (TID 196). 2098 bytes result sent to driver 17/03/01 04:13:47 INFO internal.IgniteKernal%WCA: Metrics for local node (to disable set 'metricsLogFrequency' to 0) ^-- Node [id=ffe19475, name=WCA, uptime=00:01:00:011] ^-- H/N/C [hosts=41, nodes=41, CPUs=1664] ^-- CPU [cur=1.8%, avg=2.77%, GC=0%] ^-- Heap [used=1869MB, free=87.23%, comm=14632MB] ^-- Non heap [used=120MB, free=-1%, comm=122MB] ^-- Public thread pool [active=0, idle=0, qSize=0] ^-- System thread pool [active=0, idle=80, qSize=0] ^-- Outbound messages queue [size=0] 17/03/01 04:13:50 INFO cluster.GridUpdateNotifier: Update status is not available. 17/03/01 04:14:00 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 246 17/03/01 04:14:00 INFO executor.Executor: Running task 2.0 in stage 7.0 (TID 246) 17/03/01 04:14:00 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 131 17/03/01 04:14:00 INFO storage.MemoryStore: ensureFreeSpace(2732) called with curMem=407194, maxMem=8334920908 17/03/01 04:14:00 INFO storage.MemoryStore: Block broadcast_131_piece0 stored as bytes in memory (estimated size 2.7 KB, free 7.8 GB) 17/03/01 04:14:00 INFO broadcast.TorrentBroadcast: Reading broadcast variable 131 took 17 ms 17/03/01 04:14:00 INFO storage.MemoryStore: ensureFreeSpace(7336) called with curMem=409926, maxMem=8334920908 17/03/01 04:14:00 INFO storage.MemoryStore: Block broadcast_131 stored as values in memory (estimated size 7.2 KB, free 7.8 GB) 17/03/01 04:14:11 ERROR executor.Executor: Exception in task 2.0 in stage 7.0 (TID 246) javax.cache.CacheException: class org.apache.ignite.IgniteCheckedException: Query execution failed: GridCacheQueryBean [qry=GridCacheQueryAdapter [type=TEXT, clsName=CompanyVO1, clause=MCCULLOUGH CONSTRUCTION, filter=null, transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=true, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=ffe19475-7849-4027-8648-ce56598ff50f, taskHash=0], rdc=null, trans=null] at org.apache.ignite.internal.processors.cache.GridCacheUtils.convertToCacheException(GridCacheUtils.java:1440) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.next(GridCacheQueryFutureAdapter.java:174) at org.apache.ignite.internal.processors.cache.IgniteCacheProxy$5.onHasNext(IgniteCacheProxy.java:600) at org.apache.ignite.internal.util.GridCloseableIteratorAdapter.hasNextX(GridCloseableIteratorAdapter.java:53) at org.apache.ignite.internal.util.lang.GridIteratorAdapter.hasNext(GridIteratorAdapter.java:45) at un.api.resolver.dao.CompanyDAO.getVarCompContains(CompanyDAO.scala:242) at un.api.resolver.accessor.CompanyAccessor.getVarCompContains(CompanyAccessor.scala:27) at un.api.resolver.CompanyResolverSparkTest$$anonfun$main$7.apply(CompanyResolverSparkTest.scala:291) at un.api.resolver.CompanyResolverSparkTest$$anonfun$main$7.apply(CompanyResolverSparkTest.scala:289) at scala.collection.Iterator$$anon$11.next(Iterator.scala:328) at org.apache.spark.util.Utils$.getIteratorSize(Utils.scala:1554) at org.apache.spark.rdd.RDD$$anonfun$count$1.apply(RDD.scala:1121) at org.apache.spark.rdd.RDD$$anonfun$count$1.apply(RDD.scala:1121) at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1850) at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1850) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:66) at org.apache.spark.scheduler.Task.run(Task.scala:88) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:214) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: class org.apache.ignite.IgniteCheckedException: Query execution failed: GridCacheQueryBean [qry=GridCacheQueryAdapter [type=TEXT, clsName=CompanyVO1, clause=MCCULLOUGH CONSTRUCTION, filter=null, transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=true, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=ffe19475-7849-4027-8648-ce56598ff50f, taskHash=0], rdc=null, trans=null] at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.checkError(GridCacheQueryFutureAdapter.java:260) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.internalIterator(GridCacheQueryFutureAdapter.java:318) at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.next(GridCacheQueryFutureAdapter.java:164) ... 19 more Caused by: class org.apache.ignite.IgniteCheckedException: Failed to execute query on node [query=GridCacheQueryBean [qry=GridCacheQueryAdapter [type=TEXT, clsName=CompanyVO1, clause=MCCULLOUGH CONSTRUCTION, filter=null, transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=true, incBackups=false, dedup=false, prj=null, keepBinary=false, subjId=ffe19475-7849-4027-8648-ce56598ff50f, taskHash=0], rdc=null, trans=null], nodeId=23f61699-e2c9-4ff6-8731-2483934e84c4] at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.onPage(GridCacheQueryFutureAdapter.java:383) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.processQueryResponse(GridCacheDistributedQueryManager.java:398) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.access$000(GridCacheDistributedQueryManager.java:63) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$1.apply(GridCacheDistributedQueryManager.java:93) at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$1.apply(GridCacheDistributedQueryManager.java:91) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.processMessage(GridCacheIoManager.java:827) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.onMessage0(GridCacheIoManager.java:369) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.access$400(GridCacheIoManager.java:95) at org.apache.ignite.internal.processors.cache.GridCacheIoManager$OrderedMessageListener.onMessage(GridCacheIoManager.java:1345) at org.apache.ignite.internal.managers.communication.GridIoManager.invokeListener(GridIoManager.java:1082) at org.apache.ignite.internal.managers.communication.GridIoManager.access$1600(GridIoManager.java:102) at org.apache.ignite.internal.managers.communication.GridIoManager$GridCommunicationMessageSet.unwind(GridIoManager.java:2332) at org.apache.ignite.internal.managers.communication.GridIoManager.unwindMessageSet(GridIoManager.java:1042) at org.apache.ignite.internal.managers.communication.GridIoManager.access$1900(GridIoManager.java:102) at org.apache.ignite.internal.managers.communication.GridIoManager$6.run(GridIoManager.java:1011) ... 3 more Caused by: java.lang.NullPointerException 17/03/01 04:14:11 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 308 17/03/01 04:14:11 INFO executor.Executor: Running task 2.1 in stage 7.0 (TID 308) 17/03/01 04:14:31 INFO executor.Executor: Finished task 2.1 in stage 7.0 (TID 308). 969 bytes result sent to driver 17/03/01 04:14:47 INFO internal.IgniteKernal%WCA: Metrics for local node (to disable set 'metricsLogFrequency' to 0) ^-- Node [id=ffe19475, name=WCA, uptime=00:02:00:026] ^-- H/N/C [hosts=41, nodes=41, CPUs=1664] ^-- CPU [cur=0.1%, avg=2.82%, GC=0%] ^-- Heap [used=3490MB, free=75.82%, comm=14437MB] ^-- Non heap [used=125MB, free=-1%, comm=127MB] ^-- Public thread pool [active=0, idle=0, qSize=0] ^-- System thread pool [active=0, idle=80, qSize=0] ^-- Outbound messages queue [size=0]