Details
-
Bug
-
Status: Closed
-
Blocker
-
Resolution: Fixed
-
ignite-1.4
-
None
-
Cent OS
jdk 1.7
Description
I try to create an instance of IgniteContext is to use a configuration file:
Step 0
Start spark master, worker and ignite node with default-config.xml
Step1
$export IGNITE_HOME=/home/gridgain/isuntsov/gridgain-community-fabric-1.3.2/ $ echo $IGNITE_HOME /home/gridgain/isuntsov/gridgain-community-fabric-1.3.2/
Step2
./spark-shell --packages org.apache.ignite:ignite-spark:1.3.2 --master spark://fosters-218:7077 --repositories http://www.gridgainsystems.com/nexus/content/repositories/external
Ivy Default Cache set to: /home/gridgain/.ivy2/cache
The jars for the packages stored in: /home/gridgain/.ivy2/jars
http://www.gridgainsystems.com/nexus/content/repositories/external added as a remote repository with the name: repo-1
:: loading settings :: url = jar:file:/home/gridgain/isuntsov/spark-1.3.1-bin-hadoop2.6/lib/spark-assembly-1.3.1-hadoop2.6.0.jar!/org/apache/ivy/core/settings/ivysettings.xml
org.apache.ignite#ignite-spark added as a dependency
:: resolving dependencies :: org.apache.spark#spark-submit-parent;1.0
confs: [default]
found org.apache.ignite#ignite-spark;1.3.2 in repo-1
found org.apache.ignite#ignite-core;1.3.2 in repo-1
found javax.cache#cache-api;1.0.0 in central
found org.gridgain#ignite-shmem;1.0.0 in central
found org.apache.ignite#ignite-indexing;1.3.2 in repo-1
found commons-codec#commons-codec;1.6 in central
found org.apache.lucene#lucene-core;3.5.0 in central
found com.h2database#h2;1.3.175 in central
found org.apache.ignite#ignite-spring;1.3.2 in repo-1
found org.springframework#spring-core;4.1.0.RELEASE in central
found org.springframework#spring-aop;4.1.0.RELEASE in central
found aopalliance#aopalliance;1.0 in central
found org.springframework#spring-beans;4.1.0.RELEASE in central
found org.springframework#spring-context;4.1.0.RELEASE in central
found org.springframework#spring-expression;4.1.0.RELEASE in central
found org.springframework#spring-tx;4.1.0.RELEASE in central
found org.springframework#spring-jdbc;4.1.0.RELEASE in central
found commons-logging#commons-logging;1.1.1 in central
found org.apache.ignite#ignite-log4j;1.3.2 in repo-1
found log4j#log4j;1.2.17 in central
:: resolution report :: resolve 811ms :: artifacts dl 23ms
:: modules in use:
aopalliance#aopalliance;1.0 from central in [default]
com.h2database#h2;1.3.175 from central in [default]
commons-codec#commons-codec;1.6 from central in [default]
commons-logging#commons-logging;1.1.1 from central in [default]
javax.cache#cache-api;1.0.0 from central in [default]
log4j#log4j;1.2.17 from central in [default]
org.apache.ignite#ignite-core;1.3.2 from repo-1 in [default]
org.apache.ignite#ignite-indexing;1.3.2 from repo-1 in [default]
org.apache.ignite#ignite-log4j;1.3.2 from repo-1 in [default]
org.apache.ignite#ignite-spark;1.3.2 from repo-1 in [default]
org.apache.ignite#ignite-spring;1.3.2 from repo-1 in [default]
org.apache.lucene#lucene-core;3.5.0 from central in [default]
org.gridgain#ignite-shmem;1.0.0 from central in [default]
org.springframework#spring-aop;4.1.0.RELEASE from central in [default]
org.springframework#spring-beans;4.1.0.RELEASE from central in [default]
org.springframework#spring-context;4.1.0.RELEASE from central in [default]
org.springframework#spring-core;4.1.0.RELEASE from central in [default]
org.springframework#spring-expression;4.1.0.RELEASE from central in [default]
org.springframework#spring-jdbc;4.1.0.RELEASE from central in [default]
org.springframework#spring-tx;4.1.0.RELEASE from central in [default]
:: evicted modules:
commons-logging#commons-logging;1.1.3 by [commons-logging#commons-logging;1.1.1] in [default]
---------------------------------------------------------------------
| | modules || artifacts |
| conf | number| search|dwnlded|evicted|| number|dwnlded|
---------------------------------------------------------------------
| default | 21 | 0 | 0 | 1 || 20 | 0 |
---------------------------------------------------------------------
:: retrieving :: org.apache.spark#spark-submit-parent
confs: [default]
0 artifacts copied, 20 already retrieved (0kB/16ms)
log4j:WARN No appenders could be found for logger (org.apache.hadoop.metrics2.lib.MutableMetricsFactory).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
15/07/30 02:25:01 INFO SecurityManager: Changing view acls to: gridgain
15/07/30 02:25:01 INFO SecurityManager: Changing modify acls to: gridgain
15/07/30 02:25:01 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(gridgain); users with modify permissions: Set(gridgain)
15/07/30 02:25:01 INFO HttpServer: Starting HTTP Server
15/07/30 02:25:01 INFO Server: jetty-8.y.z-SNAPSHOT
15/07/30 02:25:01 INFO AbstractConnector: Started SocketConnector@0.0.0.0:45663
15/07/30 02:25:01 INFO Utils: Successfully started service 'HTTP class server' on port 45663.
Welcome to
____ __
/ __/__ ___ _____/ /__
_\ \/ _ \/ _ `/ __/ '_/
/___/ .__/\_,_/_/ /_/\_\ version 1.3.1
/_/
Using Scala version 2.10.4 (Java HotSpot(TM) 64-Bit Server VM, Java 1.7.0_75)
Type in expressions to have them evaluated.
Type :help for more information.
15/07/30 02:25:04 INFO SparkContext: Running Spark version 1.3.1
15/07/30 02:25:04 INFO SecurityManager: Changing view acls to: gridgain
15/07/30 02:25:04 INFO SecurityManager: Changing modify acls to: gridgain
15/07/30 02:25:04 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(gridgain); users with modify permissions: Set(gridgain)
15/07/30 02:25:04 INFO Slf4jLogger: Slf4jLogger started
15/07/30 02:25:04 INFO Remoting: Starting remoting
15/07/30 02:25:04 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://sparkDriver@fosters-221:59114]
15/07/30 02:25:04 INFO Utils: Successfully started service 'sparkDriver' on port 59114.
15/07/30 02:25:04 INFO SparkEnv: Registering MapOutputTracker
15/07/30 02:25:04 INFO SparkEnv: Registering BlockManagerMaster
15/07/30 02:25:04 INFO DiskBlockManager: Created local directory at /tmp/spark-f45b7974-83aa-4523-915d-0547ecaaec48/blockmgr-6ca6af17-57bb-4a24-b621-79ea23b6bc69
15/07/30 02:25:04 INFO MemoryStore: MemoryStore started with capacity 265.4 MB
15/07/30 02:25:04 INFO HttpFileServer: HTTP File server directory is /tmp/spark-5a1bab16-2a8d-4f1b-89b9-49dc2c9d5621/httpd-3363f5ca-2c27-4c86-8c3a-790a5f7b1c54
15/07/30 02:25:04 INFO HttpServer: Starting HTTP Server
15/07/30 02:25:04 INFO Server: jetty-8.y.z-SNAPSHOT
15/07/30 02:25:04 INFO AbstractConnector: Started SocketConnector@0.0.0.0:52473
15/07/30 02:25:04 INFO Utils: Successfully started service 'HTTP file server' on port 52473.
15/07/30 02:25:04 INFO SparkEnv: Registering OutputCommitCoordinator
15/07/30 02:25:04 INFO Server: jetty-8.y.z-SNAPSHOT
15/07/30 02:25:04 INFO AbstractConnector: Started SelectChannelConnector@0.0.0.0:4040
15/07/30 02:25:04 INFO Utils: Successfully started service 'SparkUI' on port 4040.
15/07/30 02:25:04 INFO SparkUI: Started SparkUI at http://fosters-221:4040
15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/ignite-spark.jar at http://10.20.0.221:52473/jars/ignite-spark.jar with timestamp 1438248304953
15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/ignite-core.jar at http://10.20.0.221:52473/jars/ignite-core.jar with timestamp 1438248304963
15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/ignite-indexing.jar at http://10.20.0.221:52473/jars/ignite-indexing.jar with timestamp 1438248304963
15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/ignite-spring.jar at http://10.20.0.221:52473/jars/ignite-spring.jar with timestamp 1438248304964
15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/ignite-log4j.jar at http://10.20.0.221:52473/jars/ignite-log4j.jar with timestamp 1438248304964
15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/cache-api.jar at http://10.20.0.221:52473/jars/cache-api.jar with timestamp 1438248304964
15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/ignite-shmem.jar at http://10.20.0.221:52473/jars/ignite-shmem.jar with timestamp 1438248304964
15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/commons-codec.jar at http://10.20.0.221:52473/jars/commons-codec.jar with timestamp 1438248304965
15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/lucene-core.jar at http://10.20.0.221:52473/jars/lucene-core.jar with timestamp 1438248304967
15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/h2.jar at http://10.20.0.221:52473/jars/h2.jar with timestamp 1438248304970
15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/spring-core.jar at http://10.20.0.221:52473/jars/spring-core.jar with timestamp 1438248304971
15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/spring-aop.jar at http://10.20.0.221:52473/jars/spring-aop.jar with timestamp 1438248304972
15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/spring-beans.jar at http://10.20.0.221:52473/jars/spring-beans.jar with timestamp 1438248304973
15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/spring-context.jar at http://10.20.0.221:52473/jars/spring-context.jar with timestamp 1438248304975
15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/spring-expression.jar at http://10.20.0.221:52473/jars/spring-expression.jar with timestamp 1438248304975
15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/spring-tx.jar at http://10.20.0.221:52473/jars/spring-tx.jar with timestamp 1438248304976
15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/spring-jdbc.jar at http://10.20.0.221:52473/jars/spring-jdbc.jar with timestamp 1438248304977
15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/commons-logging.jar at http://10.20.0.221:52473/jars/commons-logging.jar with timestamp 1438248304977
15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/aopalliance.jar at http://10.20.0.221:52473/jars/aopalliance.jar with timestamp 1438248304977
15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/log4j.jar at http://10.20.0.221:52473/jars/log4j.jar with timestamp 1438248304978
15/07/30 02:25:05 INFO AppClient$ClientActor: Connecting to master akka.tcp://sparkMaster@fosters-218:7077/user/Master...
15/07/30 02:25:05 INFO SparkDeploySchedulerBackend: Connected to Spark cluster with app ID app-20150730022602-0005
15/07/30 02:25:05 INFO AppClient$ClientActor: Executor added: app-20150730022602-0005/0 on worker-20150730014728-fosters-221-58923 (fosters-221:58923) with 16 cores
15/07/30 02:25:05 INFO SparkDeploySchedulerBackend: Granted executor ID app-20150730022602-0005/0 on hostPort fosters-221:58923 with 16 cores, 512.0 MB RAM
15/07/30 02:25:05 INFO AppClient$ClientActor: Executor updated: app-20150730022602-0005/0 is now LOADING
15/07/30 02:25:05 INFO AppClient$ClientActor: Executor updated: app-20150730022602-0005/0 is now RUNNING
15/07/30 02:25:05 INFO NettyBlockTransferService: Server created on 51493
15/07/30 02:25:05 INFO BlockManagerMaster: Trying to register BlockManager
15/07/30 02:25:05 INFO BlockManagerMasterActor: Registering block manager fosters-221:51493 with 265.4 MB RAM, BlockManagerId(<driver>, fosters-221, 51493)
15/07/30 02:25:05 INFO BlockManagerMaster: Registered BlockManager
15/07/30 02:25:05 INFO SparkDeploySchedulerBackend: SchedulerBackend is ready for scheduling beginning after reached minRegisteredResourcesRatio: 0.0
15/07/30 02:25:05 INFO SparkILoop: Created spark context..
Spark context available as sc.
15/07/30 02:25:05 INFO SparkILoop: Created sql context (with Hive support)..
SQL context available as sqlContext.
15/07/30 02:25:07 INFO SparkDeploySchedulerBackend: Registered executor: Actor[akka.tcp://sparkExecutor@fosters-221:33293/user/Executor#271769703] with ID 0
scala> 15/07/30 02:25:07 INFO BlockManagerMasterActor: Registering block manager fosters-221:41747 with 265.4 MB RAM, BlockManagerId(0, fosters-221, 41747)
Step 3
scala> import org.apache.ignite.spark._ import org.apache.ignite.spark._ scala> import org.apache.ignite.configuration._ import org.apache.ignite.configuration._
Step 4
scala> val ic = new IgniteContext[Integer, Integer](sc, "config/default-config.xml")
15/07/30 02:26:36 INFO XmlBeanDefinitionReader: Loading XML bean definitions from URL [file:/home/gridgain/isuntsov/gridgain-community-fabric-1.3.2/config/default-config.xml]
15/07/30 02:26:36 INFO GenericApplicationContext: Refreshing org.springframework.context.support.GenericApplicationContext@35816f1c: startup date [Thu Jul 30 02:26:36 PDT 2015]; root of context hierarchy
15/07/30 02:26:36 INFO IgniteKernal:
>>> __________ ________________
>>> / _/ ___/ |/ / _/_ __/ __/
>>> _/ // (7 7 // / / / / _/
>>> /___/\___/_/|_/___/ /_/ /___/
>>>
>>> ver. 1.3.2#20150717-sha1:6711d2c7
>>> 2015 Copyright(C) Apache Software Foundation
>>>
>>> Ignite documentation: http://ignite.incubator.apache.org
15/07/30 02:26:36 INFO IgniteKernal: Config URL: n/a
15/07/30 02:26:36 INFO IgniteKernal: Daemon mode: off
15/07/30 02:26:36 INFO IgniteKernal: OS: Linux 2.6.32-358.el6.x86_64 amd64
15/07/30 02:26:36 INFO IgniteKernal: OS user: gridgain
15/07/30 02:26:36 INFO IgniteKernal: Language runtime: Scala ver. 2.10.4
15/07/30 02:26:36 INFO IgniteKernal: VM information: Java(TM) SE Runtime Environment 1.7.0_75-b13 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 24.75-b04
15/07/30 02:26:36 INFO IgniteKernal: VM total memory: 0.48GB
15/07/30 02:26:36 INFO IgniteKernal: Remote Management [restart: off, REST: on, JMX (remote: off)]
15/07/30 02:26:36 INFO IgniteKernal: IGNITE_HOME=/home/gridgain/isuntsov/gridgain-community-fabric-1.3.2/
15/07/30 02:26:36 INFO IgniteKernal: VM arguments: [-XX:MaxPermSize=128m, -Dscala.usejavacp=true, -Xms512m, -Xmx512m]
15/07/30 02:26:36 INFO IgniteKernal: Configured caches ['ignite-marshaller-sys-cache', 'ignite-sys-cache', 'ignite-atomics-sys-cache']
15/07/30 02:26:36 INFO IgniteKernal: 3-rd party licenses can be found at: /home/gridgain/isuntsov/gridgain-community-fabric-1.3.2//libs/licenses
15/07/30 02:26:36 INFO IgniteKernal: Non-loopback local IPs: 10.20.0.221, fe80:0:0:0:21b:21ff:fe5b:eeab%6
15/07/30 02:26:36 INFO IgniteKernal: Enabled local MACs: 001B215BEEAB
15/07/30 02:26:36 INFO IgnitePluginProcessor: Configured plugins:
15/07/30 02:26:36 INFO IgnitePluginProcessor: ^-- None
15/07/30 02:26:36 INFO IgnitePluginProcessor:
15/07/30 02:26:36 INFO TcpCommunicationSpi: IPC shared memory server endpoint started [port=48101, tokDir=/home/gridgain/isuntsov/gridgain-community-fabric-1.3.2/work/ipc/shmem/d21417e8-1bdc-4f83-b131-b016c40d0f6a-26106]
15/07/30 02:26:36 INFO TcpCommunicationSpi: Successfully bound shared memory communication to TCP port [port=48101, locHost=0.0.0.0/0.0.0.0]
15/07/30 02:26:36 INFO TcpCommunicationSpi: Successfully bound to TCP port [port=47101, locHost=0.0.0.0/0.0.0.0]
15/07/30 02:26:36 WARN NoopCheckpointSpi: Checkpoints are disabled (to enable configure any GridCheckpointSpi implementation)
15/07/30 02:26:36 WARN GridCollisionManager: Collision resolution is disabled (all jobs will be activated upon arrival).
15/07/30 02:26:36 WARN NoopSwapSpaceSpi: Swap space is disabled. To enable use FileSwapSpaceSpi.
15/07/30 02:26:36 INFO IgniteKernal: Security status [authentication=off]
15/07/30 02:26:36 INFO GridTcpRestProtocol: Command protocol successfully started [name=TCP binary, host=0.0.0.0/0.0.0.0, port=11212]
15/07/30 02:26:36 WARN TcpDiscoveryMulticastIpFinder: TcpDiscoveryMulticastIpFinder has no pre-configured addresses (it is recommended in production to specify at least one address in TcpDiscoveryMulticastIpFinder.getAddresses() configuration property)
15/07/30 02:26:36 WARN TcpDiscoverySpi: No addresses registered in the IP finder (will retry in 2000ms): TcpDiscoveryMulticastIpFinder [mcastGrp=228.1.2.4, mcastPort=47400, resWaitTime=500, addrReqAttempts=2, locAddr=null, super=TcpDiscoveryVmIpFinder [addrs=[], super=TcpDiscoveryIpFinderAdapter [shared=true]]]
15/07/30 02:26:39 INFO GridCacheProcessor: Started cache [name=ignite-marshaller-sys-cache, mode=REPLICATED]
15/07/30 02:26:39 INFO GridCacheProcessor: Started cache [name=ignite-atomics-sys-cache, mode=PARTITIONED]
15/07/30 02:26:39 INFO GridCacheProcessor: Started cache [name=ignite-sys-cache, mode=REPLICATED]
15/07/30 02:26:39 WARN TcpCommunicationSpi: Failed to allocate shared memory segment (switching to TCP, may be slower).
15/07/30 02:26:39 INFO GridDhtPreloader: <ignite-marshaller-sys-cache> Starting rebalancing in SYNC mode: ignite-marshaller-sys-cache
15/07/30 02:26:39 INFO GridDhtPreloader: <ignite-marshaller-sys-cache> Completed rebalancing in SYNC mode [cache=ignite-marshaller-sys-cache, time=0 ms]
15/07/30 02:26:39 INFO GridDhtPreloader: <ignite-atomics-sys-cache> Starting rebalancing in SYNC mode: ignite-atomics-sys-cache
15/07/30 02:26:39 INFO GridDhtPreloader: <ignite-atomics-sys-cache> Completed rebalancing in SYNC mode [cache=ignite-atomics-sys-cache, time=0 ms]
15/07/30 02:26:39 INFO GridDhtPreloader: <ignite-sys-cache> Starting rebalancing in SYNC mode: ignite-sys-cache
15/07/30 02:26:39 INFO GridDhtPreloader: <ignite-sys-cache> Completed rebalancing in SYNC mode [cache=ignite-sys-cache, time=0 ms]
15/07/30 02:26:39 INFO IgniteKernal: To start Console Management & Monitoring run ignitevisorcmd.{sh|bat}
15/07/30 02:26:39 INFO IgniteKernal:
15/07/30 02:26:39 INFO IgniteKernal:
>>> +----------------------------------------------------------------------+
>>> Ignite ver. 1.3.2#20150717-sha1:6711d2c799b99d7a0ae3855475cccafbf362f5dd
>>> +----------------------------------------------------------------------+
>>> OS name: Linux 2.6.32-358.el6.x86_64 amd64
>>> CPU(s): 16
>>> Heap: 0.5GB
>>> VM name: 26106@fosters-221
>>> Grid name: null
>>> Local node [ID=D21417E8-1BDC-4F83-B131-B016C40D0F6A, order=17, clientMode=true]
>>> Local node addresses: [fosters-221/0:0:0:0:0:0:0:1%1, /10.20.0.221, /127.0.0.1]
>>> Local ports: TCP:11212 TCP:47101 UDP:47400 TCP:48101
15/07/30 02:26:39 INFO GridDiscoveryManager: Topology snapshot [ver=17, server nodes=1, client nodes=1, CPUs=16, heap=1.5GB]
ic: org.apache.ignite.spark.IgniteContext[Integer,Integer] = org.apache.ignite.spark.IgniteContext@74be0783
Step 5
scala> val sharedRDD = ic.fromCache("partitioned")
sharedRDD: org.apache.ignite.spark.IgniteRDD[Integer,Integer] = IgniteRDD[0] at RDD at IgniteAbstractRDD.scala:31
Step 6
scala> sharedRDD.filter(_._2 < 10).collect() 15/07/30 02:27:58 INFO GridCacheProcessor: Started cache [name=partitioned, mode=PARTITIONED] 15/07/30 02:27:58 INFO GridDhtPreloader: <partitioned> Starting rebalancing in ASYNC mode: partitioned 15/07/30 02:27:58 INFO GridDhtPreloader: <partitioned> Completed rebalancing in ASYNC mode [cache=partitioned, time=0 ms] 15/07/30 02:27:58 INFO SparkContext: Starting job: collect at <console>:32 15/07/30 02:27:58 INFO DAGScheduler: Got job 0 (collect at <console>:32) with 1024 output partitions (allowLocal=false) 15/07/30 02:27:58 INFO DAGScheduler: Final stage: Stage 0(collect at <console>:32) 15/07/30 02:27:58 INFO DAGScheduler: Parents of final stage: List() 15/07/30 02:27:58 INFO DAGScheduler: Missing parents: List() 15/07/30 02:27:58 INFO DAGScheduler: Submitting Stage 0 (MapPartitionsRDD[1] at filter at <console>:32), which has no missing parents 15/07/30 02:27:59 INFO MemoryStore: ensureFreeSpace(2368) called with curMem=0, maxMem=278302556 15/07/30 02:27:59 INFO MemoryStore: Block broadcast_0 stored as values in memory (estimated size 2.3 KB, free 265.4 MB) 15/07/30 02:27:59 INFO MemoryStore: ensureFreeSpace(1714) called with curMem=2368, maxMem=278302556 15/07/30 02:27:59 INFO MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 1714.0 B, free 265.4 MB) 15/07/30 02:27:59 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on fosters-221:51493 (size: 1714.0 B, free: 265.4 MB) 15/07/30 02:27:59 INFO BlockManagerMaster: Updated info of block broadcast_0_piece0 15/07/30 02:27:59 INFO SparkContext: Created broadcast 0 from broadcast at DAGScheduler.scala:839 15/07/30 02:27:59 INFO DAGScheduler: Submitting 1024 missing tasks from Stage 0 (MapPartitionsRDD[1] at filter at <console>:32) 15/07/30 02:27:59 INFO TaskSchedulerImpl: Adding task set 0.0 with 1024 tasks 15/07/30 02:27:59 INFO TaskSetManager: Starting task 0.0 in stage 0.0 (TID 0, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Starting task 1.0 in stage 0.0 (TID 1, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Starting task 2.0 in stage 0.0 (TID 2, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Starting task 3.0 in stage 0.0 (TID 3, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Starting task 4.0 in stage 0.0 (TID 4, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Starting task 5.0 in stage 0.0 (TID 5, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Starting task 6.0 in stage 0.0 (TID 6, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Starting task 7.0 in stage 0.0 (TID 7, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Starting task 8.0 in stage 0.0 (TID 8, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Starting task 9.0 in stage 0.0 (TID 9, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Starting task 10.0 in stage 0.0 (TID 10, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Starting task 11.0 in stage 0.0 (TID 11, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Starting task 12.0 in stage 0.0 (TID 12, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Starting task 13.0 in stage 0.0 (TID 13, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Starting task 14.0 in stage 0.0 (TID 14, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Starting task 15.0 in stage 0.0 (TID 15, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on fosters-221:41747 (size: 1714.0 B, free: 265.4 MB) 15/07/30 02:27:59 INFO TaskSetManager: Starting task 16.0 in stage 0.0 (TID 16, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Starting task 17.0 in stage 0.0 (TID 17, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Starting task 18.0 in stage 0.0 (TID 18, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Starting task 19.0 in stage 0.0 (TID 19, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Starting task 20.0 in stage 0.0 (TID 20, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 WARN TaskSetManager: Lost task 5.0 in stage 0.0 (TID 5, fosters-221): class org.apache.ignite.IgniteCheckedException: Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME. at org.apache.ignite.internal.IgnitionEx.loadConfigurations(IgnitionEx.java:596) at org.apache.ignite.internal.IgnitionEx.loadConfiguration(IgnitionEx.java:640) at org.apache.ignite.spark.IgniteContext$$anonfun$$lessinit$greater$1.apply(IgniteContext.scala:69) at org.apache.ignite.spark.IgniteContext$$anonfun$$lessinit$greater$1.apply(IgniteContext.scala:69) at org.apache.ignite.spark.Once.apply(IgniteContext.scala:155) at org.apache.ignite.spark.IgniteContext.ignite(IgniteContext.scala:114) at org.apache.ignite.spark.impl.IgniteAbstractRDD.ensureCache(IgniteAbstractRDD.scala:37) at org.apache.ignite.spark.IgniteRDD.compute(IgniteRDD.scala:58) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277) at org.apache.spark.rdd.RDD.iterator(RDD.scala:244) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277) at org.apache.spark.rdd.RDD.iterator(RDD.scala:244) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61) at org.apache.spark.scheduler.Task.run(Task.scala:64) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: java.net.MalformedURLException: no protocol: config/default-config.xml at java.net.URL.<init>(URL.java:585) at java.net.URL.<init>(URL.java:482) at java.net.URL.<init>(URL.java:431) at org.apache.ignite.internal.IgnitionEx.loadConfigurations(IgnitionEx.java:590) ... 18 more 15/07/30 02:27:59 INFO TaskSetManager: Lost task 6.0 in stage 0.0 (TID 6) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 1] 15/07/30 02:27:59 INFO TaskSetManager: Lost task 1.0 in stage 0.0 (TID 1) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 2] 15/07/30 02:27:59 INFO TaskSetManager: Lost task 11.0 in stage 0.0 (TID 11) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 3] 15/07/30 02:27:59 INFO TaskSetManager: Lost task 15.0 in stage 0.0 (TID 15) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 4] 15/07/30 02:27:59 INFO TaskSetManager: Starting task 15.1 in stage 0.0 (TID 21, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Starting task 11.1 in stage 0.0 (TID 22, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Lost task 13.0 in stage 0.0 (TID 13) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 5] 15/07/30 02:27:59 INFO TaskSetManager: Starting task 13.1 in stage 0.0 (TID 23, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Lost task 0.0 in stage 0.0 (TID 0) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 6] 15/07/30 02:27:59 INFO TaskSetManager: Starting task 0.1 in stage 0.0 (TID 24, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Lost task 10.0 in stage 0.0 (TID 10) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 7] 15/07/30 02:27:59 INFO TaskSetManager: Starting task 10.1 in stage 0.0 (TID 25, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Lost task 12.0 in stage 0.0 (TID 12) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 8] 15/07/30 02:27:59 INFO TaskSetManager: Starting task 12.1 in stage 0.0 (TID 26, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Lost task 2.0 in stage 0.0 (TID 2) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 9] 15/07/30 02:27:59 INFO TaskSetManager: Starting task 2.1 in stage 0.0 (TID 27, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Lost task 3.0 in stage 0.0 (TID 3) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 10] 15/07/30 02:27:59 INFO TaskSetManager: Lost task 7.0 in stage 0.0 (TID 7) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 11] 15/07/30 02:27:59 INFO TaskSetManager: Starting task 7.1 in stage 0.0 (TID 28, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Starting task 3.1 in stage 0.0 (TID 29, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Lost task 4.0 in stage 0.0 (TID 4) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 12] 15/07/30 02:27:59 INFO TaskSetManager: Lost task 9.0 in stage 0.0 (TID 9) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 13] 15/07/30 02:27:59 INFO TaskSetManager: Starting task 9.1 in stage 0.0 (TID 30, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Starting task 4.1 in stage 0.0 (TID 31, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Lost task 8.0 in stage 0.0 (TID 8) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 14] 15/07/30 02:27:59 INFO TaskSetManager: Lost task 14.0 in stage 0.0 (TID 14) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 15] 15/07/30 02:27:59 INFO TaskSetManager: Starting task 14.1 in stage 0.0 (TID 32, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Starting task 8.1 in stage 0.0 (TID 33, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Lost task 16.0 in stage 0.0 (TID 16) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 16] 15/07/30 02:27:59 INFO TaskSetManager: Lost task 17.0 in stage 0.0 (TID 17) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 17] 15/07/30 02:27:59 INFO TaskSetManager: Starting task 17.1 in stage 0.0 (TID 34, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Lost task 18.0 in stage 0.0 (TID 18) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 18] 15/07/30 02:27:59 INFO TaskSetManager: Starting task 18.1 in stage 0.0 (TID 35, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Lost task 19.0 in stage 0.0 (TID 19) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 19] 15/07/30 02:27:59 INFO TaskSetManager: Starting task 19.1 in stage 0.0 (TID 36, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Lost task 20.0 in stage 0.0 (TID 20) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 20] 15/07/30 02:27:59 INFO TaskSetManager: Starting task 20.1 in stage 0.0 (TID 37, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Lost task 15.1 in stage 0.0 (TID 21) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 21] 15/07/30 02:27:59 INFO TaskSetManager: Starting task 15.2 in stage 0.0 (TID 38, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Lost task 11.1 in stage 0.0 (TID 22) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 22] 15/07/30 02:27:59 INFO TaskSetManager: Starting task 11.2 in stage 0.0 (TID 39, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Lost task 13.1 in stage 0.0 (TID 23) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 23] 15/07/30 02:27:59 INFO TaskSetManager: Starting task 13.2 in stage 0.0 (TID 40, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Lost task 12.1 in stage 0.0 (TID 26) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 24] 15/07/30 02:27:59 INFO TaskSetManager: Starting task 12.2 in stage 0.0 (TID 41, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Lost task 10.1 in stage 0.0 (TID 25) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 25] 15/07/30 02:27:59 INFO TaskSetManager: Starting task 10.2 in stage 0.0 (TID 42, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Lost task 2.1 in stage 0.0 (TID 27) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 26] 15/07/30 02:27:59 INFO TaskSetManager: Starting task 2.2 in stage 0.0 (TID 43, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Lost task 0.1 in stage 0.0 (TID 24) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 27] 15/07/30 02:27:59 INFO TaskSetManager: Starting task 0.2 in stage 0.0 (TID 44, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Starting task 16.1 in stage 0.0 (TID 45, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Lost task 7.1 in stage 0.0 (TID 28) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 28] 15/07/30 02:27:59 INFO TaskSetManager: Starting task 7.2 in stage 0.0 (TID 46, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Lost task 3.1 in stage 0.0 (TID 29) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 29] 15/07/30 02:27:59 INFO TaskSetManager: Lost task 4.1 in stage 0.0 (TID 31) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 30] 15/07/30 02:27:59 INFO TaskSetManager: Starting task 4.2 in stage 0.0 (TID 47, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Lost task 9.1 in stage 0.0 (TID 30) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 31] 15/07/30 02:27:59 INFO TaskSetManager: Starting task 9.2 in stage 0.0 (TID 48, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Lost task 14.1 in stage 0.0 (TID 32) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 32] 15/07/30 02:27:59 INFO TaskSetManager: Starting task 14.2 in stage 0.0 (TID 49, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Starting task 3.2 in stage 0.0 (TID 50, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Lost task 17.1 in stage 0.0 (TID 34) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 33] 15/07/30 02:27:59 INFO TaskSetManager: Starting task 17.2 in stage 0.0 (TID 51, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Lost task 8.1 in stage 0.0 (TID 33) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 34] 15/07/30 02:27:59 INFO TaskSetManager: Lost task 19.1 in stage 0.0 (TID 36) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 35] 15/07/30 02:27:59 INFO TaskSetManager: Starting task 19.2 in stage 0.0 (TID 52, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Lost task 18.1 in stage 0.0 (TID 35) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 36] 15/07/30 02:27:59 INFO TaskSetManager: Starting task 18.2 in stage 0.0 (TID 53, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Lost task 20.1 in stage 0.0 (TID 37) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 37] 15/07/30 02:27:59 INFO TaskSetManager: Starting task 20.2 in stage 0.0 (TID 54, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Starting task 8.2 in stage 0.0 (TID 55, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Lost task 15.2 in stage 0.0 (TID 38) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 38] 15/07/30 02:27:59 INFO TaskSetManager: Lost task 11.2 in stage 0.0 (TID 39) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 39] 15/07/30 02:27:59 INFO TaskSetManager: Starting task 11.3 in stage 0.0 (TID 56, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Lost task 13.2 in stage 0.0 (TID 40) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 40] 15/07/30 02:27:59 INFO TaskSetManager: Starting task 13.3 in stage 0.0 (TID 57, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Lost task 12.2 in stage 0.0 (TID 41) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 41] 15/07/30 02:27:59 INFO TaskSetManager: Starting task 12.3 in stage 0.0 (TID 58, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Lost task 10.2 in stage 0.0 (TID 42) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 42] 15/07/30 02:27:59 INFO TaskSetManager: Starting task 10.3 in stage 0.0 (TID 59, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Lost task 2.2 in stage 0.0 (TID 43) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 43] 15/07/30 02:27:59 INFO TaskSetManager: Starting task 2.3 in stage 0.0 (TID 60, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Lost task 0.2 in stage 0.0 (TID 44) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 44] 15/07/30 02:27:59 INFO TaskSetManager: Starting task 0.3 in stage 0.0 (TID 61, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Starting task 15.3 in stage 0.0 (TID 62, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Lost task 16.1 in stage 0.0 (TID 45) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 45] 15/07/30 02:27:59 INFO TaskSetManager: Lost task 7.2 in stage 0.0 (TID 46) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 46] 15/07/30 02:27:59 INFO TaskSetManager: Starting task 7.3 in stage 0.0 (TID 63, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Lost task 4.2 in stage 0.0 (TID 47) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 47] 15/07/30 02:27:59 INFO TaskSetManager: Starting task 4.3 in stage 0.0 (TID 64, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Starting task 16.2 in stage 0.0 (TID 65, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Lost task 9.2 in stage 0.0 (TID 48) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 48] 15/07/30 02:27:59 INFO TaskSetManager: Lost task 14.2 in stage 0.0 (TID 49) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 49] 15/07/30 02:27:59 INFO TaskSetManager: Starting task 14.3 in stage 0.0 (TID 66, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Lost task 3.2 in stage 0.0 (TID 50) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 50] 15/07/30 02:27:59 INFO TaskSetManager: Starting task 3.3 in stage 0.0 (TID 67, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Lost task 17.2 in stage 0.0 (TID 51) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 51] 15/07/30 02:27:59 INFO TaskSetManager: Starting task 17.3 in stage 0.0 (TID 68, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Lost task 19.2 in stage 0.0 (TID 52) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 52] 15/07/30 02:27:59 INFO TaskSetManager: Starting task 19.3 in stage 0.0 (TID 69, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Lost task 18.2 in stage 0.0 (TID 53) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 53] 15/07/30 02:27:59 INFO TaskSetManager: Starting task 18.3 in stage 0.0 (TID 70, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Lost task 20.2 in stage 0.0 (TID 54) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 54] 15/07/30 02:27:59 INFO TaskSetManager: Starting task 20.3 in stage 0.0 (TID 71, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Lost task 8.2 in stage 0.0 (TID 55) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 55] 15/07/30 02:27:59 INFO TaskSetManager: Starting task 8.3 in stage 0.0 (TID 72, fosters-221, NODE_LOCAL, 2152 bytes) 15/07/30 02:27:59 INFO TaskSetManager: Lost task 11.3 in stage 0.0 (TID 56) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 56] 15/07/30 02:27:59 ERROR TaskSetManager: Task 11 in stage 0.0 failed 4 times; aborting job 15/07/30 02:27:59 INFO TaskSetManager: Lost task 13.3 in stage 0.0 (TID 57) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 57] 15/07/30 02:27:59 INFO TaskSchedulerImpl: Cancelling stage 0 15/07/30 02:27:59 INFO TaskSchedulerImpl: Stage 0 was cancelled 15/07/30 02:27:59 INFO DAGScheduler: Stage 0 (collect at <console>:32) failed in 0.839 s 15/07/30 02:27:59 INFO TaskSetManager: Lost task 12.3 in stage 0.0 (TID 58) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 58] 15/07/30 02:27:59 INFO DAGScheduler: Job 0 failed: collect at <console>:32, took 1.058878 s 15/07/30 02:27:59 INFO TaskSetManager: Lost task 0.3 in stage 0.0 (TID 61) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 59] 15/07/30 02:27:59 INFO TaskSetManager: Lost task 10.3 in stage 0.0 (TID 59) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 60] 15/07/30 02:27:59 INFO TaskSetManager: Lost task 15.3 in stage 0.0 (TID 62) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 61] 15/07/30 02:27:59 INFO TaskSetManager: Lost task 2.3 in stage 0.0 (TID 60) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 62] 15/07/30 02:27:59 INFO TaskSetManager: Lost task 7.3 in stage 0.0 (TID 63) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 63] 15/07/30 02:27:59 INFO TaskSetManager: Lost task 4.3 in stage 0.0 (TID 64) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 64] 15/07/30 02:27:59 INFO TaskSetManager: Lost task 14.3 in stage 0.0 (TID 66) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 65] 15/07/30 02:27:59 INFO TaskSetManager: Lost task 16.2 in stage 0.0 (TID 65) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 66] 15/07/30 02:27:59 INFO TaskSetManager: Lost task 3.3 in stage 0.0 (TID 67) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 67] 15/07/30 02:27:59 INFO TaskSetManager: Lost task 17.3 in stage 0.0 (TID 68) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 68] 15/07/30 02:27:59 INFO TaskSetManager: Lost task 19.3 in stage 0.0 (TID 69) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 69] 15/07/30 02:27:59 INFO TaskSetManager: Lost task 18.3 in stage 0.0 (TID 70) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 70] 15/07/30 02:28:00 INFO TaskSetManager: Lost task 20.3 in stage 0.0 (TID 71) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 71] 15/07/30 02:28:00 INFO TaskSetManager: Lost task 8.3 in stage 0.0 (TID 72) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 72] 15/07/30 02:28:00 INFO TaskSchedulerImpl: Removed TaskSet 0.0, whose tasks have all completed, from pool org.apache.spark.SparkException: Job aborted due to stage failure: Task 11 in stage 0.0 failed 4 times, most recent failure: Lost task 11.3 in stage 0.0 (TID 56, fosters-221): class org.apache.ignite.IgniteCheckedException: Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME. at org.apache.ignite.internal.IgnitionEx.loadConfigurations(IgnitionEx.java:596) at org.apache.ignite.internal.IgnitionEx.loadConfiguration(IgnitionEx.java:640) at org.apache.ignite.spark.IgniteContext$$anonfun$$lessinit$greater$1.apply(IgniteContext.scala:69) at org.apache.ignite.spark.IgniteContext$$anonfun$$lessinit$greater$1.apply(IgniteContext.scala:69) at org.apache.ignite.spark.Once.apply(IgniteContext.scala:155) at org.apache.ignite.spark.IgniteContext.ignite(IgniteContext.scala:114) at org.apache.ignite.spark.impl.IgniteAbstractRDD.ensureCache(IgniteAbstractRDD.scala:37) at org.apache.ignite.spark.IgniteRDD.compute(IgniteRDD.scala:58) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277) at org.apache.spark.rdd.RDD.iterator(RDD.scala:244) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277) at org.apache.spark.rdd.RDD.iterator(RDD.scala:244) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61) at org.apache.spark.scheduler.Task.run(Task.scala:64) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: java.net.MalformedURLException: no protocol: config/default-config.xml at java.net.URL.<init>(URL.java:585) at java.net.URL.<init>(URL.java:482) at java.net.URL.<init>(URL.java:431) at org.apache.ignite.internal.IgnitionEx.loadConfigurations(IgnitionEx.java:590) ... 18 more Driver stacktrace: at org.apache.spark.scheduler.DAGScheduler.org$apache$spark$scheduler$DAGScheduler$$failJobAndIndependentStages(DAGScheduler.scala:1204) at org.apache.spark.scheduler.DAGScheduler$$anonfun$abortStage$1.apply(DAGScheduler.scala:1193) at org.apache.spark.scheduler.DAGScheduler$$anonfun$abortStage$1.apply(DAGScheduler.scala:1192) at scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59) at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:47) at org.apache.spark.scheduler.DAGScheduler.abortStage(DAGScheduler.scala:1192) at org.apache.spark.scheduler.DAGScheduler$$anonfun$handleTaskSetFailed$1.apply(DAGScheduler.scala:693) at org.apache.spark.scheduler.DAGScheduler$$anonfun$handleTaskSetFailed$1.apply(DAGScheduler.scala:693) at scala.Option.foreach(Option.scala:236) at org.apache.spark.scheduler.DAGScheduler.handleTaskSetFailed(DAGScheduler.scala:693) at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:1393) at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:1354) at org.apache.spark.util.EventLoop$$anon$1.run(EventLoop.scala:48)