Description
Experiment in EXECUTING state even when the cluster initialization fails and job cannot be launched at the resource.
Error [1] exists in the gfac server log.
But the experiment is not failed and it remains in EXECUTING state.
Experiment should be failed with error messages from the log.
[1]
2016-09-08 14:31:50,860 [pool-3-thread-4] ERROR org.apache.airavata.gfac.core.GFacException - Remote cluster initialization error
org.apache.airavata.common.exception.AiravataException: JSch initialization error
at org.apache.airavata.gfac.impl.Factory.getSSHSession(Factory.java:502)
at org.apache.airavata.gfac.impl.HPCRemoteCluster.<init>(HPCRemoteCluster.java:67)
at org.apache.airavata.gfac.impl.Factory.getJobSubmissionRemoteCluster(Factory.java:233)
at org.apache.airavata.gfac.impl.GFacEngineImpl.populateProcessContext(GFacEngineImpl.java:190)
at org.apache.airavata.gfac.impl.GFacWorker.<init>(GFacWorker.java:75)
at org.apache.airavata.gfac.server.GfacServerHandler.submitProcess(GfacServerHandler.java:161)
at org.apache.airavata.gfac.server.GfacServerHandler$ProcessLaunchMessageHandler.onMessage(GfacServerHandler.java:273)
at org.apache.airavata.messaging.core.impl.RabbitMQProcessLaunchConsumer$2.handleDelivery(RabbitMQProcessLaunchConsumer.java:187)
at com.rabbitmq.client.impl.ConsumerDispatcher$5.run(ConsumerDispatcher.java:144)
at com.rabbitmq.client.impl.ConsumerWorkService$WorkPoolRunnable.run(ConsumerWorkService.java:99)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: com.jcraft.jsch.JSchException: java.net.UnknownHostException: JetStream
at com.jcraft.jsch.Util.createSocket(Util.java:349)
at com.jcraft.jsch.Session.connect(Session.java:215)
at com.jcraft.jsch.Session.connect(Session.java:183)
at org.apache.airavata.gfac.impl.Factory.getSSHSession(Factory.java:499)
... 12 more
Caused by: java.net.UnknownHostException: JetStream
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:184)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
at java.net.Socket.connect(Socket.java:589)
at java.net.Socket.connect(Socket.java:538)
at java.net.Socket.<init>(Socket.java:434)
at java.net.Socket.<init>(Socket.java:211)
at com.jcraft.jsch.Util.createSocket(Util.java:343)
... 15 more
2016-09-08 14:31:50,861 [pool-3-thread-4] ERROR org.apache.airavata.gfac.server.GfacServerHandler - Failed to submit process
org.apache.airavata.gfac.core.GFacException: Remote cluster initialization error
at org.apache.airavata.gfac.impl.GFacEngineImpl.populateProcessContext(GFacEngineImpl.java:213)
at org.apache.airavata.gfac.impl.GFacWorker.<init>(GFacWorker.java:75)
at org.apache.airavata.gfac.server.GfacServerHandler.submitProcess(GfacServerHandler.java:161)
at org.apache.airavata.gfac.server.GfacServerHandler$ProcessLaunchMessageHandler.onMessage(GfacServerHandler.java:273)
at org.apache.airavata.messaging.core.impl.RabbitMQProcessLaunchConsumer$2.handleDelivery(RabbitMQProcessLaunchConsumer.java:187)
at com.rabbitmq.client.impl.ConsumerDispatcher$5.run(ConsumerDispatcher.java:144)
at com.rabbitmq.client.impl.ConsumerWorkService$WorkPoolRunnable.run(ConsumerWorkService.java:99)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.airavata.common.exception.AiravataException: JSch initialization error
at org.apache.airavata.gfac.impl.Factory.getSSHSession(Factory.java:502)
at org.apache.airavata.gfac.impl.HPCRemoteCluster.<init>(HPCRemoteCluster.java:67)
at org.apache.airavata.gfac.impl.Factory.getJobSubmissionRemoteCluster(Factory.java:233)
at org.apache.airavata.gfac.impl.GFacEngineImpl.populateProcessContext(GFacEngineImpl.java:190)
... 9 more