Uploaded image for project: 'CloudStack'
  1. CloudStack
  2. CLOUDSTACK-3994

Wrong error notification is generated when Primary storage (Cluster wide) is added with wrong path

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • 4.2.0
    • 4.4.0
    • Storage Controller, VMware
    • Security Level: Public (Anyone can view this level - this is the default.)
    • None

    Description

      Steps:

      1. Configure Adv Zone with VMWARE
      2. Tried to add wrong cluster wide primary storage point

      It failed saying " Failed to delete storage pool on host"

      2013-08-01 10:00:12,928 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-230:null) Seq 1-757532143: Executing request
      2013-08-01 10:00:12,928 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-230:null) Seq 1-757532143: Response Received:
      2013-08-01 10:00:12,929 DEBUG [agent.transport.Request] (DirectAgent-230:null) Seq 1-757532143: Processing: { Ans: , MgmtId: 187767034175903, via: 1, Ver: v1, Flags: 10, [{"com.cloud.agent.api.Answer":{"result":true,"details":"success","wait":0}}] }
      2013-08-01 10:00:12,933 DEBUG [agent.transport.Request] (catalina-exec-23:null) Seq 1-757532143: Received: { Ans: , MgmtId: 187767034175903, via: 1, Ver: v1, Flags: 10,

      { Answer } }
      2013-08-01 10:00:12,933 DEBUG [agent.manager.AgentManagerImpl] (catalina-exec-23:null) Details from executing class com.cloud.agent.api.CreateStoragePoolCommand: success
      2013-08-01 10:00:12,933 DEBUG [datastore.lifecycle.CloudStackPrimaryDataStoreLifeCycleImpl] (catalina-exec-23:null) In createPool Adding the pool to each of the hosts
      2013-08-01 10:00:12,935 DEBUG [cloud.storage.StorageManagerImpl] (catalina-exec-23:null) Adding pool null to host 1
      2013-08-01 10:00:12,940 DEBUG [agent.transport.Request] (catalina-exec-23:null) Seq 1-757532144: Sending { Cmd , MgmtId: 187767034175903, via: 1, Ver: v1, Flags: 100011, [{"com.cloud.agent.api.ModifyStoragePoolCommand":{"add":true,"pool":{"id":5,"uuid":"86ee5258-33e7-36f0-b3c1-f6029e5c8bdf","host":"10.102.192.100","path":"/cpg_vol/sailaja/ps1","port":2049,"type":"NetworkFilesystem"},"localPath":"/mnt//86ee5258-33e7-36f0-b3c1-f6029e5c8bdf","wait":0}}] }
      2013-08-01 10:00:12,941 DEBUG [agent.transport.Request] (catalina-exec-23:null) Seq 1-757532144: Executing: { Cmd , MgmtId: 187767034175903, via: 1, Ver: v1, Flags: 100011, [{"com.cloud.agent.api.ModifyStoragePoolCommand":{"add":true,"pool":{"id":5,"uuid":"86ee5258-33e7-36f0-b3c1-f6029e5c8bdf","host":"10.102.192.100","path":"/cpg_vol/sailaja/ps1","port":2049,"type":"NetworkFilesystem"},"localPath":"/mnt//86ee5258-33e7-36f0-b3c1-f6029e5c8bdf","wait":0}}] }
      2013-08-01 10:00:12,941 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-230:null) Seq 1-757532144: Executing request
      2013-08-01 10:00:12,942 INFO [vmware.resource.VmwareResource] (DirectAgent-230:10.102.192.18) Executing resource ModifyStoragePoolCommand: {"add":true,"pool":{"id":5,"uuid":"86ee5258-33e7-36f0-b3c1-f6029e5c8bdf","host":"10.102.192.100","path":"/cpg_vol/sailaja/ps1","port":2049,"type":"NetworkFilesystem"},"localPath":"/mnt//86ee5258-33e7-36f0-b3c1-f6029e5c8bdf","wait":0}
      2013-08-01 10:00:13,144 INFO [vmware.mo.HostMO] (DirectAgent-230:10.102.192.18) Creation of NFS datastore on vCenter failed. Details: vCenter API trace - mountDatastore(). target MOR: host-8973, vmfs: false, poolHost: 10.102.192.100, poolHostPort: 2049, poolPath: /cpg_vol/sailaja/ps1, poolUuid: 86ee525833e736f0b3c1f6029e5c8bdf. Exception mesg: An error occurred during host configuration.
      2013-08-01 10:00:13,145 ERROR [vmware.resource.VmwareResource] (DirectAgent-230:10.102.192.18) ModifyStoragePoolCommand failed due to Exception: java.lang.Exception
      Message: Creation of NFS datastore on vCenter failed.

      java.lang.Exception: Creation of NFS datastore on vCenter failed.
      at com.cloud.hypervisor.vmware.mo.HostMO.mountDatastore(HostMO.java:772)
      at com.cloud.hypervisor.vmware.resource.VmwareResource.execute(VmwareResource.java:4102)
      at com.cloud.hypervisor.vmware.resource.VmwareResource.executeRequest(VmwareResource.java:472)
      at com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:186)
      at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
      at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
      at java.util.concurrent.FutureTask.run(FutureTask.java:166)
      at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165)
      at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266)
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
      at java.lang.Thread.run(Thread.java:679)
      2013-08-01 10:00:13,148 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-230:null) Seq 1-757532144: Response Received:
      2013-08-01 10:00:13,151 DEBUG [agent.transport.Request] (DirectAgent-230:null) Seq 1-757532144: Processing: { Ans: , MgmtId: 187767034175903, via: 1, Ver: v1, Flags: 10, [{"com.cloud.agent.api.Answer":{"result":false,"details":"ModifyStoragePoolCommand failed due to Exception: java.lang.Exception\nMessage: Creation of NFS datastore on vCenter failed.\n","wait":0}}] }
      2013-08-01 10:00:13,152 DEBUG [agent.transport.Request] (catalina-exec-23:null) Seq 1-757532144: Received: { Ans: , MgmtId: 187767034175903, via: 1, Ver: v1, Flags: 10, { Answer }

      }
      2013-08-01 10:00:13,152 DEBUG [agent.manager.AgentManagerImpl] (catalina-exec-23:null) Details from executing class com.cloud.agent.api.ModifyStoragePoolCommand: ModifyStoragePoolCommand failed due to Exception: java.lang.Exception
      Message: Creation of NFS datastore on vCenter failed.

      2013-08-01 10:00:13,152 WARN [apache.cloudstack.alerts] (catalina-exec-23:null) alertType:: 7 // dataCenterId:: 1 // podId:: 1 // clusterId:: null // message:: Unable to attach storage pool5 to the host1
      2013-08-01 10:00:13,161 WARN [datastore.lifecycle.CloudStackPrimaryDataStoreLifeCycleImpl] (catalina-exec-23:null) Unable to establish a connection between Host[-1-Routing] and org.apache.cloudstack.storage.datastore.PrimaryDataStoreImpl@19976649
      com.cloud.utils.exception.CloudRuntimeException: Unable establish connection from storage head to storage pool 5 due to ModifyStoragePoolCommand failed due to Exception: java.lang.Exception
      Message: Creation of NFS datastore on vCenter failed.
      5
      at org.apache.cloudstack.storage.datastore.provider.DefaultHostListener.hostConnect(DefaultHostListener.java:66)
      at com.cloud.storage.StorageManagerImpl.connectHostToSharedPool(StorageManagerImpl.java:882)
      at org.apache.cloudstack.storage.datastore.lifecycle.CloudStackPrimaryDataStoreLifeCycleImpl.attachCluster(CloudStackPrimaryDataStoreLifeCycleImpl.java:390)
      at com.cloud.storage.StorageManagerImpl.createPool(StorageManagerImpl.java:746)
      at com.cloud.storage.StorageManagerImpl.createPool(StorageManagerImpl.java:176)
      at org.apache.cloudstack.api.command.admin.storage.CreateStoragePoolCmd.execute(CreateStoragePoolCmd.java:168)
      at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:158)
      at com.cloud.api.ApiServer.queueCommand(ApiServer.java:514)
      at com.cloud.api.ApiServer.handleRequest(ApiServer.java:372)
      at com.cloud.api.ApiServlet.processRequest(ApiServlet.java:305)
      at com.cloud.api.ApiServlet.doGet(ApiServlet.java:66)
      at javax.servlet.http.HttpServlet.service(HttpServlet.java:617)
      at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
      at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
      at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
      at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
      at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
      at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
      at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
      at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:555)
      at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
      at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
      at org.apache.coyote.http11.Http11NioProcessor.process(Http11NioProcessor.java:889)
      at org.apache.coyote.http11.Http11NioProtocol$Http11ConnectionHandler.process(Http11NioProtocol.java:721)
      at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:2268)
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
      at java.lang.Thread.run(Thread.java:679)
      2013-08-01 10:00:13,163 WARN [datastore.lifecycle.CloudStackPrimaryDataStoreLifeCycleImpl] (catalina-exec-23:null) No host can access storage pool org.apache.cloudstack.storage.datastore.PrimaryDataStoreImpl@19976649 on cluster 1
      2013-08-01 10:00:13,175 DEBUG [cloud.storage.StorageManagerImpl] (catalina-exec-23:null) Failed to add data store
      com.cloud.utils.exception.CloudRuntimeException: Failed to access storage pool
      at org.apache.cloudstack.storage.datastore.lifecycle.CloudStackPrimaryDataStoreLifeCycleImpl.attachCluster(CloudStackPrimaryDataStoreLifeCycleImpl.java:401)
      at com.cloud.storage.StorageManagerImpl.createPool(StorageManagerImpl.java:746)
      at com.cloud.storage.StorageManagerImpl.createPool(StorageManagerImpl.java:176)
      at org.apache.cloudstack.api.command.admin.storage.CreateStoragePoolCmd.execute(CreateStoragePoolCmd.java:168)
      at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:158)
      at com.cloud.api.ApiServer.queueCommand(ApiServer.java:514)
      at com.cloud.api.ApiServer.handleRequest(ApiServer.java:372)
      at com.cloud.api.ApiServlet.processRequest(ApiServlet.java:305)
      at com.cloud.api.ApiServlet.doGet(ApiServlet.java:66)
      at javax.servlet.http.HttpServlet.service(HttpServlet.java:617)
      at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
      at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
      at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
      at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
      at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
      at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
      at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
      at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:555)
      at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
      at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
      at org.apache.coyote.http11.Http11NioProcessor.process(Http11NioProcessor.java:889)
      at org.apache.coyote.http11.Http11NioProtocol$Http11ConnectionHandler.process(Http11NioProtocol.java:721)
      at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:2268)
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
      at java.lang.Thread.run(Thread.java:679)
      2013-08-01 10:00:13,180 INFO [cloud.api.ApiServer] (catalina-exec-23:null) Failed to delete storage pool on host
      2013-08-01 10:00:13,181 DEBUG [cloud.api.ApiServlet] (catalina-exec-23:null) ===END=== 10.144.6.19 – GET command=createStoragePool&scope=cluster&zoneid=176d7081-e1d2-4472-8a17-eff1322ddd39&podid=c227dd76-6ffd-4dc2-ad8a-0a71fc92c763&clusterid=2a9b03c7-edaa-416c-9e6c-d2cb8baf056e&name=new1&url=nfs%3A%2F%2F10.102.192.100%2Fcpg_vol%2Fsailaja%2Fps1&response=json&sessionkey=x8JP8GtGm4LirW0b8AK9sVj26D0%3D&_=1375331641550
      2013-08-01 10:00:13,203 DEBUG [storage.image.BaseImageStoreDriverImpl] (RemoteHostEndPoint-8:null) Performing image store createTemplate async callback
      2013-08-01 10:00:13,647 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-4:null) SeqA 2-8579: Processing Seq 2-8579: { Cmd , MgmtId: -1, via: 2, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":2,"_loadInfo":"

      {\n \"connections\": []\n}

      ","wait":0}}] }
      2013-08-01 10:00:13,653 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-4:null) SeqA 2-8579: Sending Seq 2-8579: { Ans: , MgmtId: 187767034175903, via: 2, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
      ^C

      Attachments

        1. apilog.log
          96 kB
          Sailaja Mada
        2. management-server.log
          8.69 MB
          Sailaja Mada

        Activity

          People

            anshulg Anshul Gangwar
            sailaja Sailaja Mada
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: