Uploaded image for project: 'CloudStack'
  1. CloudStack
  2. CLOUDSTACK-5731

[Automation] VM deployment failed with ConcurrentOperationException in vmware

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 4.3.0
    • 4.4.0
    • Management Server, VMware
    • Security Level: Public (Anyone can view this level - this is the default.)
    • None
    • vmware 5.0
      branch 4.3

    Description

      This issue observed in automation environment, where mulpitple deployment and delete operation happens parallel

      Vew of the vm deployment failed with below error, i will attach complete log with this defect

      2014-01-02 13:24:29,612 WARN [o.a.c.alerts] (Job-Executor-2:ctx-9e3b8e54 ctx-dd556c3f) alertType:: 8 // dataCenterId:: 1 // podId:: 1 // clusterId:: null // message:: Failed to deploy
      Vm with Id: 5, on Host with Id: null
      2014-01-02 13:24:29,653 ERROR [c.c.a.ApiAsyncJobDispatcher] (Job-Executor-2:ctx-9e3b8e54) Unexpected exception while executing org.apache.cloudstack.api.command.user.vm.DeployVMCmd
      com.cloud.utils.exception.CloudRuntimeException: Unable to serialize: com.cloud.exception.AgentUnavailableException/{"_scope":"com.cloud.host.Host","_id":1,"idList":[],"csErrorCode":4285,"detailMessage":"Resource [Host:1] is unreachable: Host 1: Unable to start instance due to Unable to transition to a new state from Running via OperationFailed","cause":

      {"class":"com.cloud.exception.ConcurrentOperationException","msg":"Unable to transition to a new state from Running via OperationFailed"}

      ,"stackTrace":[

      {"declaringClass":"com.cloud.vm.VirtualMachineManagerImpl","methodName":"orchestrateStart","fileName":"VirtualMachineManagerImpl.java","lineNumber":1053}

      ,

      {"declaringClass":"com.cloud.vm.VirtualMachineManagerImpl","methodName":"orchestrateStart","fileName":"VirtualMachineManagerImpl.java","lineNumber":4736}

      ,

      {"declaringClass":"sun.reflect.NativeMethodAccessorImpl","methodName":"invoke0","fileName":"NativeMethodAccessorImpl.java","lineNumber":-2}

      ,

      {"declaringClass":"sun.reflect.NativeMethodAccessorImpl","methodName":"invoke","fileName":"NativeMethodAccessorImpl.java","lineNumber":57}

      ,

      {"declaringClass":"sun.reflect.DelegatingMethodAccessorImpl","methodName":"invoke","fileName":"DelegatingMethodAccessorImpl.java","lineNumber":43}

      ,

      {"declaringClass":"java.lang.reflect.Method","methodName":"invoke","fileName":"Method.java","lineNumber":606}

      ,

      {"declaringClass":"com.cloud.vm.VmWorkJobHandlerProxy","methodName":"handleVmWorkJob","fileName":"VmWorkJobHandlerProxy.java","lineNumber":107}

      ,

      {"declaringClass":"com.cloud.vm.VirtualMachineManagerImpl","methodName":"handleVmWorkJob","fileName":"VirtualMachineManagerImpl.java","lineNumber":4855}

      ,

      {"declaringClass":"com.cloud.vm.VmWorkJobDispatcher","methodName":"runJob","fileName":"VmWorkJobDispatcher.java","lineNumber":99}

      ,

      {"declaringClass":"org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5","methodName":"runInContext","fileName":"AsyncJobManagerImpl.java","lineNumber":522}

      ,

      {"declaringClass":"org.apache.cloudstack.managed.context.ManagedContextRunnable$1","methodName":"run","fileName":"ManagedContextRunnable.java","lineNumber":49}

      ,

      {"declaringClass":"org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1","methodName":"call","fileName":"DefaultManagedContext.java","lineNumber":56}

      ,

      {"declaringClass":"org.apache.cloudstack.managed.context.impl.DefaultManagedContext","methodName":"callWithContext","fileName":"DefaultManagedContext.java","lineNumber":103}

      ,

      {"declaringClass":"org.apache.cloudstack.managed.context.impl.DefaultManagedContext","methodName":"runWithContext","fileName":"DefaultManagedContext.java","lineNumber":53}

      ,

      {"declaringClass":"org.apache.cloudstack.managed.context.ManagedContextRunnable","methodName":"run","fileName":"ManagedContextRunnable.java","lineNumber":46}

      ,

      {"declaringClass":"java.util.concurrent.Executors$RunnableAdapter","methodName":"call","fileName":"Executors.java","lineNumber":471}

      ,

      {"declaringClass":"java.util.concurrent.FutureTask","methodName":"run","fileName":"FutureTask.java","lineNumber":262}

      ,

      {"declaringClass":"java.util.concurrent.ThreadPoolExecutor","methodName":"runWorker","fileName":"ThreadPoolExecutor.java","lineNumber":1145}

      ,

      {"declaringClass":"java.util.concurrent.ThreadPoolExecutor$Worker","methodName":"run","fileName":"ThreadPoolExecutor.java","lineNumber":615}

      ,

      {"declaringClass":"java.lang.Thread","methodName":"run","fileName":"Thread.java","lineNumber":744}

      ],"suppressedExceptions":[]}
      at org.apache.cloudstack.framework.jobs.impl.JobSerializerHelper.fromObjectSerializedString(JobSerializerHelper.java:135)
      at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl.unmarshallResultObject(AsyncJobManagerImpl.java:667)
      at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:758)
      at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:592)
      at org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.deployVirtualMachine(VMEntityManagerImpl.java:237)
      at org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.deploy(VirtualMachineEntityImpl.java:207)
      at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3572)
      at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3152)
      at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3138)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      at java.lang.reflect.Method.invoke(Method.java:606)
      at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
      at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
      at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
      at com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:50)
      at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
      at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
      at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
      at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
      at com.sun.proxy.$Proxy169.startVirtualMachine(Unknown Source)
      at org.apache.cloudstack.api.command.user.vm.DeployVMCmd.execute(DeployVMCmd.java:443)
      at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:161)
      at com.cloud.api.ApiAsyncJobDispatcher.runJobInContext(ApiAsyncJobDispatcher.java:109)
      at com.cloud.api.ApiAsyncJobDispatcher$1.run(ApiAsyncJobDispatcher.java:66)
      at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
      at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
      at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
      at com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:63)
      at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:522)
      at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
      at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)

      Attachments

        1. management-server.rar
          1.89 MB
          Rayees Namathponnan

        Activity

          People

            kelveny Kelven Yang
            rayeesn Rayees Namathponnan
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: