Uploaded image for project: 'CloudStack'
  1. CloudStack
  2. CLOUDSTACK-4543

[Automation] Failed to configure VPC router then reported as deployment failure

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 4.2.0
    • 4.3.0
    • Automation
    • Security Level: Public (Anyone can view this level - this is the default.)
    • None
    • KVM
      4.2.1-stable branch

    Description

      This issue observed during automation run, VPC router deployment failed during network configuration the failed with error [{"com.cloud.agent.api.SetupGuestNetworkAnswer":{"result":false,"details":"Creating guest network failed due to ","wait":0}}] }

      Here the log from Management server

      2013-08-28 05:09:27,760 DEBUG [cloud.network.NetworkManagerImpl] (Job-Executor-8:job-2160 = [ 58de3203-44b2-4384-aff3-b66a617425d3 ]) Network id=473 is shutdown successfully, cleaning up corresponding resources now.
      2013-08-28 05:09:27,762 DEBUG [network.guru.GuestNetworkGuru] (Job-Executor-8:job-2160 = [ 58de3203-44b2-4384-aff3-b66a617425d3 ]) Releasing vnet for the network id=473
      2013-08-28 05:09:27,773 DEBUG [cloud.network.NetworkManagerImpl] (Job-Executor-8:job-2160 = [ 58de3203-44b2-4384-aff3-b66a617425d3 ]) Lock is released for network Ntwk[473|Guest|125] as a part of network shutdown
      2013-08-28 05:09:27,774 DEBUG [cloud.network.NetworkManagerImpl] (Job-Executor-8:job-2160 = [ 58de3203-44b2-4384-aff3-b66a617425d3 ]) Lock is released for network id 473 as a part of network implement
      2013-08-28 05:09:27,774 ERROR [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-8:job-2160 = [ 58de3203-44b2-4384-aff3-b66a617425d3 ]) Failed to start instance VM[User|267a2467-9d94-4667-9624-60e139fd2d1d]
      com.cloud.utils.exception.CloudRuntimeException: Failed to add VPC router VM[DomainRouter|r-507-QA] to guest network Ntwk[473|Guest|125]
      at com.cloud.network.element.VpcVirtualRouterElement.implement(VpcVirtualRouterElement.java:178)
      at com.cloud.network.NetworkManagerImpl.implementNetworkElementsAndResources(NetworkManagerImpl.java:2034)
      at com.cloud.network.NetworkManagerImpl.implementNetwork(NetworkManagerImpl.java:1939)
      at com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
      at com.cloud.network.NetworkManagerImpl.prepare(NetworkManagerImpl.java:2120)
      at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:886)
      at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:578)
      at org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.deployVirtualMachine(VMEntityManagerImpl.java:227)
      at org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.deploy(VirtualMachineEntityImpl.java:209)
      at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3406)
      at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:2966)
      at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:2952)
      at com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
      at org.apache.cloudstack.api.command.user.vm.DeployVMCmd.execute(DeployVMCmd.java:420)
      at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:158)
      at com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:531)
      at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
      at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
      at java.util.concurrent.FutureTask.run(FutureTask.java:166)
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
      at java.lang.Thread.run(Thread.java:679)
      2013-08-28 05:09:27,782 DEBUG [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-8:job-2160 = [ 58de3203-44b2-4384-aff3-b66a617425d3 ]) Cleaning up resources for the vm VM[User|267a2467-9d94-4667-9624-60e139fd2d1d] in Starting state

      Log from Agent

      2013-08-28 05:06:48,127 DEBUG [cloud.agent.Agent] (agentRequest-Handler-3:null) Request:Seq 1-1854544170: { Cmd , MgmtId: 29066118877352, via: 1, Ver: v1, Flags: 100111, [{"com.cloud.agent.api.SetupGuestN
      etworkCommand":{"dhcpRange":"10.1.2.1","networkDomain":"test.domain.org","defaultDns1":"8.8.8.8","isRedundant":false,"add":true,"nic":

      {"deviceId":3,"networkRateMbps":200,"defaultNic":false,"uuid":"7b212956 -2acf-448d-95f4-7b8bb95c4127","ip":"10.1.2.1","netmask":"255.255.255.0","gateway":"10.1.2.1","mac":"02:00:33:f3:00:02","broadcastType":"Vlan","type":"Guest","broadcastUri":"vlan://2316","isolationUri":"vla n://2316","isSecurityGroupEnabled":false}

      ,"accessDetails":

      {"router.guest.ip":"10.1.2.1","guest.vlan.tag":"2316","guest.network.gateway":"10.1.2.1","guest.bridge":"10.1.2.255","router.ip":"169.254.0.91","ro uter.name":"r-507-QA"}

      ,"wait":0}}] }
      2013-08-28 05:06:48,127 DEBUG [cloud.agent.Agent] (agentRequest-Handler-3:null) Processing command: com.cloud.agent.api.SetupGuestNetworkCommand
      2013-08-28 05:06:48,206 DEBUG [resource.virtualnetwork.VirtualRoutingResource] (agentRequest-Handler-3:null) Executing: /usr/share/cloudstack-common/scripts/network/domr/router_proxy.sh vpc_guestnw.sh 169.
      254.0.91 -C -d eth3 -i 10.1.2.1 -g 10.1.2.1 -m 24 -n 10.1.2.0 -s 8.8.8.8 -e test.domain.org

      2013-08-28 05:07:04,749 DEBUG [cloud.agent.Agent] (agentRequest-Handler-4:null) Processing command: com.cloud.agent.api.GetVmStatsCommand
      2013-08-28 05:07:07,005 DEBUG [cloud.agent.Agent] (agentRequest-Handler-5:null) Processing command: com.cloud.agent.api.GetHostStatsCommand
      2013-08-28 05:07:07,005 DEBUG [kvm.resource.LibvirtComputingResource] (agentRequest-Handler-5:null) Executing: /bin/bash -c idle=$(top -b -n 1|grep Cpu(s):|cut -d% -f4|cut -d, -f2);echo $idle
      2013-08-28 05:07:07,592 DEBUG [kvm.resource.LibvirtComputingResource] (agentRequest-Handler-5:null) Execution is successful.
      2013-08-28 05:07:07,593 DEBUG [kvm.resource.LibvirtComputingResource] (agentRequest-Handler-5:null) Executing: /bin/bash -c freeMem=$(free|grep cache:|awk '

      {print $4}

      ');echo $freeMem
      2013-08-28 05:07:07,606 DEBUG [kvm.resource.LibvirtComputingResource] (agentRequest-Handler-5:null) Execution is successful.
      2013-08-28 05:07:07,607 DEBUG [kvm.resource.LibvirtComputingResource] (agentRequest-Handler-5:null) Executing: /bin/bash -c free|grep Mem:|awk '

      {print $2}

      '
      2013-08-28 05:07:07,619 DEBUG [kvm.resource.LibvirtComputingResource] (agentRequest-Handler-5:null) Execution is successful.
      2013-08-28 05:07:09,242 DEBUG [resource.virtualnetwork.VirtualRoutingResource] (agentRequest-Handler-3:null) Exit value is 1
      2013-08-28 05:07:09,242 DEBUG [resource.virtualnetwork.VirtualRoutingResource] (agentRequest-Handler-3:null)
      2013-08-28 05:07:09,242 DEBUG [cloud.agent.Agent] (agentRequest-Handler-3:null) Seq 1-1854544170: { Ans: , MgmtId: 29066118877352, via: 1, Ver: v1, Flags: 110, [{"com.cloud.agent.api.SetupGuestNetworkAnswer":{"result":false,"details":"Creating guest network failed due to ","wait":0}}] }
      2013-08-28 05:07:09,245 DEBUG [cloud.agent.Agent] (agentRequest-Handler-2:null) Request:Seq 1-1854544171: { Cmd , MgmtId: 29066118877352, via: 1, Ver: v1, Flags: 100111, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":true,"vmName":"i-372-508-QA","wait":0}}] }

      Attachments

        1. KVM_Regression_28_Aug_Agent.rar
          1.87 MB
          Rayees Namathponnan
        2. KVM_Regression_28_Aug_MS.rar
          6.91 MB
          Rayees Namathponnan

        Activity

          People

            rayeesn Rayees Namathponnan
            rayeesn Rayees Namathponnan
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: