Uploaded image for project: 'CloudStack'
  1. CloudStack
  2. CLOUDSTACK-2718

disassciateIpAddress on an IP when the router is not reachable leaves the IPAddress state in 'Releasing' forever.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Not A Problem
    • 4.2.0
    • 4.2.0
    • Network Controller
    • Security Level: Public (Anyone can view this level - this is the default.)

    Description

      Steps to reproduce :

      1. Have a latest CloudStack setup with advanced zone and having at least one XenCluster
      2. Have at least one isolated network
      3. As a non-ROOT domain user, acquire a public ip on the above network
      4. Bring down the link-local interface on the router VM for the above network

      NOTE : In case of VMware, bring down the mgmt interface
      5. Try to disassociate the IP address acquired in (3)

      Observations:-

      It failed with an exception but, IPAddress state is stuck at 'Releasing'. There is no way for end-user/admin to take any further action on this.

      Here is the snippet from mgmt-server log :

      2013-05-28 14:02:27,084 DEBUG [network.router.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:null) Found 1 routers to update status.
      2013-05-28 14:02:27,087 DEBUG [network.router.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:null) Found 0 networks to update RvR status.
      2013-05-28 14:02:27,197 DEBUG [network.router.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:null) Found 1 routers to update status.
      2013-05-28 14:02:27,199 DEBUG [network.router.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:null) Found 0 networks to update RvR status.
      2013-05-28 14:02:27,565 ERROR [xen.resource.CitrixResourceBase] (DirectAgent-406:null) Ip Assoc failure on applying one ip due to exception:
      com.cloud.exception.InternalErrorException: Xen plugin "ipassoc" failed.
      at com.cloud.hypervisor.xen.resource.CitrixResourceBase.assignPublicIpAddress(CitrixResourceBase.java:2393)
      at com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResourceBase.java:2503)
      at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:514)
      at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:73)
      at com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:104)
      at com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:186)
      at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
      at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
      at java.util.concurrent.FutureTask.run(FutureTask.java:166)
      at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165)
      at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266)
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      at java.lang.Thread.run(Thread.java:679)
      2013-05-28 14:02:27,566 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-406:null) Seq 1-550246224: Response Received:
      2013-05-28 14:02:27,567 DEBUG [agent.transport.Request] (DirectAgent-406:null) Seq 1-550246224: Processing: { Ans: , MgmtId: 7332683579487, via: 1, Ver: v1, Flags: 0, [{"com.cloud.agent.api.routing.IpAssocAnswer":{"results":["Failed"],"result":false,"wait":0}}] }
      2013-05-28 14:02:27,567 DEBUG [agent.transport.Request] (Job-Executor-39:job-37) Seq 1-550246224: Received: { Ans: , MgmtId: 7332683579487, via: 1, Ver: v1, Flags: 0,

      { IpAssocAnswer }

      }
      2013-05-28 14:02:27,568 DEBUG [cloud.network.NetworkManagerImpl] (Job-Executor-39:job-37) Resource is not available: VirtualRouter
      com.cloud.exception.ResourceUnavailableException: Resource [DataCenter:1] is unreachable: Unable to apply ip association on router
      at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.applyRules(VirtualNetworkApplianceManagerImpl.java:3740)
      at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.associatePublicIP(VirtualNetworkApplianceManagerImpl.java:3552)
      at com.cloud.network.router.VpcVirtualNetworkApplianceManagerImpl.associatePublicIP(VpcVirtualNetworkApplianceManagerImpl.java:561)
      at com.cloud.network.element.VirtualRouterElement.applyIps(VirtualRouterElement.java:471)
      at com.cloud.network.NetworkManagerImpl.applyIpAssociations(NetworkManagerImpl.java:610)
      at com.cloud.network.NetworkManagerImpl.applyIpAssociations(NetworkManagerImpl.java:555)
      at com.cloud.network.NetworkManagerImpl.disassociatePublicIpAddress(NetworkManagerImpl.java:1092)
      at com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
      at com.cloud.network.NetworkServiceImpl.releaseIpAddressInternal(NetworkServiceImpl.java:880)
      at com.cloud.network.NetworkServiceImpl.releaseIpAddress(NetworkServiceImpl.java:840)
      at com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
      at org.apache.cloudstack.api.command.user.address.DisassociateIPAddrCmd.execute(DisassociateIPAddrCmd.java:79)
      at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:155)
      at com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:437)
      at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
      at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
      at java.util.concurrent.FutureTask.run(FutureTask.java:166)
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      at java.lang.Thread.run(Thread.java:679)
      2013-05-28 14:02:27,569 WARN [cloud.network.NetworkManagerImpl] (Job-Executor-39:job-37) Unable to apply ip address associations for Ntwk[204|Guest|8]
      2013-05-28 14:02:27,569 WARN [cloud.network.NetworkServiceImpl] (Job-Executor-39:job-37) Failed to release public ip address id=4
      2013-05-28 14:02:27,578 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Executor-39:job-37) Complete async job-37, jobStatus: 2, resultCode: 530, result: Error Code: 530 Error text: Failed to disassociate ip address

      Attaching all the required logs along with db dump to the bug.

      Attachments

        1. logs.tgz
          677 kB
          Venkata Swamy

        Activity

          People

            Unassigned Unassigned
            swamy Venkata Swamy
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: