[CLOUDSTACK-7357] CLONE - Failed to stop VPC router with NPE

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 4.4.0
• Fix Version/s: 4.4.1
• Component/s: Virtual Router
• Security Level: Public (Anyone can view this level - this is the default.)
• Assignee: Amogh Vasekar
• Reporter: Amogh Vasekar
• Created: 15/Aug/14 22:12
• Updated: 18/Aug/14 21:07
• Resolved: 18/Aug/14 21:07

Description

There are many VPC router stop cases failing in automation runs,

VPC router stop fails with below NPE

2014-08-08 10:30:01,087 DEBUG [c.c.n.v.NetworkACLManagerImpl] (AccountChecker-1:ctx-13aaf529) Applying NetworkACL for network: 369 with Network ACL service provider
2014-08-08 10:30:01,090 DEBUG [c.c.n.e.VpcVirtualRouterElement] (AccountChecker-1:ctx-13aaf529) Virtual router elemnt doesn't need to apply firewall rules on the backend; virtual router doesn't exist in the network 369
2014-08-08 10:30:01,091 DEBUG [c.c.n.v.NetworkACLManagerImpl] (AccountChecker-1:ctx-13aaf529) Successfully released Network ACLs for network id=369 and # of rules now = 3
2014-08-08 10:30:01,092 DEBUG [c.c.n.r.RulesManagerImpl] (AccountChecker-1:ctx-13aaf529) Found 0 static nat rules to apply for network id 369
2014-08-08 10:30:01,098 DEBUG [c.c.n.e.VpcVirtualRouterElement] (AccountChecker-1:ctx-13aaf529) VpcVirtualRouter element doesn't need to associate ip addresses on the backend; VPC virtual router doesn't exist in the network 369
2014-08-08 10:30:01,099 DEBUG [o.a.c.e.o.NetworkOrchestrator] (AccountChecker-1:ctx-13aaf529) Sending network shutdown to VpcVirtualRouter
2014-08-08 10:30:01,110 DEBUG [c.c.n.NetworkModelImpl] (AccountChecker-1:ctx-13aaf529) Service SecurityGroup is not supported in the network id=369
2014-08-08 10:30:01,110 DEBUG [c.c.n.r.VpcVirtualNetworkApplianceManagerImpl] (AccountChecker-1:ctx-13aaf529) Router r-320-VM is in Stopped, so not sending setup guest network command to the backend
2014-08-08 10:30:01,115 WARN [o.a.c.e.o.NetworkOrchestrator] (AccountChecker-1:ctx-13aaf529) Unable to complete shutdown of the network elements due to element: VpcVirtualRouter
java.lang.NullPointerException
at com.cloud.hypervisor.KVMGuru.implement(KVMGuru.java:63)
at com.cloud.vm.VirtualMachineManagerImpl.orchestrateRemoveVmFromNetwork(VirtualMachineManagerImpl.java:3024)
at com.cloud.vm.VirtualMachineManagerImpl.removeVmFromNetwork(VirtualMachineManagerImpl.java:3009)
at com.cloud.network.router.VpcVirtualNetworkApplianceManagerImpl.removeVpcRouterFromGuestNetwork(VpcVirtualNetworkApplianceManagerImpl.java:321)
at sun.reflect.GeneratedMethodAccessor280.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
at com.sun.proxy.$Proxy189.removeVpcRouterFromGuestNetwork(Unknown Source)
at com.cloud.network.element.VpcVirtualRouterElement.shutdown(VpcVirtualRouterElement.java:261)

at org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.shutdownNetworkElementsAndResources(NetworkOrchestrator.java:2142)
at org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.shutdownNetwork(NetworkOrchestrator.java:2044)
at org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.destroyNetwork(NetworkOrchestrator.java:2202)
at com.cloud.user.AccountManagerImpl.cleanupAccount(AccountManagerImpl.java:793)
at com.cloud.user.AccountManagerImpl$AccountCleanupTask.runInContext(AccountManagerImpl.java:1675)
at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:744)
2014-08-08 10:30:01,121 DEBUG [o.a.c.e.o.NetworkOrchestrator] (AccountChecker-1:ctx-13aaf529) Lock is released for network Ntwk[369|Guest|102] as a part of network shutdown
2014-08-08 10:30:01,122 DEBUG [o.a.c.e.o.NetworkOrchestrator] (AccountChecker-1:ctx-13aaf529) Network is not not in the correct state to be destroyed: Shutdown
2014-08-08 10:30:01,122 WARN [c.c.u.AccountManagerImpl] (AccountChecker-1:ctx-13aaf529) Unable to destroy network Ntwk[369|Guest|102] as a part of account id=231 cleanup.
2014-08-08 10:30:01,127 DEBUG [o.a.c.e.o.NetworkOrchestrator] (AccountChecker-1:ctx-13aaf529) Lock is acquired for network Ntwk[370|Guest|103] as a part of network shutdown
2014-08-08 10:30:01,131 DEBUG [o.a.c.e.o.NetworkOrchestrator] (AccountChecker-1:ctx-13aaf529) Releasing 0 port forwarding rules for network id=370 as a part of shutdownNetworkRules
2014-08-08 10:30:01,131 DEBUG [c.c.n.f.FirewallManagerImpl] (AccountChecker-1:ctx-13aaf529) There are no rules to forward to the network elements
2014-08-08 10:30:01,132 DEBUG [o.a.c.e.o.NetworkOrchestrator] (AccountChecker-1:ctx-13aaf529) Releasing 0 static nat rules for network id=370 as a part of shutdownNetworkRules
2014-08-08 10:30:01,132 DEBUG [c.c.n.f.FirewallManagerImpl] (AccountChecker-1:ctx-13aaf529) There are no rules to forward to the network elements

Issue Links

• is a clone of: CLOUDSTACK-7295 [Automation] Failed to stop VPC router with NPE