[CLOUDSTACK-8787] Network Update from Standalone VR offering to RVR offering is failing with Runtime Exception

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 4.6.0
• Fix Version/s: Future
• Security Level: Public (Anyone can view this level - this is the default.)
• Assignee: Kshitij Kansal
• Reporter: Deepthi Machiraju
• Created: 31/Aug/15 11:18
• Updated: 13/Apr/16 02:38

Description

• Deploy a network with Standalone offering ID .
• Navigate to Network and update the offering from Standalone -> RVR.

Expected Result :
Network Update should be sucessful

Observation:
Network update is failing with the following below exception : " failed to update network 637b4d16-a2ef-464c-a805-2375774a5730due to Failed to implement network (with specified id) elements and resources as a part of network update "

015-08-31 10:59:13,044 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-87:ctx-d2e23154 job-141/job-144) Done with run of VM work job: com.cloud.vm.VmWorkStart for VM 33, job origin: 141
2015-08-31 10:59:13,044 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-87:ctx-d2e23154 job-141/job-144) Done executing com.cloud.vm.VmWorkStart for job-144
2015-08-31 10:59:13,049 WARN [c.c.n.NetworkServiceImpl] (API-Job-Executor-47:ctx-14794ea0 job-141 ctx-70358d9a) Failed to implement network Ntwk[206|Guest|18] elements and resources as a part of network update due to
com.cloud.exception.ResourceUnavailableException: Resource [DataCenter:1] is unreachable: Can't find all necessary running routers!
at com.cloud.network.element.VirtualRouterElement.implement(VirtualRouterElement.java:227)
at org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.implementNetworkElementsAndResources(NetworkOrchestrator.java:1113)
at com.cloud.network.NetworkServiceImpl.updateGuestNetwork(NetworkServiceImpl.java:2354)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
at org.apache.cloudstack.network.contrail.management.EventUtils$EventInterceptor.invoke(EventUtils.java:106)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
at com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:51)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
at $Proxy161.updateGuestNetwork(Unknown Source)
at org.apache.cloudstack.api.command.admin.network.UpdateNetworkCmdByAdmin.execute(UpdateNetworkCmdByAdmin.java:51)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:141)
at com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:108)
at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537)
at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
2015-08-31 10:59:13,051 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-87:ctx-d2e23154 job-141/job-144) Remove job-144 from job monitoring
2015-08-31 10:59:13,056 ERROR [c.c.a.ApiAsyncJobDispatcher] (API-Job-Executor-47:ctx-14794ea0 job-141) Unexpected exception while executing org.apache.cloudstack.api.command.admin.network.UpdateNetworkCmdByAdmin
com.cloud.utils.exception.CloudRuntimeException: failed to update network 637b4d16-a2ef-464c-a805-2375774a5730due to Failed to implement network (with specified id) elements and resources as a part of network update
at com.cloud.network.NetworkServiceImpl.updateGuestNetwork(NetworkServiceImpl.java:2384)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
at org.apache.cloudstack.network.contrail.management.EventUtils$EventInterceptor.invoke(EventUtils.java:106)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
at com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:51)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
at $Proxy161.updateGuestNetwork(Unknown Source)
at org.apache.cloudstack.api.command.admin.network.UpdateNetworkCmdByAdmin.execute(UpdateNetworkCmdByAdmin.java:51)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:141)
at com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:108)
at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537)
at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
2015-08-31 10:59:13,057 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-47:ctx-14794ea0 job-141) Complete async job-141, jobStatus: FAILED, resultCode: 530, result: org.apache.cloudstack.api.response.ExceptionResponse/null/

{"uuidList":[],"errorcode":530,"errortext":"failed to update network 637b4d16-a2ef-464c-a805-2375774a5730due to Failed to implement network (with specified id) elements and resources as a part of network update"}

2015-08-31 10:59:13,058 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-47:ctx-14794ea0 job-141) Publish async job-141 complete on message bus
2015-08-31 10:59:13,058 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-47:ctx-14794ea0 job-141) Wake up jobs related to job-141
2015-08-31 10:59:13,058 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-47:ctx-14794ea0 job-141) Update db status for job-141
2015-08-31 10:59:13,059 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-47:ctx-14794ea0 job-141) Wake up jobs joined with job-141 and disjoin all subjobs created from job- 141
2015-08-31 10:59:13,062 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-47:ctx-14794ea0 job-141) Done executing org.apache.cloudstack.api.command.admin.network.UpdateNetworkCmdByAdmin for job-141
2015-08-31 10:59:13,062 INFO [o.a.c.f.j.i.AsyncJobMonitor] (API-Job-Executor-47:ctx-14794ea0 job-141) Remove job-141 from job monitoring

Attached MS logs and DB dump.

Issue Links

• duplicates: CLOUDSTACK-8788 Network Update from RVR offering to Standalone offering fails.