Uploaded image for project: 'CloudStack'
  1. CloudStack
  2. CLOUDSTACK-9612

Restart Network with clean up fails for networks whose offering has been changed from Isolated -> RVR

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 4.9.2.0
    • None
    • Security Level: Public (Anyone can view this level - this is the default.)
    • None

    Description

      Deploy a network N1 with " Offering for Isolated networks with Source Nat service enabled" . Ensure both vm and vr are UP .
      Create a RVR offering and edit the network offering from the current to RVR ofefring .
      Ensure both Master and Backup are up and running.
      Now restart the network with clean up option enabled.

      Observations :
      Restarting the nw with clean up is creating is failing with the below error.

      2016-11-24 15:49:32,432 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-47:ctx-a1f65072 job-99/job-104 ctx-8f4ab192) (logid:fb2d5b7b) Start completed for VM VM[DomainRouter|r-21-QA]
      2016-11-24 15:49:32,432 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-47:ctx-a1f65072 job-99/job-104 ctx-8f4ab192) (logid:fb2d5b7b) Done executing VM work job: com.cloud.vm.VmWorkStart{"dcId":0,"rawParams":{"RestartNetwork":"rO0ABXNyABFqYXZhLmxhbmcuQm9vbGVhbs0gcoDVnPruAgABWgAFdmFsdWV4cAE"},"userId":2,"accountId":2,"vmId":21,"handlerName":"VirtualMachineManagerImpl"}
      2016-11-24 15:49:32,432 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-47:ctx-a1f65072 job-99/job-104 ctx-8f4ab192) (logid:fb2d5b7b) Complete async job-104, jobStatus: SUCCEEDED, resultCode: 0, result: null
      2016-11-24 15:49:32,434 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-47:ctx-a1f65072 job-99/job-104 ctx-8f4ab192) (logid:fb2d5b7b) Publish async job-104 complete on message bus
      2016-11-24 15:49:32,434 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-47:ctx-a1f65072 job-99/job-104 ctx-8f4ab192) (logid:fb2d5b7b) Wake up jobs related to job-104
      2016-11-24 15:49:32,434 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-47:ctx-a1f65072 job-99/job-104 ctx-8f4ab192) (logid:fb2d5b7b) Update db status for job-104
      2016-11-24 15:49:32,435 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-47:ctx-a1f65072 job-99/job-104 ctx-8f4ab192) (logid:fb2d5b7b) Wake up jobs joined with job-104 and disjoin all subjobs created from job- 104
      2016-11-24 15:49:32,446 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-47:ctx-a1f65072 job-99/job-104) (logid:fb2d5b7b) Done with run of VM work job: com.cloud.vm.VmWorkStart for VM 21, job origin: 99
      2016-11-24 15:49:32,446 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-47:ctx-a1f65072 job-99/job-104) (logid:fb2d5b7b) Done executing com.cloud.vm.VmWorkStart for job-104
      2016-11-24 15:49:32,448 INFO  [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-47:ctx-a1f65072 job-99/job-104) (logid:fb2d5b7b) Remove job-104 from job monitoring
      2016-11-24 15:49:32,455 WARN  [o.a.c.e.o.NetworkOrchestrator] (API-Job-Executor-10:ctx-d835fe9f job-99 ctx-2cd2b41c) (logid:fb2d5b7b) Failed to implement network Ntwk[204|Guest|16] elements and resources as a part of network restart due to 
      com.cloud.exception.ResourceUnavailableException: Resource [DataCenter:1] is unreachable: Can't find all necessary running routers!
      	at com.cloud.network.element.VirtualRouterElement.implement(VirtualRouterElement.java:226)
      	at org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.implementNetworkElementsAndResources(NetworkOrchestrator.java:1132)
      	at org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.restartNetwork(NetworkOrchestrator.java:2740)
      	at com.cloud.network.NetworkServiceImpl.restartNetwork(NetworkServiceImpl.java:1907)
      	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
      	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      	at java.lang.reflect.Method.invoke(Method.java:498)
      	at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
      	at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
      	at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
      	at org.apache.cloudstack.network.contrail.management.EventUtils$EventInterceptor.invoke(EventUtils.java:106)
      	at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
      	at com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:51)
      	at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
      	at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
      	at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
      	at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
      	at com.sun.proxy.$Proxy183.restartNetwork(Unknown Source)
      	at org.apache.cloudstack.api.command.user.network.RestartNetworkCmd.execute(RestartNetworkCmd.java:95)
      	at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:150)
      	at com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:108)
      	at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
      	at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
      	at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
      	at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
      	at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
      	at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
      	at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
      	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
      	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      	at java.lang.Thread.run(Thread.java:745)
      
      

      Attachments

        Issue Links

          Activity

            People

              jayapal Jayapal
              jayapal Jayapal
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Slack

                  Issue deployment