[CLOUDSTACK-3682] NPE in BridgeVifDriver causing systemvm startup failure in KVM

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 4.6.0
• Component/s: Install and Setup, KVM
• Security Level: Public (Anyone can view this level - this is the default.)
• Assignee: Daan
• Reporter: Prasanna
• Created: 20/Jul/13 05:35
• Updated: 29/Jul/15 14:23
• Resolved: 29/Jul/15 14:23

Description

KVM start up of systemVMs is broken on master with the following exception
found in the management server logs

Running against master (88c84d91092f7f77bf7766a5164de90ac703bdc9)

Management Server:
Jul 19 21:32:55 cloudstack-centos63.fmt.vmops.com local0: 2013-07-20 04:32:55,858 DEBUG [agent.manager.AgentAttache] (secstorage-1:null) Request seq: 1368719379
Jul 19 21:32:55 cloudstack-centos63.fmt.vmops.com local0: 2013-07-20 04:32:55,859 DEBUG [agent.transport.Request] (AgentManager-Handler-3:null) Seq 2-1785069582: Processing: { Ans: , MgmtId: 200973787296321, via: 2, Ver: v1, Flags: 10, [{"com.cloud.agent.api.Answer":{"result":false,"details":"java.lang.NullPointerException\n\tat com.cloud.hypervisor.kvm.resource.BridgeVifDriver.plug(BridgeVifDriver.java:118)\n\tat com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.createVif(LibvirtComputingResource.java:3504)\n\tat com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.createVifs(LibvirtComputingResource.java:3266)\n\tat com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(L...
Jul 19 21:32:55 cloudstack-centos63.fmt.vmops.com ...ibvirtComputingResource.java: 3291)\n\tat com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1223)\n\tat com.cloud.agent.Agent.processRequest(Agent.java:499)\n\tat com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:807)\n\tat com.cloud.utils.nio.Task.run(Task.java:83)\n\tat java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)\n\tat java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)\n\tat java.lang.Thread.run(Thread.java:679)\n","wait":0}},{"com.cloud.agent.api.Answer":{"result":false,"details":"Stopped by previous failure","wait":0}}] }
Jul 19 21:32:55 cloudstack-centos63.fmt.vmops.com local0: 2013-07-20 04:32:55,862 DEBUG [agent.transport.Request] (consoleproxy-1:null) Seq 2-1785069582: Received: { Ans: , MgmtId: 200973787296321, via: 2, Ver: v1, Flags: 10,

{ Answer, Answer }

}
Jul 19 21:32:55 cloudstack-centos63.fmt.vmops.com local0: 2013-07-20 04:32:55,864 DEBUG [agent.manager.AgentAttache] (secstorage-1:null) waiting to send 1368719379
Jul 19 21:32:55 cloudstack-centos63.fmt.vmops.com local0: 2013-07-20 04:32:55,864 DEBUG [agent.manager.AgentAttache] (secstorage-1:null) entering synchronize block for sending 1368719379
Jul 19 21:32:55 cloudstack-centos63.fmt.vmops.com local0: 2013-07-20 04:32:55,867 ERROR [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Failed to start instance VM[ConsoleProxy|v-2-VM]
Jul 19 21:32:55 cloudstack-centos63.fmt.vmops.com com.cloud.utils.exception.CloudRuntimeException: Unable to get answer that is of class com.cloud.agent.api.StartAnswer
Jul 19 21:32:55 cloudstack-centos63.fmt.vmops.com at com.cloud.agent.manager.Commands.getAnswer(Commands.java:80)
Jul 19 21:32:55 cloudstack-centos63.fmt.vmops.com at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:939)
Jul 19 21:32:55 cloudstack-centos63.fmt.vmops.com at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:614)
Jul 19 21:32:55 cloudstack-centos63.fmt.vmops.com at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:607)
Jul 19 21:32:55 cloudstack-centos63.fmt.vmops.com at com.cloud.consoleproxy.ConsoleProxyManagerImpl.startProxy(ConsoleProxyManagerImpl.java:555)
Jul 19 21:32:55 cloudstack-centos63.fmt.vmops.com at com.cloud.consoleproxy.ConsoleProxyManagerImpl.allocCapacity(ConsoleProxyManagerImpl.java:927)
Jul 19 21:32:55 cloudstack-centos63.fmt.vmops.com at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:1641)
Jul 19 21:32:55 cloudstack-centos63.fmt.vmops.com at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:156)
Jul 19 21:32:55 cloudstack-centos63.fmt.vmops.com at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:111)
Jul 19 21:32:55 cloudstack-centos63.fmt.vmops.com at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:33)
Jul 19 21:32:55 cloudstack-centos63.fmt.vmops.com at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:81)
Jul 19 21:32:55 cloudstack-centos63.fmt.vmops.com at com.cloud.vm.SystemVmLoadScanner$1.run(SystemVmLoadScanner.java:72)
Jul 19 21:32:55 cloudstack-centos63.fmt.vmops.com at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
Jul 19 21:32:55 cloudstack-centos63.fmt.vmops.com at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:351)
Jul 19 21:32:55 cloudstack-centos63.fmt.vmops.com at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178)
Jul 19 21:32:55 cloudstack-centos63.fmt.vmops.com at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:165)
Jul 19 21:32:55 cloudstack-centos63.fmt.vmops.com at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:267)
Jul 19 21:32:55 cloudstack-centos63.fmt.vmops.com at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
Jul 19 21:32:55 cloudstack-centos63.fmt.vmops.com at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
Jul 19 21:32:55 cloudstack-centos63.fmt.vmops.com at java.lang.Thread.run(Thread.java:679)

Agent:
Jul 19 22:25:24 apache-81-3.fmt.vmops.com local1: 2013-07-20 05:25:24,952 WARN [cloud.agent.Agent] (agentRequest-Handler-1:null) Caught:
Jul 19 22:25:24 java.lang.NullPointerException
Jul 19 22:25:24 apache-81-3.fmt.vmops.com at com.cloud.hypervisor.kvm.resource.BridgeVifDriver.plug(BridgeVifDriver.java:118)
Jul 19 22:25:24 apache-81-3.fmt.vmops.com at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.createVif(LibvirtComputingResource.java:3504)
Jul 19 22:25:24 apache-81-3.fmt.vmops.com at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.createVifs(LibvirtComputingResource.java:3266)
Jul 19 22:25:24 apache-81-3.fmt.vmops.com at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(LibvirtComputingResource.java:3291)
Jul 19 22:25:24 apache-81-3.fmt.vmops.com at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1223)
Jul 19 22:25:24 apache-81-3.fmt.vmops.com at com.cloud.agent.Agent.processRequest(Agent.java:499)
Jul 19 22:25:24 apache-81-3.fmt.vmops.com at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:807)
Jul 19 22:25:24 apache-81-3.fmt.vmops.com at com.cloud.utils.nio.Task.run(Task.java:83)
Jul 19 22:25:24 apache-81-3.fmt.vmops.com at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
Jul 19 22:25:24 apache-81-3.fmt.vmops.com at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
Jul 19 22:25:24 apache-81-3.fmt.vmops.com at java.lang.Thread.run(Thread.java:679)

Issue Links

• is related to: CLOUDSTACK-3883 Advance Zone used to VMware, Public Network with vlan id specified, but portgroup created is cloud.public.untagged.0.1-vSwitch0 not cloud.public.[vlanid].0.1-vSwitch0