[CLOUDSTACK-6893] systemvms can not start on KVM host

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Security Level: Public (Anyone can view this level - this is the default.)
• Assignee: Wei Zhou
• Reporter: Wei Zhou
• Created: 11/Jun/14 11:44
• Updated: 01/Dec/14 09:10
• Resolved: 04/Aug/14 08:01

Description

After upgrading from 4.3 to 4.4, the systemvms can not start with the following error logs:

2014-06-11 13:39:42,119 DEBUG [cloud.agent.Agent] (agentRequest-Handler-4:null) Request:Seq 2-8064539557737005074: { Cmd , MgmtId: 345051514000, via: 2, Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StartCommand":{"vm":{"id":216,"name":"s-216-VM","type":"SecondaryStorageVm","cpus":1,"minSpeed":500,"maxSpeed":500,"minRam":536870912,"maxRam":536870912,"arch":"x86_64","os":"Debian GNU/Linux 5.0 (64-bit)","platformEmulator":"Debian GNU/Linux 5","bootArgs":" template=domP type=secstorage host=172.16.15.10 port=8250 name=s-216-VM zone=1 pod=1 guid=s-216-VM resource=org.apache.cloudstack.storage.resource.NfsSecondaryStorageResource instance=SecStorage sslcopy=false role=templateProcessor mtu=1500 eth2ip=10.11.115.115 eth2mask=255.255.255.0 gateway=10.11.115.254 public.network.device=eth2 eth0ip=169.254.1.127 eth0mask=255.255.0.0 eth1ip=172.16.15.38 eth1mask=255.255.255.0 mgmtcidr=10.11.115.0/24 localgw=172.16.15.254 private.network.device=eth1 eth3ip=172.16.15.41 eth3mask=255.255.255.0 storageip=172.16.15.41 storagenetmask=255.255.255.0 storagegateway=172.16.15.254 internaldns1=8.8.8.8 internaldns2=8.8.4.4 dns1=8.8.8.8 dns2=8.8.4.4","rebootOnCrash":false,"enableHA":false,"limitCpuUse":false,"enableDynamicallyScaleVm":false,"vncPassword":"3bbd718218d5602b","params":{},"uuid":"198324f1-aeba-4fae-adad-4ffc087b2f3a","disks":[{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"0d65d238-a753-48da-b1d6-638fa533eb67","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"1dcbc42c-99bc-3276-9d86-4ad81ef1ad8e","id":2,"poolType":"NetworkFilesystem","host":"172.16.15.254","path":"/storage/cs-115-pri","port":2049,"url":"NetworkFilesystem://172.16.15.254/storage/cs-115-pri/?ROLE=Primary&STOREUUID=1dcbc42c-99bc-3276-9d86-4ad81ef1ad8e"}},"name":"ROOT-216","size":297230848,"path":"0d65d238-a753-48da-b1d6-638fa533eb67","volumeId":214,"vmName":"s-216-VM","accountId":1,"format":"QCOW2","id":214,"deviceId":0,"cacheMode":"NONE","hypervisorType":"KVM"}},"diskSeq":0,"path":"0d65d238-a753-48da-b1d6-638fa533eb67","type":"ROOT","_details":{"managed":"false","storagePort":"2049","storageHost":"172.16.15.254","volumeSize":"297230848"}}],"nics":[

{"deviceId":2,"networkRateMbps":-1,"defaultNic":true,"uuid":"765b43a0-43f7-4b23-abcc-86ccc6197a0e","ip":"10.11.115.115","netmask":"255.255.255.0","gateway":"10.11.115.254","mac":"06:78:16:00:00:1a","dns1":"8.8.8.8","dns2":"8.8.4.4","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://115","isolationUri":"vlan://115","isSecurityGroupEnabled":false,"name":"cloudbr0"}

,

{"deviceId":0,"networkRateMbps":-1,"defaultNic":false,"uuid":"dc8a1a58-e581-49a2-8377-dc4fba1dfa57","ip":"169.254.1.127","netmask":"255.255.0.0","gateway":"169.254.0.1","mac":"0e:00:a9:fe:01:7f","broadcastType":"LinkLocal","type":"Control","isSecurityGroupEnabled":false}

,

{"deviceId":1,"networkRateMbps":-1,"defaultNic":false,"uuid":"81b10433-e67c-4052-8664-3bfccdb1c9cf","ip":"172.16.15.38","netmask":"255.255.255.0","gateway":"172.16.15.254","mac":"06:11:c4:00:00:09","broadcastType":"Native","type":"Management","isSecurityGroupEnabled":false,"name":"cloudbr1"}

,

{"deviceId":3,"networkRateMbps":-1,"defaultNic":false,"uuid":"cdcd5757-04df-4b19-a314-f73b314778b2","ip":"172.16.15.41","netmask":"255.255.255.0","gateway":"172.16.15.254","mac":"06:ee:96:00:00:70","broadcastType":"Storage","type":"Storage","isSecurityGroupEnabled":false,"name":"cloudbr1"}

]},"hostIp":"172.16.15.15","executeInSequence":false,"wait":0}},{"com.cloud.agent.api.check.CheckSshCommand":{"ip":"169.254.1.127","port":3922,"interval":6,"retries":100,"name":"s-216-VM","wait":0}}] }
2014-06-11 13:39:42,119 DEBUG [cloud.agent.Agent] (agentRequest-Handler-4:null) Processing command: com.cloud.agent.api.StartCommand
2014-06-11 13:39:42,178 DEBUG [kvm.storage.KVMStoragePoolManager] (agentRequest-Handler-4:null) Disconnecting disk 0d65d238-a753-48da-b1d6-638fa533eb67
2014-06-11 13:39:42,229 DEBUG [cloud.agent.Agent] (agentRequest-Handler-4:null) Seq 2-8064539557737005074: { Ans: , MgmtId: 345051514000, via: 2, Ver: v1, Flags: 10, [{"com.cloud.agent.api.Answer":{"result":false,"details":"No enum constant com.cloud.hypervisor.kvm.resource.LibvirtVMDef.DiskDef.diskCacheMode.none","wait":0}},{"com.cloud.agent.api.Answer":{"result":false,"details":"Stopped by previous failure","wait":0}}] }