Uploaded image for project: 'CloudStack'
  1. CloudStack
  2. CLOUDSTACK-5042

(Upgrade) Exception when stop VM after upgrade

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 4.2.1, 4.3.0
    • 4.2.1, 4.3.0
    • None
    • Security Level: Public (Anyone can view this level - this is the default.)
    • None

    Description

      (1) wrong device when install

      Running /usr/bin/cloudstack-agent-upgrade to update bridge name for upgrade from CloudStack 4.0.x (and before) to CloudStack 4.1 (and later)
      upgrade bridge: cloudVirBr108, eth1.108
      find vlan Id: 108
      find physical device eth1
      new bridge name breth1-108
      Upgrade succeed

      However, the actual device in agent.properties is cloudbr0 -> eth0

      ------------------------

      (2)

      2013-11-05 11:08:40,715 DEBUG [cloud.agent.Agent] (agentRequest-Handler-1:null) Request:Seq 2-1615527947: { Cmd , MgmtId: 345051517871, via: 2, Ver: v1, Flags: 100111, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":true,"vmName":"s-3-VM","wait":0}}] }
      2013-11-05 11:08:40,715 DEBUG [cloud.agent.Agent] (agentRequest-Handler-1:null) Processing command: com.cloud.agent.api.StopCommand
      2013-11-05 11:08:40,747 DEBUG [kvm.resource.LibvirtComputingResource] (agentRequest-Handler-1:null) Executing: /usr/share/cloudstack-common/scripts/vm/network/security_group.py destroy_network_rules_for_vm --vmname s-3-VM --vif vnet0
      2013-11-05 11:08:40,960 DEBUG [kvm.resource.LibvirtComputingResource] (agentRequest-Handler-1:null) Execution is successful.
      2013-11-05 11:08:40,960 DEBUG [kvm.resource.LibvirtComputingResource] (agentRequest-Handler-1:null) Try to stop the vm at first
      2013-11-05 11:08:46,970 DEBUG [utils.script.Script] (agentRequest-Handler-1:null) Executing: /bin/bash -c ls /sys/class/net/cloud0/brif | grep vnet
      2013-11-05 11:08:46,979 DEBUG [utils.script.Script] (agentRequest-Handler-1:null) Execution is successful.
      2013-11-05 11:08:46,980 DEBUG [utils.script.Script] (agentRequest-Handler-1:null) Executing: /bin/bash -c ls /sys/class/net/cloudbr1/brif | grep vnet
      2013-11-05 11:08:46,985 DEBUG [utils.script.Script] (agentRequest-Handler-1:null) Execution is successful.
      2013-11-05 11:08:46,985 DEBUG [utils.script.Script] (agentRequest-Handler-1:null) Executing: /bin/bash -c ls /sys/class/net/cloudVirBr108/brif | grep vnet
      2013-11-05 11:08:46,990 DEBUG [utils.script.Script] (agentRequest-Handler-1:null) Exit value is 1
      2013-11-05 11:08:46,990 DEBUG [utils.script.Script] (agentRequest-Handler-1:null) ls: cannot access /sys/class/net/cloudVirBr108/brif: No such file or directory
      2013-11-05 11:08:46,990 DEBUG [kvm.resource.BridgeVifDriver] (agentRequest-Handler-1:null) Executing: /usr/share/cloudstack-common/scripts/vm/network/vnet/modifyvlan.sh -o delete -v 108 -p undefined -b cloudVirBr108
      2013-11-05 11:08:46,998 DEBUG [kvm.resource.BridgeVifDriver] (agentRequest-Handler-1:null) Execution is successful.
      2013-11-05 11:08:46,998 DEBUG [kvm.resource.BridgeVifDriver] (agentRequest-Handler-1:null) ERROR: trying to remove VLAN :undefined.108: error: No such device
      Failed to del vlan: 108

      2013-11-05 11:08:46,999 DEBUG [cloud.agent.Agent] (agentRequest-Handler-1:null) Seq 2-1615527947: { Ans: , MgmtId: 345051517871, via: 2, Ver: v1, Flags: 110, [{"com.cloud.agent.api.StopAnswer":{"vncPort":0,"result":true,"wait":0}}] }
      2013-11-05 11:08:49,622 DEBUG [kvm.resource.KVMHAMonitor] (Thread-4:null) Found NFS storage pool bedca527-1fc1-38dc-9448-fe6bf4e66653 in libvirt, continuing
      2013-11-05 11:08:49,623 DEBUG [kvm.resource.KVMHAMonitor] (Thread-4:null) Executing: /usr/share/cloudstack-common/scripts/vm/hypervisor/kvm/kvmheartbeat.sh -i 172.16.8.254 -p /storage/cs-108-pri -m /mnt/bedca527-1fc1-38dc-9448-fe6bf4e66653 -h 172.16.8.15
      2013-11-05 11:08:49,635 DEBUG [kvm.resource.KVMHAMonitor] (Thread-4:null) Execution is successful.

      (3) Because of (1), the start of systemvm will fail

      2013-11-05 11:09:38,571 DEBUG [cloud.agent.Agent] (agentRequest-Handler-4:null) Processing command: com.cloud.agent.api.StartCommand
      2013-11-05 11:09:38,608 DEBUG [kvm.resource.BridgeVifDriver] (agentRequest-Handler-4:null) nic=[Nic:Control-169.254.0.121-null]
      2013-11-05 11:09:38,608 DEBUG [utils.script.Script] (agentRequest-Handler-4:null) Executing: /bin/bash -c ip route | grep 169.254.0.0/16
      2013-11-05 11:09:38,616 DEBUG [utils.script.Script] (agentRequest-Handler-4:null) Execution is successful.
      2013-11-05 11:09:38,617 DEBUG [kvm.resource.BridgeVifDriver] (agentRequest-Handler-4:null) nic=[Nic:Management-172.16.8.33-null]
      2013-11-05 11:09:38,617 DEBUG [kvm.resource.BridgeVifDriver] (agentRequest-Handler-4:null) nic=[Nic:Guest-10.11.108.116-vlan://108]
      2013-11-05 11:09:38,617 DEBUG [kvm.resource.BridgeVifDriver] (agentRequest-Handler-4:null) creating a vlan dev and bridge for guest traffic per traffic label cloudbr0
      2013-11-05 11:09:38,618 DEBUG [kvm.resource.BridgeVifDriver] (agentRequest-Handler-4:null) Executing: /usr/share/cloudstack-common/scripts/vm/network/vnet/modifyvlan.sh -v 108 -p eth0 -b breth0-108 -o add
      2013-11-05 11:09:38,638 DEBUG [kvm.resource.BridgeVifDriver] (agentRequest-Handler-4:null) Exit value is 1
      2013-11-05 11:09:38,640 DEBUG [kvm.resource.BridgeVifDriver] (agentRequest-Handler-4:null) Set name-type for VLAN subsystem. Should be visible in /proc/net/vlan/configdevice eth0.108 is already a member of a bridge; can't enslave it to bridge breth0-108.Failed to add vlan: eth0.108 to breth0-108
      2013-11-05 11:09:38,641 WARN [kvm.resource.LibvirtComputingResource] (agentRequest-Handler-4:null) InternalErrorException
      com.cloud.exception.InternalErrorException: Failed to create vnet 108: Set name-type for VLAN subsystem. Should be visible in /proc/net/vlan/configdevice eth0.108 is already a member of a bridge; can't enslave it to bridge breth0-108.Failed to add vlan: eth0.108 to breth0-108
      at com.cloud.hypervisor.kvm.resource.BridgeVifDriver.createVnet(BridgeVifDriver.java:171)
      at com.cloud.hypervisor.kvm.resource.BridgeVifDriver.createVlanBr(BridgeVifDriver.java:156)
      at com.cloud.hypervisor.kvm.resource.BridgeVifDriver.plug(BridgeVifDriver.java:106)
      at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.createVif(LibvirtComputingResource.java:3809)
      at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.createVifs(LibvirtComputingResource.java:3565)
      at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(LibvirtComputingResource.java:3590)
      at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1257)
      at com.cloud.agent.Agent.processRequest(Agent.java:525)
      at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:852)
      at com.cloud.utils.nio.Task.run(Task.java:83)
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      at java.lang.Thread.run(Thread.java:679)

      Attachments

        Activity

          People

            weizhou Wei Zhou
            weizhou Wei Zhou
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: