[CLOUDSTACK-8653] VM HA fails at shutdown KVM host test

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Invalid
• Affects Version/s: 4.5.1
• Component/s: KVM
• Security Level: Public (Anyone can view this level - this is the default.)
• Labels: HA KVM
• Environment: Cloudstack 4.5.1; 2 KVM hosts , 1 manager. ; NFS primary storage and secondary ; Centos 6.6
• Assignee: Unassigned
• Reporter: Luciano Castro
• Created: 20/Jul/15 15:06
• Updated: 20/Jul/15 19:07
• Resolved: 20/Jul/15 19:07

Description

I´m testing HA Offer, and the scenario of this test was:

1) I set HA on a VM at KVM host 'A'.
2) I shutdown gracefully this host 'A'
3) I expected that the investigators process will be check if the HA VMs is alive, but I couldn´t see nothing in the logs:

[root@1q2 ~]# date
Mon Jul 20 15:03:10 UTC 2015
[root@1q2 ~]#
[root@1q2 ~]# ls -ltrh /var/log/cloudstack/management/management-server.log
rw-rw-r-. 1 cloud cloud 14M Jul 20 15:03 /var/log/cloudstack/management/management-server.log
[root@1q2 ~]#
[root@1q2 ~]# grep -i Investigator /var/log/cloudstack/management/management-server.log
[root@1q2 ~]#

Global Options:
options value
ha.investigators.exclude nothing

ha.investigators.order SimpleInvestigator,XenServerInvestigator,KVMInvestigator,HypervInvestigator,VMwareInvestigator,PingInvestigator,ManagementIPSysVMInvestigator

investigate.retry.interval 60

[root@1q2 ~]# ps waux| grep -i java
root 11408 0.0 0.0 103252 880 pts/0 S+ 14:44 0:00 grep -i java
cloud 24225 0.7 1.7 16982036 876412 ? Sl Jul16 43:48 /usr/lib/jvm/jre-1.7.0/bin/java -Djava.awt.headless=true -Dcom.sun.management.jmxremote=false -Xmx2g -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/var/log/cloudstack/management/ -XX:PermSize=512M -XX:MaxPermSize=800m -Djava.security.properties=/etc/cloudstack/management/java.security.ciphers -classpath :::/etc/cloudstack/management:/usr/share/cloudstack-management/setup:/usr/share/cloudstack-management/bin/bootstrap.jar:/usr/share/cloudstack-management/bin/tomcat-juli.jar:/usr/share/java/commons-daemon.jar -Dcatalina.base=/usr/share/cloudstack-management -Dcatalina.home=/usr/share/cloudstack-management -Djava.endorsed.dirs= -Djava.io.tmpdir=/usr/share/cloudstack-management/temp -Djava.util.logging.config.file=/usr/share/cloudstack-management/conf/logging.properties -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager org.apache.catalina.startup.Bootstrap start

4) I tryed to move this VM to KVM host 'B', but the message is:

Resource [Host:3] is unreachable: Host 3: Host with specified id is not in the right state: Disconnected

Could you try to reproduce it?

thanks.