[CLOUDSTACK-7163] [Automation] test_vpc_site2site_vpn failing while calling API "Site2SiteVpnCfgCommand"

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 4.5.0
• Fix Version/s: 4.5.0
• Component/s: Virtual Router
• Security Level: Public (Anyone can view this level - this is the default.)
• Environment: KVM; build master 4.5
• Assignee: Sheng Yang
• Reporter: Rayees Namathponnan
• Created: 22/Jul/14 22:07
• Updated: 21/Sep/14 20:13
• Resolved: 25/Jul/14 22:23

Description

This issue is observed with BVT test "TestVpcSite2SiteVpn.test_vpc_site2site_vpn"

Test perform below steps

1. 0) Get the default network offering for VPC
2. 1) Create VPC
3. 2) Create network in VPC
4. 3) Deploy a vm
5. 4) Enable Site-to-Site VPN for VPC
6. 5) Add VPN Customer gateway info

Above test failing while calling API "Site2SiteVpnCfgCommand "

MS Log

2014-07-22 01:52:05,934 DEBUG [c.c.a.t.Request] (API-Job-Executor-94:ctx-df3bae7d job-186 ctx-c6b7a16b) Seq 2-7048133416834826487: Sending { Cmd , Mgmt
Id: 29066118877352, via: 2(Rack2Host12.lab.vmops.com), Ver: v1, Flags: 100101, [{"com.cloud.agent.api.routing.Site2SiteVpnCfgCommand":{"create":true,"lo
calPublicIp":"10.223.122.73","localGuestCidr":"10.1.1.0/24","localPublicGateway":"10.223.122.65","peerGatewayIp":"10.223.122.72","peerGuestCidrList":"10
.2.1.0/24","ipsecPsk":"ipsecpsk","ikePolicy":"3des-md5;modp1536","espPolicy":"3des-md5;modp1536","ikeLifetime":86400,"espLifetime":3600,"dpd":false,"pas
sive":false,"accessDetails":

{"zone.network.type":"Advanced","router.ip":"169.254.2.49","router.name":"r-21-VM"}

,"wait":0}}] }
2014-07-22 01:52:07,505 DEBUG [c.c.a.ApiServlet] (catalina-exec-21:ctx-132693a1) ===START=== 10.223.240.194 – GET jobid=ba146476-5a0b-4c2c-bb35-88baa
6f05be9&apiKey=G8sA0FQTZpogJU0AHE94dxi79AfBpYj8zo595VBiIAh1hQ5qSL5JNRwkirFcRMwLwADgylMwWZ9CUoHJrMdhEQ&command=queryAsyncJobResult&response=json&signatur
e=vlNAJb4TRLbyqp5GOmiAloCY2pU%3D

2014-07-22 01:52:12,775 DEBUG [c.c.a.ApiServlet] (catalina-exec-20:ctx-429c5d35 ctx-7519e824 ctx-9d81eaf7) ===END=== 10.223.240.194 – GET jobid=01f85
959-607a-4f22-bbe7-93cfcd1d2a87&apiKey=G8sA0FQTZpogJU0AHE94dxi79AfBpYj8zo595VBiIAh1hQ5qSL5JNRwkirFcRMwLwADgylMwWZ9CUoHJrMdhEQ&command=queryAsyncJobResul
t&response=json&signature=XEU%2FZBTerXYrgbe3KyDPCbhTkMU%3D
2014-07-22 01:52:13,001 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-13:null) SeqA 4-443: Processing Seq 4-443: { Cmd , MgmtId: -1, via: 4, V
er: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":3,"_loadInfo":"

{\n \"connections\": []\n}

","wait":0}}] }
2014-07-22 01:52:13,005 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-13:null) SeqA 4-443: Sending Seq 4-443: { Ans: , MgmtId: 29066118877352,
via: 4, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2014-07-22 01:52:14,084 DEBUG [c.c.a.t.Request] (AgentManager-Handler-2:null) Seq 2-7048133416834826487: Processing: { Ans: , MgmtId: 29066118877352, v
ia: 2, Ver: v1, Flags: 100, [{"com.cloud.agent.api.Answer":{"result":false,"details":" inet 10.223.122.73/26 brd 10.223.122.127 scope global eth1ipta
bles: No chain/target/match by that name.iptables: No chain/target/match by that name.iptables: No chain/target/match by that name.iptables: No chain/ta
rget/match by that name.021 no connection named \"vpn-10.223.122.72\"000 terminating all conns with alias='vpn-10.223.122.72' 021 no connection named \"
vpn-10.223.122.72\"021 no connection named \"vpn-10.223.122.72\"003 no secrets filename matched \"/etc/ipsec.d/ipsec.*.secrets\"iptables: Bad rule (does
a matching rule exist in that chain?).iptables: Bad rule (does a matching rule exist in that chain?).iptables: Bad rule (does a matching rule exist in
that chain?).iptables: Bad rule (does a matching rule exist in that chain?).034 esp string error: Non alphanum or valid separator found in auth string,
just after \"3des-md5\" (old_state=ST_AA)000 initiating all conns with alias='vpn-10.223.122.72' 021 no connection named \"vpn-10.223.122.72\"ISAKMP SA
NOT found but checking IPsec;IPsec SA not found;Site-to-site VPN have not connectedISAKMP SA NOT found but checking IPsec;IPsec SA not found;Site-to-sit
e VPN have not connectedISAKMP SA NOT found but checking IPsec;IPsec SA not found;Site-to-site VPN have not connectedISAKMP SA NOT found but checking IP
sec;IPsec SA not found;Site-to-site VPN have not connectedISAKMP SA NOT found but checking IPsec;IPsec SA not found;Site-to-site VPN have not connected0
21 no connection named \"vpn-10.223.122.72\"000 terminating all conns with alias='vpn-10.223.122.72' 021 no connection named \"vpn-10.223.122.72\"021 no
connection named \"vpn-10.223.122.72\"003 no secrets filename matched \"/etc/ipsec.d/ipsec.*.secrets\"","wait":0}}] }
2014-07-22 01:52:14,084 DEBUG [c.c.a.m.AgentAttache] (AgentManager-Handler-2:null) Seq 2-7048133416834826490: Sending now. is current sequence.
2014-07-22 01:52:14,085 DEBUG [c.c.a.t.Request] (API-Job-Executor-94:ctx-df3bae7d job-186 ctx-c6b7a16b) Seq 2-7048133416834826487: Received: { Ans: , MgmtId: 29066118877352, via: 2, Ver: v1, Flags: 100,

{ Answer }

}

2014-07-22 01:52:14,108 WARN [o.a.c.a.c.u.v.CreateVpnConnectionCmd] (API-Job-Executor-94:ctx-df3bae7d job-186 ctx-c6b7a16b) Exception:
com.cloud.exception.ResourceUnavailableException: Resource [Site2SiteVpnConnection:2] is unreachable: Failed to apply site-to-site VPN
at com.cloud.network.vpn.Site2SiteVpnManagerImpl.startVpnConnection(Site2SiteVpnManagerImpl.java:345)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
at org.apache.cloudstack.network.contrail.management.EventUtils$EventInterceptor.invoke(EventUtils.java:106)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
at com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:51)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
at com.sun.proxy.$Proxy159.startVpnConnection(Unknown Source)
at org.apache.cloudstack.api.command.user.vpn.CreateVpnConnectionCmd.execute(CreateVpnConnectionCmd.java:149)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:141)
at com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:108)
at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:507)
at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:464)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:744)
2014-07-22 01:52:14,111 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-94:ctx-df3bae7d job-186) Complete async job-186, jobStatus: FAILED, resultCode: 530, result: org.apache.cloudstack.api.response.ExceptionResponse/null/

{"uuidList":[],"errorcode":534,"errortext":"Resource [Site2SiteVpnConnection:2] is unreachable: Failed to apply site-to-site VPN"}

2014-07-22 01:52:14,129 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-94:ctx-df3bae7d job-186) Done executing org.apache.cloudstack.api.command.user.vpn.CreateVpnConnectionCmd for job-186
.