[CLOUDSTACK-7540] S2SVpnConnections:CheckRouterTask is fails with NullPointer exception

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.2.0
• Fix Version/s: 4.5.0
• Component/s: Network Controller
• Security Level: Public (Anyone can view this level - this is the default.)
• Assignee: Jayapal
• Reporter: Jayapal
• Created: 12/Sep/14 11:32
• Updated: 15/Sep/14 10:25
• Resolved: 15/Sep/14 10:25

Description

CheckRouterTask is failing with NullPointer exception and log is filling with with this messages continuously

1. Create two VPCs
2. Create VPN customer gateway
3. Create VPN connection

When router is checking for vpn status getting NPE.
MS log:
Content of management log:
[c.c.a.t.Request] (StatsCollector-2:ctx-30b6f162) Seq 1-2611524833921479961: Received:

{ Ans: , MgmtId: 7175246184473, via: 1, Ver: v1, Flags: 10, { GetStorageStatsAnswer }

}
2014-07-01 15:10:31,002 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-287:ctx-67faca60) Seq 5-6290684254506525415: Executing request
2014-07-01 15:10:31,299 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-287:ctx-67faca60) Seq 5-6290684254506525415: Response Received:
2014-07-01 15:10:31,300 DEBUG [c.c.a.t.Request] (StatsCollector-2:ctx-30b6f162) Seq 5-6290684254506525415: Received: { Ans: , MgmtId: 7175246184473, via: 5, Ver: v1, Flags: 10,

{ GetStorageStatsAnswer }

}
2014-07-01 15:10:49,681 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-b706b798) Found 9 routers to update status.
2014-07-01 15:10:49,692 DEBUG [c.c.a.t.Request] (RouterStatusMonitor-1:ctx-b706b798) Seq 5-6290684254506525416: Sending { Cmd , MgmtId: 7175246184473, via: 5(Rack1Pod1Host9), Ver: v1, Flags: 100111, [{"com.cloud.agent.api.CheckS2SVpnConnectionsCommand":

{"vpnIps":["10.147.49.120"],"accessDetails": {"router.name":"r-238-VM","router.ip":"169.254.3.241"}

,"wait":30}}] }
2014-07-01 15:10:49,693 DEBUG [c.c.a.t.Request] (RouterStatusMonitor-1:ctx-b706b798) Seq 5-6290684254506525416: Executing: { Cmd , MgmtId: 7175246184473, via: 5(Rack1Pod1Host9), Ver: v1, Flags: 100111, [{"com.cloud.agent.api.CheckS2SVpnConnectionsCommand":

{"vpnIps":["10.147.49.120"],"accessDetails": {"router.name":"r-238-VM","router.ip":"169.254.3.241"}

,"wait":30}}] }
2014-07-01 15:10:49,693 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-288:ctx-328fc667) Seq 5-6290684254506525416: Executing request
2014-07-01 15:10:49,693 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent-288:ctx-328fc667) Executing command in VR: /opt/cloud/bin/router_proxy.sh checkbatchs2svpn.sh 169.254.3.241 10.147.49.120
2014-07-01 15:10:50,080 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-288:ctx-328fc667) Seq 5-6290684254506525416: Response Received:
2014-07-01 15:10:50,081 DEBUG [c.c.a.t.Request] (DirectAgent-288:ctx-328fc667) Seq 5-6290684254506525416: Processing: { Ans: , MgmtId: 7175246184473, via: 5, Ver: v1, Flags: 110, [{"com.cloud.agent.api.CheckS2SVpnConnectionsAnswer":{"ipToConnected":{},"ipToDetail":{},"details":"whack: Pluto is not running (no \"/var/run/pluto/pluto.ctl\")\n10.147.49.120:11:ISAKMP SA NOT found but checking IPsec;IPsec SA not found;Site-to-site VPN have not connected&","result":true,"wait":0}}] }
2014-07-01 15:10:50,081 DEBUG [c.c.a.t.Request] (RouterStatusMonitor-1:ctx-b706b798) Seq 5-6290684254506525416: Received:

{ Ans: , MgmtId: 7175246184473, via: 5, Ver: v1, Flags: 110, { CheckS2SVpnConnectionsAnswer }

}
2014-07-01 15:10:50,081 DEBUG [c.c.a.m.AgentManagerImpl] (RouterStatusMonitor-1:ctx-b706b798) Details from executing class com.cloud.agent.api.CheckS2SVpnConnectionsCommand: whack: Pluto is not running (no "/var/run/pluto/pluto.ctl")
10.147.49.120:11:ISAKMP SA NOT found but checking IPsec;IPsec SA not found;Site-to-site VPN have not connected&
2014-07-01 15:10:50,084 DEBUG [c.c.a.m.AgentAttache] (DirectAgent-288:ctx-328fc667) Seq 5-6290684254506525416: No more commands found
2014-07-01 15:10:50,091 ERROR [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-b706b798) Fail to complete the CheckRouterTask!
java.lang.NullPointerException
at com.cloud.agent.api.CheckS2SVpnConnectionsAnswer.isConnected(CheckS2SVpnConnectionsAnswer.java:60)
at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.updateSite2SiteVpnConnectionState(VirtualNetworkApplianceManagerImpl.java:1124)
at com.cloud.network.router.VirtualNetworkApplianceManagerImpl$CheckRouterTask.runInContext(VirtualNetworkApplianceManagerImpl.java:1368)
at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:744)
2014-07-01 15:10:51,735 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-2d2cd056) Zone 2 is ready to launch console proxy
2014-07-01 15:10:52,021 DEBUG [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-b288c827) Zone 2 is ready to launch secondary storage VM