Uploaded image for project: 'Stratos'
  1. Stratos
  2. STRATOS-1229

Instance termination failed with NPE from jclouds

    Details

    • Type: Task
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 4.1.0 Alpha
    • Fix Version/s: FUTURE
    • Component/s: Cloud Controller
    • Labels:
      None

      Description

      TID: [0] [STRATOS] [2015-03-05 09:21:00,771] INFO

      {org.apache.stratos.autoscaler.context.partition.ClusterLevelPartitionContext$PendingMemberWatcher}

      - Pending state of member expired, member will be moved to obsolete list. [pending member] my-php.php.domain65a77b67-8687-4db3-ae44-0e59965f5658 [expiry time] 900000 [cluster] my-php.php.domain [cluster instance] single-cartridge-app-1
      TID: [0] [STRATOS] [2015-03-05 09:21:34,639] DEBUG

      {org.apache.stratos.autoscaler.monitor.component.ApplicationMonitor}

      - Application monitor is running for [application] single-cartridge-app
      TID: [0] [STRATOS] [2015-03-05 09:22:15,774] DEBUG

      {org.apache.stratos.autoscaler.monitor.cluster.ClusterMonitor} - Cluster monitor is running.. ClusterMonitor [clusterId=my-php.php.domain, hasPrimary=false ]
      TID: [0] [STRATOS] [2015-03-05 09:22:15,775] DEBUG {org.apache.stratos.autoscaler.monitor.cluster.ClusterMonitor}

      - Cluster monitor is running: [application-id] single-cartridge-app [cluster-id]: my-php.php.domain
      TID: [0] [STRATOS] [2015-03-05 09:22:15,782] DEBUG

      {org.apache.stratos.autoscaler.rule.RuleLog} - Running obsolete instances rule: [partition] partition-1 [network-partition] network-partition-1 [cluster] my-php.php.domain
      TID: [0] [STRATOS] [2015-03-05 09:22:15,782] DEBUG {org.apache.stratos.autoscaler.monitor.cluster.ClusterMonitor} - Running minimum check for cluster instance single-cartridge-app-1 for the cluster: my-php.php.domain
      TID: [0] [STRATOS] [2015-03-05 09:22:15,782] DEBUG {org.apache.stratos.autoscaler.rule.RuleLog}

      - [obsolete-check] [network-partition] network-partition-1 [partition] partition-1 [cluster] my-php.php.domain Obsolete member count: 1
      TID: [0] [STRATOS] [2015-03-05 09:22:15,783] DEBUG

      {org.apache.stratos.autoscaler.rule.RuleLog} - Running minimum rule: [network-partition] network-partition-1 [cluster-instance] single-cartridge-app-1
      TID: [0] [STRATOS] [2015-03-05 09:22:15,783] DEBUG {org.apache.stratos.autoscaler.rule.RuleLog}

      - [min-check] [network-partition] network-partition-1 [cluster-instance] single-cartridge-app-1 [cluster] my-php.php.domain Non terminated member count: 0
      TID: [0] [STRATOS] [2015-03-05 09:22:15,783] DEBUG

      {org.apache.stratos.autoscaler.rule.RuleLog} - [min-check] [network-partition] network-partition-1 [cluster-instance] single-cartridge-app-1 [cluster] my-php.php.domain Minimum member count: 1
      TID: [0] [STRATOS] [2015-03-05 09:22:15,784] DEBUG {org.apache.stratos.autoscaler.rule.RuleLog}

      - [min-check] true [primary] false [non terminated member count] 0 [cluster] my-php.php.domain
      TID: [0] [STRATOS] [2015-03-05 09:22:15,784] DEBUG

      {org.apache.stratos.autoscaler.rule.RuleLog} - [obsolete-check] [network-partition] network-partition-1 [partition] partition-1 [cluster] my-php.php.domain Member id: my-php.php.domain65a77b67-8687-4db3-ae44-0e59965f5658
      TID: [0] [STRATOS] [2015-03-05 09:22:15,784] INFO {org.apache.stratos.autoscaler.rule.RuleLog}

      - [min-check] Partition available, hence trying to spawn an instance to fulfil minimum count! [cluster] my-php.php.domain
      TID: [0] [STRATOS] [2015-03-05 09:22:15,784] DEBUG

      {org.apache.stratos.autoscaler.rule.RuleLog} - Running instances cleanup event sender rule: [partition] partition-1 [network-partition] network-partition-1
      TID: [0] [STRATOS] [2015-03-05 09:22:15,784] DEBUG {org.apache.stratos.autoscaler.rule.RuleLog}

      - [min-check] [partition] partition-1 [cluster] my-php.php.domain
      TID: [0] [STRATOS] [2015-03-05 09:22:15,784] DEBUG

      {org.apache.stratos.autoscaler.rule.RuleLog}

      - [instance-cleanup-check] [network-partition] network-partition-1 [partition] partition-1 [cluster] my-php.php.domain Pending termination member count: 0
      TID: [0] [STRATOS] [2015-03-05 09:22:15,784] INFO

      {org.apache.stratos.autoscaler.client.CloudControllerClient}

      - Trying to spawn an instance via cloud controller: [cluster] my-php.php.domain [partition] partition-1 [network-partition-id] network-partition-1
      TID: [0] [STRATOS] [2015-03-05 09:22:15,785] INFO

      {org.apache.stratos.common.client.CloudControllerServiceClient}

      - Terminating instance via cloud controller: [member] my-php.php.domain65a77b67-8687-4db3-ae44-0e59965f5658
      TID: [0] [STRATOS] [2015-03-05 09:22:15,837] INFO

      {org.apache.stratos.cloud.controller.iaases.JcloudsIaas}

      - Starting to terminate member: [cartridge-type] php [member-id] my-php.php.domain65a77b67-8687-4db3-ae44-0e59965f5658
      TID: [0] [STRATOS] [2015-03-05 09:22:15,861] INFO

      {org.apache.stratos.cloud.controller.messaging.publisher.TopologyEventPublisher}

      - Publishing member created event: [service-name] php [cluster-id] my-php.php.domain [cluster-instance-id] single-cartridge-app-1 [member-id] my-php.php.domainb8a76dfb-115a-45b5-85e0-ded4640a2538 [instance-id] null [network-partition-id] network-partition-1 [partition-id] partition-1 [lb-cluster-id] null
      TID: [0] [STRATOS] [2015-03-05 09:22:15,866] INFO

      {org.apache.stratos.messaging.message.processor.topology.MemberCreatedMessageProcessor}

      - Member created: [service-name] php [cluster-id] my-php.php.domain [member-id] my-php.php.domainb8a76dfb-115a-45b5-85e0-ded4640a2538 [cluster-instance-id] single-cartridge-app-1
      TID: [0] [STRATOS] [2015-03-05 09:22:15,883] DEBUG

      {org.apache.stratos.autoscaler.monitor.cluster.ClusterMonitor} - Execution point of scaling Rule, [Is rif Reset] : false [Is memoryConsumption Reset] : false [Is loadAverage Reset] : false
      TID: [0] [STRATOS] [2015-03-05 09:22:15,883] DEBUG {org.apache.stratos.autoscaler.monitor.cluster.ClusterMonitor}

      - Scale rule will not run since the LB statistics have not received before this cycle for [cluster instance context] single-cartridge-app-1 [cluster] my-php.php.domain
      TID: [0] [STRATOS] [2015-03-05 09:22:24,956] ERROR

      {org.apache.stratos.cloud.controller.services.impl.InstanceTerminator}

      - Instance termination failed! MemberContext [applicationId=single-cartridge-app, cartridgeType=php, clusterId=my-php.php.domain, memberId=my-php.php.domain65a77b67-8687-4db3-ae44-0e59965f5658, instanceId=RegionOne/1fb4fd57-2acf-461f-a6e8-dee422f8b944, partition=Partition [id=partition-1, description=null, isPublic=false, provider=openstack, properties=Properties [properties=[Property [name=region, value=RegionOne]]]], defaultPrivateIP=10.0.0.200, defaultPublicIP=192.168.17.5, allocatedIPs=[192.168.17.5], publicIPs=[192.168.17.5], privateIPs=[10.0.0.200], initTime=1425546345791, lbClusterId=null, networkPartitionId=network-partition-1, kubernetesPodId=null, kubernetesPodLabel=null, instanceMetadata=org.apache.stratos.cloud.controller.domain.InstanceMetadata@1a77b31, properties=Properties [properties=[Property [name=PRIMARY, value=false], Property [name=MIN_COUNT, value=1]]]]
      java.lang.NullPointerException: arg[0] in {invocation=org.jclouds.openstack.nova.v2_0.NovaApi.public abstract com.google.common.base.Optional org.jclouds.openstack.nova.v2_0.NovaApi.getFloatingIPExtensionForZone(java.lang.String)[null], result={annotationParser=

      {caller=NovaApi.getFloatingIPExtensionForZone[null]}

      }}
      at com.google.common.base.Preconditions.checkNotNull(Preconditions.java:253)
      at org.jclouds.openstack.v2_0.functions.PresentWhenExtensionAnnotationNamespaceEqualsAnyNamespaceInExtensionsSet.apply(PresentWhenExtensionAnnotationNamespaceEqualsAnyNamespaceInExtensionsSet.java:67)
      at org.jclouds.openstack.v2_0.functions.PresentWhenExtensionAnnotationNamespaceEqualsAnyNamespaceInExtensionsSet.apply(PresentWhenExtensionAnnotationNamespaceEqualsAnyNamespaceInExtensionsSet.java:43)
      at org.jclouds.rest.internal.DelegatesToInvocationFunction.propagateContextToDelegate(DelegatesToInvocationFunction.java:205)
      at org.jclouds.rest.internal.DelegatesToInvocationFunction.handle(DelegatesToInvocationFunction.java:154)
      at org.jclouds.rest.internal.DelegatesToInvocationFunction.invoke(DelegatesToInvocationFunction.java:123)
      at com.sun.proxy.$Proxy119.getFloatingIPExtensionForZone(Unknown Source)
      at org.apache.stratos.cloud.controller.iaases.openstack.networking.NovaNetworkingApi.releaseAddress(NovaNetworkingApi.java:239)
      at org.apache.stratos.cloud.controller.iaases.openstack.OpenstackIaas.releaseAddress(OpenstackIaas.java:239)
      at org.apache.stratos.cloud.controller.iaases.JcloudsIaas.destroyNode(JcloudsIaas.java:334)
      at org.apache.stratos.cloud.controller.iaases.JcloudsIaas.terminateInstance(JcloudsIaas.java:314)
      at org.apache.stratos.cloud.controller.services.impl.InstanceTerminator.run(InstanceTerminator.java:56)
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      at java.lang.Thread.run(Thread.java:745)

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              lahirugamage Lahiru Sandaruwan
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated: