Uploaded image for project: 'Stratos'
  1. Stratos
  2. STRATOS-919

Error while AS asks CC to terminate an instance that are not in the topology

    Details

      Description

      The following scenario will ended up with termination failed error continuously.

      AS asks CC to create a container
      CC schedule a new task and returning member contexts to AS
      AS adding the members to pending list
      CC is also adding member contexts to its data holder
      But CC will not add it to the topology until pods status become to "Running" state
      Meanwhile members are exceeding their timeouts and moved to obsolete list
      AS asks CC to terminate obsolete pods
      CC kills it, but didn't send the member terminated event, because member is not in the topology
      AS didn't get any member terminated event, so it will not remove any members from its member lists
      AS will ask CC again to terminate the pod, in next monitor interval
      CC now will complain "Failed to terminate member. Member id not found", because it terminated those pods already and removed the member contexts from its data holder
      So this "Failed to terminate member. Member id not found" will occur continuously

        Activity

        Hide
        raj@apache.org Rajkumar Rajaratnam added a comment -

        This is resolved by adding the member context to CC data holder as soon as CC gets an instance start up call from AS.

        Show
        raj@apache.org Rajkumar Rajaratnam added a comment - This is resolved by adding the member context to CC data holder as soon as CC gets an instance start up call from AS.

          People

          • Assignee:
            Unassigned
            Reporter:
            raj@apache.org Rajkumar Rajaratnam
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development