[YUNIKORN-478] Handle app completion at the shim side

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.10
• Component/s: shim - kubernetes
• Labels: pull-request-available
• Assignee: TingYao Huang
• Reporter: Weiwei Yang
• Created: 04/Dec/20 05:29
• Updated: 05/Sep/23 16:34
• Resolved: 23/Dec/20 23:29

Description

We need a generic approach to tell if an app gets canceled or finished.
Add the following annotations:

• yunikorn.apache.org/appCompletionBarrierCount: 1
• yunikorn.apache.org/appCompletionBarrier: true

The criteria to tell if an app is completed is: the given count of pods with yunikorn.apache.org/appCompletionBarrier=true has terminated. When the app is completed, we need to do

1. shim side, we need to delete all the placeholders
2. shim needs to send UpdateRequest#RemoveApplications in order to notify the scheduler

Issue Links

• breaks: YUNIKORN-494 Rename the AllocationRelease Request and Response in core
• links to: GitHub Pull Request #213