[YUNIKORN-1468] Remove completed apps from queue object

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 1.2.0
• Component/s: core - scheduler
• Labels: pull-request-available
• Target Version: 1.2.0
• Assignee: Brandon Grams
• Reporter: Wilfred Spiegelenburg
• Created: 12/Dec/22 03:09
• Updated: 07/Feb/23 22:33
• Resolved: 13/Dec/22 16:50

Description

Completed applications remain linked to a queue and never cleaned up. This is a similar problem as we have seen in YUNIKORN-1440.

The problem is however larger than just keeping it linked and not cleaning up:

• the completedApplications map in the queue is not safe for appID reuse as the map key is the application ID without suffix.
• a dynamic queue is removed when empty: a newly created queue with the same path does not have any history which is incorrect
• the completedApplications map in the queue is never cleaned up

Issue Links

• links to: GitHub Pull Request #474