[YUNIKORN-1670] Application recovery can fail if app is rejected

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.3.0
• Component/s: shim - kubernetes
• Labels: pull-request-available
• Target Version: 1.3.0
• Assignee: Craig Condit
• Reporter: Craig Condit
• Created: 31/Mar/23 17:28
• Updated: 20/Jun/23 14:41
• Resolved: 03/Apr/23 12:05

Description

During application recovery, the current code waits up to 30 seconds for all applications to transition to "Accepted". However, if an application is rejected, or if the cluster is large enough, recovery will not succeed.

Similar to how informer sync was recently updated, we should modify the logic to keep trying, but log periodically. Additionally, we should not look specifically for Accepted state, but for state != New and != Recovering. This ensures that we have processed all the applicaitons.

Issue Links

• links to: GitHub Pull Request #565