[YARN-9013] [GPG] fix order of steps cleaning Registry entries in ApplicationCleaner

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Resolved
• Labels: pull-request-available
• Assignee: Botong Huang
• Reporter: Botong Huang
• Created: 12/Nov/18 18:30
• Updated: 30/Oct/23 22:56
• Resolved: 06/Dec/18 16:21

Description

ApplicationCleaner today deletes the entry for all finished (non-running) application in YarnRegistry using this logic:

1. GPG gets the list of running applications from Router.
2. GPG gets the full list of applications in registry
3. GPG deletes in registry every app in 2 that’s not in 1

The problem is that jobs that started between 1 and 2 meets the criteria in 3, and thus get deleted by mistake. The fix/right order should be 2->1->3, rather than 1->2->3.

Issue Links

• is caused by: YARN-8862 [GPG] Add Yarn Registry cleanup in ApplicationCleaner
• links to: GitHub Pull Request #6147