[YARN-11387] [GPG] YARN GPG mistakenly deleted applicationid

• Type: Sub-task
• Status: In Progress
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.2.1, 3.4.0
• Component/s: federation
• Labels: federation gpg pull-request-available
• Flags: Patch

Language

JAVA

• Assignee: Shilun Fan
• Reporter: zhangjunj
• Created: 04/Dec/22 14:50
• Updated: 10/Nov/24 16:17

Description

In YARN-7599, the Federation can delete expired applicationid, but  YARN GPG uses getRouter() method to obtain application information for multiple clusters. If there are too many applicationids that more than 200,000 , it will not be possible to pull all the applicationid information at one time, resulting in the possibility of accidental deletion. The following error is reported for spark component.

 

Issue Links

• links to: GitHub Pull Request #6473
• links to: GitHub Pull Request #6660