[YARN-10714] Remove dangling dynamic queues on reinitialization

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Fix Version/s: 3.4.0
• Component/s: capacity scheduler
• Target Version/s: 3.4.0
• Hadoop Flags: Reviewed
• Assignee: Andras Gyori
• Reporter: Andras Gyori
• Created: 24/Mar/21 17:32
• Updated: 12/Feb/24 05:55
• Resolved: 07/Apr/21 09:53

Description

Current logic does not handle orphaned auto created child queues. The following example steps show a scenario in which it is possible to submit applications to an orphaned queue, that has an invalid (already removed) ParentQueue.

1. Auto create a queue root.a.a-auto
2. Remove root.a from the config
3. Reinitialize CS without restarting it (possible via mutation API)
4. Submit application to root.a.a-auto, while root.a is a non-existent queue