[YARN-5333] Some recovered apps are put into default queue when RM HA

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.9.0, 2.7.4, 3.0.0-alpha1, 2.8.2
• Target Version/s: 2.7.4
• Hadoop Flags: Reviewed
• Assignee: Jun Gong
• Reporter: Jun Gong
• Created: 07/Jul/16 12:50
• Updated: 05/Jun/17 22:42
• Resolved: 05/Aug/16 16:18

Description

Enable RM HA and use FairScheduler, yarn.scheduler.fair.allow-undeclared-pools is set to false, yarn.scheduler.fair.user-as-default-queue is set to false.

Reproduce steps:
1. Start two RMs.
2. After RMs are running, change both RM's file etc/hadoop/fair-scheduler.xml, then add some queues.
3. Submit some apps to the new added queues.
4. Stop the active RM, then the standby RM will transit to active and recover apps.
However the new active RM will put recovered apps into default queue because it might have not loaded the new fair-scheduler.xml. We need call initScheduler before start active services or bring refreshAll() in front of rm.transitionToActive(). It seems it is also important for other scheduler.

Issue Links

• is related to: YARN-6663 Backport YARN-5333 to branch-2.8, branch-2.7
• relates to: YARN-5988 RM unable to start in secure setup
• relates to: YARN-4927 TestRMHA#testTransitionedToActiveRefreshFail fails with FairScheduler