Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-5333

Some recovered apps are put into default queue when RM HA

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.9.0, 2.7.4, 3.0.0-alpha1, 2.8.2
    • Component/s: None
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      Enable RM HA and use FairScheduler, yarn.scheduler.fair.allow-undeclared-pools is set to false, yarn.scheduler.fair.user-as-default-queue is set to false.

      Reproduce steps:
      1. Start two RMs.
      2. After RMs are running, change both RM's file etc/hadoop/fair-scheduler.xml, then add some queues.
      3. Submit some apps to the new added queues.
      4. Stop the active RM, then the standby RM will transit to active and recover apps.
      However the new active RM will put recovered apps into default queue because it might have not loaded the new fair-scheduler.xml. We need call initScheduler before start active services or bring refreshAll() in front of rm.transitionToActive(). It seems it is also important for other scheduler.

        Attachments

        1. YARN-5333.01.patch
          1 kB
          Jun Gong
        2. YARN-5333.02.patch
          7 kB
          Jun Gong
        3. YARN-5333.03.patch
          9 kB
          Jun Gong
        4. YARN-5333.04.patch
          11 kB
          Jun Gong
        5. YARN-5333.05.patch
          11 kB
          Jun Gong
        6. YARN-5333.06.patch
          17 kB
          Jun Gong
        7. YARN-5333.07.patch
          18 kB
          Jun Gong
        8. YARN-5333.08.patch
          18 kB
          Jun Gong
        9. YARN-5333.09.patch
          16 kB
          Jun Gong
        10. YARN-5333.10.patch
          15 kB
          Jun Gong

          Issue Links

            Activity

              People

              • Assignee:
                hex108 Jun Gong
                Reporter:
                hex108 Jun Gong
              • Votes:
                0 Vote for this issue
                Watchers:
                15 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: