Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-10254

CapacityScheduler incorrect User Group Mapping after leaf queue change

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.4.0, 3.3.1
    • 3.4.0, 3.3.1
    • capacity scheduler
    • None
    • Reviewed

    Description

      YARN-9879 and YARN-10198 introduced some major changes to user group mapping, and some of them unfortunately had some negative impact on the way mapping works.

      In some cases incorrect PlacementContexts were created, where full queue path was passed as leaf queue name. This affects how the yarn cli app list displays the queues.

      u:%user:%primary_group.%user mapping fails with an incorrect validation error when the %primary_group parent queue was a managed parent.

      Group based rules in certain cases are mapped to root.[primary_group] rules, loosing the ability to create deeper structures.

       

      Attachments

        1. YARN-10254.001.patch
          9 kB
          Gergely Pollák
        2. YARN-10254.002.patch
          24 kB
          Gergely Pollák
        3. YARN-10254.003.patch
          24 kB
          Gergely Pollák
        4. YARN-10254.004.patch
          29 kB
          Gergely Pollák
        5. YARN-10254.005.patch
          30 kB
          Gergely Pollák
        6. YARN-10254.branch-3.3.001.patch
          30 kB
          Gergely Pollák

        Issue Links

          Activity

            People

              shuzirra Gergely Pollák
              shuzirra Gergely Pollák
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: