Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-10254

CapacityScheduler incorrect User Group Mapping after leaf queue change

VotersStop watchingWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.4.0, 3.3.1
    • 3.4.0, 3.3.1
    • capacity scheduler
    • None
    • Reviewed

    Description

      YARN-9879 and YARN-10198 introduced some major changes to user group mapping, and some of them unfortunately had some negative impact on the way mapping works.

      In some cases incorrect PlacementContexts were created, where full queue path was passed as leaf queue name. This affects how the yarn cli app list displays the queues.

      u:%user:%primary_group.%user mapping fails with an incorrect validation error when the %primary_group parent queue was a managed parent.

      Group based rules in certain cases are mapped to root.[primary_group] rules, loosing the ability to create deeper structures.

       

      Attachments

        1. YARN-10254.001.patch
          9 kB
          Gergely Pollák
        2. YARN-10254.002.patch
          24 kB
          Gergely Pollák
        3. YARN-10254.003.patch
          24 kB
          Gergely Pollák
        4. YARN-10254.004.patch
          29 kB
          Gergely Pollák
        5. YARN-10254.005.patch
          30 kB
          Gergely Pollák
        6. YARN-10254.branch-3.3.001.patch
          30 kB
          Gergely Pollák

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            shuzirra Gergely Pollák
            shuzirra Gergely Pollák
            Votes:
            0 Vote for this issue
            Watchers:
            4 Stop watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment