Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-9017

PlacementRule order is not maintained in CS

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.4.0
    • 3.4.0, 3.3.1
    • capacity scheduler
    • None
    • Reviewed

    Description

      yarn.scheduler.queue-placement-rules doesn't work as expected in Capacity Scheduler

      • *Queue Mapping Interface based on Default or User Defined Placement Rules* - This feature allows users to map a job to a specific queue based on some default placement rule. For instance based on user & group, or application name. User can also define their own placement rule.

      As per current UserGroupMapping is always added in placementRule. CapacityScheduler#updatePlacementRules

          // Initialize placement rules
          Collection<String> placementRuleStrs = conf.getStringCollection(
              YarnConfiguration.QUEUE_PLACEMENT_RULES);
          List<PlacementRule> placementRules = new ArrayList<>();
      ...
      
          // add UserGroupMappingPlacementRule if absent
          distingushRuleSet.add(YarnConfiguration.USER_GROUP_PLACEMENT_RULE);
      

      PlacementRule configuration order is not maintained

      Attachments

        1. YARN-9017.003.patch
          7 kB
          Bilwa S T
        2. YARN-9017.002.patch
          7 kB
          Bilwa S T
        3. YARN-9017.001.patch
          6 kB
          Bilwa S T

        Activity

          People

            BilwaST Bilwa S T
            bibinchundatt Bibin Chundatt
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: