Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.9.0, 3.0.0-beta1
    • Component/s: None
    • Labels:
      None

      Description

      YARN-3635 introduces PlacementRules for placing applications in queues. It is currently hardcoded to one rule, UserGroupMappingPlacementRule. This should be configurable as mentioned in the comments:

        private void updatePlacementRules() throws IOException {
          List<PlacementRule> placementRules = new ArrayList<>();
      
          // Initialize UserGroupMappingPlacementRule
          // TODO, need make this defineable by configuration.
          UserGroupMappingPlacementRule ugRule = getUserGroupMappingPlacementRule();
          if (null != ugRule) {
            placementRules.add(ugRule);
          }
      
          rmContext.getQueuePlacementManager().updateRules(placementRules);
        }
      1. YARN-6689.001.patch
        3 kB
        Jonathan Hung
      2. YARN-6689.002.patch
        6 kB
        Jonathan Hung
      3. YARN-6689.003.patch
        7 kB
        Jonathan Hung
      4. YARN-6689.004.patch
        7 kB
        Jonathan Hung

        Issue Links

          Activity

          Hide
          jhung Jonathan Hung added a comment -

          Thanks Xuan/Wangda for the reviews and commit!

          Show
          jhung Jonathan Hung added a comment - Thanks Xuan/Wangda for the reviews and commit!
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11996 (See https://builds.apache.org/job/Hadoop-trunk-Commit/11996/)
          YARN-6689. PlacementRule should be configurable. (Jonathan Hung via (xgong: rev 9845bea59c0009b8ffff7050403e5ba270054164)

          • (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
          • (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/yarn-default.xml
          • (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/conf/YarnConfiguration.java
          • (add) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/placement/PlacementFactory.java
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11996 (See https://builds.apache.org/job/Hadoop-trunk-Commit/11996/ ) YARN-6689 . PlacementRule should be configurable. (Jonathan Hung via (xgong: rev 9845bea59c0009b8ffff7050403e5ba270054164) (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/yarn-default.xml (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/conf/YarnConfiguration.java (add) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/placement/PlacementFactory.java
          Hide
          xgong Xuan Gong added a comment -

          Committed into trunk/branch-2. Thanks, Jonathan

          Show
          xgong Xuan Gong added a comment - Committed into trunk/branch-2. Thanks, Jonathan
          Hide
          xgong Xuan Gong added a comment -

          +1 LGTM. Checking this in

          Show
          xgong Xuan Gong added a comment - +1 LGTM. Checking this in
          Hide
          leftnoteasy Wangda Tan added a comment -

          Xuan Gong, thanks for committing the patch, however I think we should commit the patch to trunk/branch-2 instead of branch.

          Show
          leftnoteasy Wangda Tan added a comment - Xuan Gong , thanks for committing the patch, however I think we should commit the patch to trunk/branch-2 instead of branch.
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 49s Docker mode activated.
          +1 @author 0m 0s The patch does not contain any @author tags.
          -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
          0 mvndep 0m 45s Maven dependency ordering for branch
          +1 mvninstall 13m 3s trunk passed
          +1 compile 8m 39s trunk passed
          +1 checkstyle 0m 48s trunk passed
          +1 mvnsite 1m 40s trunk passed
          +1 findbugs 3m 5s trunk passed
          +1 javadoc 1m 15s trunk passed
          0 mvndep 0m 10s Maven dependency ordering for patch
          +1 mvninstall 1m 19s the patch passed
          +1 compile 5m 18s the patch passed
          +1 javac 5m 18s the patch passed
          +1 checkstyle 0m 51s the patch passed
          +1 mvnsite 1m 46s the patch passed
          +1 whitespace 0m 0s The patch has no whitespace issues.
          +1 xml 0m 1s The patch has no ill-formed XML file.
          +1 findbugs 3m 32s the patch passed
          +1 javadoc 1m 29s the patch passed
          +1 unit 0m 33s hadoop-yarn-api in the patch passed.
          +1 unit 2m 33s hadoop-yarn-common in the patch passed.
          -1 unit 44m 27s hadoop-yarn-server-resourcemanager in the patch failed.
          +1 asflicense 0m 34s The patch does not generate ASF License warnings.
          100m 56s



          Reason Tests
          Failed junit tests hadoop.yarn.server.resourcemanager.TestRMRestart
            hadoop.yarn.server.resourcemanager.metrics.TestSystemMetricsPublisher



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:14b5c93
          JIRA Issue YARN-6689
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12874795/YARN-6689.004.patch
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml
          uname Linux 4d90ed21dad0 4.4.0-43-generic #63-Ubuntu SMP Wed Oct 12 13:48:03 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision trunk / a5c0476
          Default Java 1.8.0_131
          findbugs v3.1.0-RC1
          unit https://builds.apache.org/job/PreCommit-YARN-Build/16261/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
          Test Results https://builds.apache.org/job/PreCommit-YARN-Build/16261/testReport/
          modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn
          Console output https://builds.apache.org/job/PreCommit-YARN-Build/16261/console
          Powered by Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 49s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. 0 mvndep 0m 45s Maven dependency ordering for branch +1 mvninstall 13m 3s trunk passed +1 compile 8m 39s trunk passed +1 checkstyle 0m 48s trunk passed +1 mvnsite 1m 40s trunk passed +1 findbugs 3m 5s trunk passed +1 javadoc 1m 15s trunk passed 0 mvndep 0m 10s Maven dependency ordering for patch +1 mvninstall 1m 19s the patch passed +1 compile 5m 18s the patch passed +1 javac 5m 18s the patch passed +1 checkstyle 0m 51s the patch passed +1 mvnsite 1m 46s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 xml 0m 1s The patch has no ill-formed XML file. +1 findbugs 3m 32s the patch passed +1 javadoc 1m 29s the patch passed +1 unit 0m 33s hadoop-yarn-api in the patch passed. +1 unit 2m 33s hadoop-yarn-common in the patch passed. -1 unit 44m 27s hadoop-yarn-server-resourcemanager in the patch failed. +1 asflicense 0m 34s The patch does not generate ASF License warnings. 100m 56s Reason Tests Failed junit tests hadoop.yarn.server.resourcemanager.TestRMRestart   hadoop.yarn.server.resourcemanager.metrics.TestSystemMetricsPublisher Subsystem Report/Notes Docker Image:yetus/hadoop:14b5c93 JIRA Issue YARN-6689 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12874795/YARN-6689.004.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml uname Linux 4d90ed21dad0 4.4.0-43-generic #63-Ubuntu SMP Wed Oct 12 13:48:03 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / a5c0476 Default Java 1.8.0_131 findbugs v3.1.0-RC1 unit https://builds.apache.org/job/PreCommit-YARN-Build/16261/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/16261/testReport/ modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn Console output https://builds.apache.org/job/PreCommit-YARN-Build/16261/console Powered by Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
          Hide
          jhung Jonathan Hung added a comment -

          004 fixes checkstyle again.

          Show
          jhung Jonathan Hung added a comment - 004 fixes checkstyle again.
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 21s Docker mode activated.
          +1 @author 0m 0s The patch does not contain any @author tags.
          -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
          0 mvndep 0m 47s Maven dependency ordering for branch
          +1 mvninstall 14m 20s trunk passed
          +1 compile 9m 12s trunk passed
          +1 checkstyle 0m 55s trunk passed
          +1 mvnsite 1m 51s trunk passed
          +1 findbugs 3m 21s trunk passed
          +1 javadoc 1m 30s trunk passed
          0 mvndep 0m 10s Maven dependency ordering for patch
          +1 mvninstall 1m 24s the patch passed
          +1 compile 5m 43s the patch passed
          +1 javac 5m 43s the patch passed
          -0 checkstyle 0m 53s hadoop-yarn-project/hadoop-yarn: The patch generated 1 new + 286 unchanged - 0 fixed = 287 total (was 286)
          +1 mvnsite 1m 49s the patch passed
          +1 whitespace 0m 0s The patch has no whitespace issues.
          +1 xml 0m 1s The patch has no ill-formed XML file.
          +1 findbugs 3m 48s the patch passed
          +1 javadoc 1m 26s the patch passed
          +1 unit 0m 32s hadoop-yarn-api in the patch passed.
          +1 unit 2m 26s hadoop-yarn-common in the patch passed.
          -1 unit 46m 33s hadoop-yarn-server-resourcemanager in the patch failed.
          +1 asflicense 0m 36s The patch does not generate ASF License warnings.
          105m 32s



          Reason Tests
          Failed junit tests hadoop.yarn.server.resourcemanager.TestRMRestart
            hadoop.yarn.server.resourcemanager.scheduler.fair.TestFSAppStarvation
          Timed out junit tests org.apache.hadoop.yarn.server.resourcemanager.TestSubmitApplicationWithRMHA



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:14b5c93
          JIRA Issue YARN-6689
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12874780/YARN-6689.003.patch
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml
          uname Linux 5798ab17b22d 3.13.0-116-generic #163-Ubuntu SMP Fri Mar 31 14:13:22 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision trunk / 686a634
          Default Java 1.8.0_131
          findbugs v3.1.0-RC1
          checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/16260/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/16260/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
          Test Results https://builds.apache.org/job/PreCommit-YARN-Build/16260/testReport/
          modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn
          Console output https://builds.apache.org/job/PreCommit-YARN-Build/16260/console
          Powered by Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 21s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. 0 mvndep 0m 47s Maven dependency ordering for branch +1 mvninstall 14m 20s trunk passed +1 compile 9m 12s trunk passed +1 checkstyle 0m 55s trunk passed +1 mvnsite 1m 51s trunk passed +1 findbugs 3m 21s trunk passed +1 javadoc 1m 30s trunk passed 0 mvndep 0m 10s Maven dependency ordering for patch +1 mvninstall 1m 24s the patch passed +1 compile 5m 43s the patch passed +1 javac 5m 43s the patch passed -0 checkstyle 0m 53s hadoop-yarn-project/hadoop-yarn: The patch generated 1 new + 286 unchanged - 0 fixed = 287 total (was 286) +1 mvnsite 1m 49s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 xml 0m 1s The patch has no ill-formed XML file. +1 findbugs 3m 48s the patch passed +1 javadoc 1m 26s the patch passed +1 unit 0m 32s hadoop-yarn-api in the patch passed. +1 unit 2m 26s hadoop-yarn-common in the patch passed. -1 unit 46m 33s hadoop-yarn-server-resourcemanager in the patch failed. +1 asflicense 0m 36s The patch does not generate ASF License warnings. 105m 32s Reason Tests Failed junit tests hadoop.yarn.server.resourcemanager.TestRMRestart   hadoop.yarn.server.resourcemanager.scheduler.fair.TestFSAppStarvation Timed out junit tests org.apache.hadoop.yarn.server.resourcemanager.TestSubmitApplicationWithRMHA Subsystem Report/Notes Docker Image:yetus/hadoop:14b5c93 JIRA Issue YARN-6689 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12874780/YARN-6689.003.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml uname Linux 5798ab17b22d 3.13.0-116-generic #163-Ubuntu SMP Fri Mar 31 14:13:22 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 686a634 Default Java 1.8.0_131 findbugs v3.1.0-RC1 checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/16260/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/16260/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/16260/testReport/ modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn Console output https://builds.apache.org/job/PreCommit-YARN-Build/16260/console Powered by Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
          Hide
          jhung Jonathan Hung added a comment -

          003 patch fixes TestYarnConfigurationFields test (others seem unrelated), also fix checkstyle.

          Show
          jhung Jonathan Hung added a comment - 003 patch fixes TestYarnConfigurationFields test (others seem unrelated), also fix checkstyle.
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 12s Docker mode activated.
          +1 @author 0m 0s The patch does not contain any @author tags.
          -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
          0 mvndep 0m 37s Maven dependency ordering for branch
          +1 mvninstall 12m 39s trunk passed
          +1 compile 8m 43s trunk passed
          +1 checkstyle 0m 47s trunk passed
          +1 mvnsite 1m 11s trunk passed
          +1 findbugs 2m 3s trunk passed
          +1 javadoc 0m 48s trunk passed
          0 mvndep 0m 9s Maven dependency ordering for patch
          +1 mvninstall 0m 56s the patch passed
          +1 compile 5m 42s the patch passed
          +1 javac 5m 42s the patch passed
          -0 checkstyle 0m 48s hadoop-yarn-project/hadoop-yarn: The patch generated 16 new + 286 unchanged - 0 fixed = 302 total (was 286)
          +1 mvnsite 1m 5s the patch passed
          +1 whitespace 0m 0s The patch has no whitespace issues.
          +1 findbugs 2m 18s the patch passed
          +1 javadoc 0m 45s the patch passed
          -1 unit 0m 29s hadoop-yarn-api in the patch failed.
          -1 unit 42m 5s hadoop-yarn-server-resourcemanager in the patch failed.
          +1 asflicense 0m 24s The patch does not generate ASF License warnings.
          89m 3s



          Reason Tests
          Failed junit tests hadoop.yarn.conf.TestYarnConfigurationFields
            hadoop.yarn.server.resourcemanager.TestRMRestart
            hadoop.yarn.server.resourcemanager.scheduler.fair.TestFSAppStarvation
          Timed out junit tests org.apache.hadoop.yarn.server.resourcemanager.TestRMStoreCommands



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:14b5c93
          JIRA Issue YARN-6689
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12874765/YARN-6689.002.patch
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
          uname Linux 889aff0cd2bc 4.4.0-43-generic #63-Ubuntu SMP Wed Oct 12 13:48:03 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision trunk / 63ce159
          Default Java 1.8.0_131
          findbugs v3.1.0-RC1
          checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/16258/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/16258/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-api.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/16258/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
          Test Results https://builds.apache.org/job/PreCommit-YARN-Build/16258/testReport/
          modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn
          Console output https://builds.apache.org/job/PreCommit-YARN-Build/16258/console
          Powered by Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 12s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. 0 mvndep 0m 37s Maven dependency ordering for branch +1 mvninstall 12m 39s trunk passed +1 compile 8m 43s trunk passed +1 checkstyle 0m 47s trunk passed +1 mvnsite 1m 11s trunk passed +1 findbugs 2m 3s trunk passed +1 javadoc 0m 48s trunk passed 0 mvndep 0m 9s Maven dependency ordering for patch +1 mvninstall 0m 56s the patch passed +1 compile 5m 42s the patch passed +1 javac 5m 42s the patch passed -0 checkstyle 0m 48s hadoop-yarn-project/hadoop-yarn: The patch generated 16 new + 286 unchanged - 0 fixed = 302 total (was 286) +1 mvnsite 1m 5s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 findbugs 2m 18s the patch passed +1 javadoc 0m 45s the patch passed -1 unit 0m 29s hadoop-yarn-api in the patch failed. -1 unit 42m 5s hadoop-yarn-server-resourcemanager in the patch failed. +1 asflicense 0m 24s The patch does not generate ASF License warnings. 89m 3s Reason Tests Failed junit tests hadoop.yarn.conf.TestYarnConfigurationFields   hadoop.yarn.server.resourcemanager.TestRMRestart   hadoop.yarn.server.resourcemanager.scheduler.fair.TestFSAppStarvation Timed out junit tests org.apache.hadoop.yarn.server.resourcemanager.TestRMStoreCommands Subsystem Report/Notes Docker Image:yetus/hadoop:14b5c93 JIRA Issue YARN-6689 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12874765/YARN-6689.002.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux 889aff0cd2bc 4.4.0-43-generic #63-Ubuntu SMP Wed Oct 12 13:48:03 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 63ce159 Default Java 1.8.0_131 findbugs v3.1.0-RC1 checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/16258/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/16258/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-api.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/16258/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/16258/testReport/ modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn Console output https://builds.apache.org/job/PreCommit-YARN-Build/16258/console Powered by Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
          Hide
          jhung Jonathan Hung added a comment - - edited

          Hi Xuan Gong/Wangda Tan, as discussed, attached 002 patch which:

          1. changes userGroup to user-group (for UserGroupMappingPlacementRule)
          2. tries to load PlacementRule using reflection if keyword is not found
          Show
          jhung Jonathan Hung added a comment - - edited Hi Xuan Gong / Wangda Tan , as discussed, attached 002 patch which: changes userGroup to user-group (for UserGroupMappingPlacementRule) tries to load PlacementRule using reflection if keyword is not found
          Hide
          jhung Jonathan Hung added a comment -

          Here's an initial patch which reads from yarn.scheduler.queue-placement-rules to determine which placement rules to apply.

          Show
          jhung Jonathan Hung added a comment - Here's an initial patch which reads from yarn.scheduler.queue-placement-rules to determine which placement rules to apply.

            People

            • Assignee:
              jhung Jonathan Hung
              Reporter:
              jhung Jonathan Hung
            • Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development