Details
-
Type:
Improvement
-
Status: Resolved
-
Priority:
Trivial
-
Resolution: Fixed
-
Affects Version/s: 2.7.1
-
Fix Version/s: 2.9.0, 3.0.0-alpha1
-
Component/s: yarn
-
Labels:
-
Hadoop Flags:Reviewed
Description
If the YARN properties below are poorly configured:
yarn.scheduler.minimum-allocation-mb yarn.scheduler.maximum-allocation-mb
The error message that shows up in the RM is:
2016-01-07 14:47:03,711 FATAL org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Error starting ResourceManager
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Invalid resource scheduler memory allocation configuration, yarn.scheduler.minimum-allocation-mb=-1, yarn.scheduler.maximum-allocation-mb=-3, min should equal greater than 0, max should be no smaller than min.
at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.validateConf(FairScheduler.java:215)
While it's technically correct, it's not very user friendly.
Activity
- All
- Comments
- Work Log
- History
- Activity
- Transitions
Submit for testing.
 -1 overall |
| Vote | Subsystem | Runtime | Comment |
|---|---|---|---|
| 0 | reexec | 0m 0s | Docker mode activated. |
| +1 | @author | 0m 0s | The patch does not contain any @author tags. |
| -1 | test4tests | 0m 0s | The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. |
| +1 | mvninstall | 7m 24s | trunk passed |
| +1 | compile | 0m 25s | trunk passed with JDK v1.8.0_66 |
| +1 | compile | 0m 30s | trunk passed with JDK v1.7.0_91 |
| +1 | checkstyle | 0m 13s | trunk passed |
| +1 | mvnsite | 0m 36s | trunk passed |
| +1 | mvneclipse | 0m 15s | trunk passed |
| +1 | findbugs | 1m 12s | trunk passed |
| -1 | javadoc | 0m 21s | hadoop-yarn-server-resourcemanager in trunk failed with JDK v1.8.0_66. |
| +1 | javadoc | 0m 26s | trunk passed with JDK v1.7.0_91 |
| +1 | mvninstall | 0m 30s | the patch passed |
| +1 | compile | 0m 23s | the patch passed with JDK v1.8.0_66 |
| +1 | javac | 0m 23s | the patch passed |
| +1 | compile | 0m 27s | the patch passed with JDK v1.7.0_91 |
| +1 | javac | 0m 27s | the patch passed |
| +1 | checkstyle | 0m 14s | the patch passed |
| +1 | mvnsite | 0m 34s | the patch passed |
| +1 | mvneclipse | 0m 12s | the patch passed |
| +1 | whitespace | 0m 0s | Patch has no whitespace issues. |
| +1 | findbugs | 1m 16s | the patch passed |
| -1 | javadoc | 0m 18s | hadoop-yarn-server-resourcemanager in the patch failed with JDK v1.8.0_66. |
| +1 | javadoc | 0m 24s | the patch passed with JDK v1.7.0_91 |
| +1 | unit | 59m 29s | hadoop-yarn-server-resourcemanager in the patch passed with JDK v1.8.0_66. |
| +1 | unit | 60m 54s | hadoop-yarn-server-resourcemanager in the patch passed with JDK v1.7.0_91. |
| +1 | asflicense | 0m 17s | Patch does not generate ASF License warnings. |
| 137m 24s |
| Subsystem | Report/Notes |
|---|---|
| Docker | Image:yetus/hadoop:0ca8df7 |
| JIRA Patch URL | https://issues.apache.org/jira/secure/attachment/12781087/YARN-4560.001.patch |
| JIRA Issue | |
| Optional Tests | asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle |
| uname | Linux 11a0aceef44b 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | /testptch/hadoop/patchprocess/precommit/personality/provided.sh |
| git revision | trunk / 89022f8 |
| Default Java | 1.7.0_91 |
| Multi-JDK versions | /usr/lib/jvm/java-8-oracle:1.8.0_66 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_91 |
| findbugs | v3.0.0 |
| javadoc | https://builds.apache.org/job/PreCommit-YARN-Build/10197/artifact/patchprocess/branch-javadoc-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager-jdk1.8.0_66.txt |
| javadoc | https://builds.apache.org/job/PreCommit-YARN-Build/10197/artifact/patchprocess/patch-javadoc-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager-jdk1.8.0_66.txt |
| JDK v1.7.0_91 Test Results | https://builds.apache.org/job/PreCommit-YARN-Build/10197/testReport/ |
| modules | C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager |
| Max memory used | 75MB |
| Powered by | Apache Yetus 0.2.0-SNAPSHOT http://yetus.apache.org |
| Console output | https://builds.apache.org/job/PreCommit-YARN-Build/10197/console |
This message was automatically generated.
Looks good to me. +1 (non-binding). Karthik Kambatla?
+1. Checking this in.
Thanks for improving the logging, Ray. Just committed this to trunk and branch-2.
FAILURE: Integrated in Hadoop-trunk-Commit #9468 (See https://builds.apache.org/job/Hadoop-trunk-Commit/9468/)
YARN-4560. Make scheduler error checking message more user friendly. (kasha: rev 3ef5500783f043ff206458d8c10ed3d5405a8b0c)
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/FairScheduler.java
Thanks for the review everyone! Thanks for the commit Karthik!
Initial version.