Details
-
Type:
Bug
-
Status: Closed
-
Priority:
Major
-
Resolution: Fixed
-
Affects Version/s: 2.7.0
-
Fix Version/s: 2.8.0, 2.7.3, 3.0.0-alpha1
-
Component/s: resourcemanager
-
Labels:None
Description
On the WEBUI, the global main view page : http://resourcemanager:8088/cluster/apps doesn't display applications over 9999.
With command line it works (# yarn application -list).
Regards,
Alexandre
Issue Links
- is depended upon by
-
MAPREDUCE-6419
JobHistoryServer doesn't sort properly based on Job ID when Job id's exceed 9999
-
- Resolved
-
- is duplicated by
-
YARN-4357
Applications page loads very slowly when there are lots of applications
-
- Resolved
-
Activity
- All
- Comments
- Work Log
- History
- Activity
- Transitions
Hi,
There is no Java stackstrace for this bug.
I think that the property yarn.resourcemanager.max-completed-applications is in cause (default value is 10000), but it doesn't work properly.
Maybe yarn.resourcemanager.max-completed-applications is only effective on ResourceManager GUI.
Regards,
LINTE Hey, could you provide which version of hadoop you are using ? 2.7 ?
LINTE, This seems to be sorting issue with respect to the app ids. It is just considering the first four digits of the application number for sorting in ascending/descing order, due to this it is not showing the application ids having more that 9999 based on the order and it is mixing up with the other apps considering only the first 4 digits. You can see the attached image RMApps.png which shows displaying the apps having id>9999 with other apps,
Please check and confirm whether is it happening same or not in your case by searching for the specific app id in the search box. Thanks.
Hi,
xgong, Yes with 2.7.0 yarn version
devarak.j, Yes i confirm this is an asc/desc sortingissue with application id over 9999.
Regards,
The datatable string sort algorithm has limitation.
It can not properly sort the string having having the combination of the string and numeric value. The application id "application_numericValue"
ie is why the sort is not working properly.
To fix the same we can use the datatable plugins natural sort alogorithm.
sb.append("[\n") .append("{'sType':'natural', 'aTargets': [0]") .append(", 'mRender': parseHadoopID }")
plugin - ref:
https://github.com/DataTables/Plugins/blob/1.10.7/sorting/natural.js
Please review the attached patch
 -1 overall |
| Vote | Subsystem | Runtime | Comment |
|---|---|---|---|
| -1 | pre-patch | 17m 43s | Pre-patch trunk has 3 extant Findbugs (version 3.0.0) warnings. |
| -1 | @author | 0m 0s | The patch appears to contain 1 @author tags which the Hadoop community has agreed to not allow in code contributions. |
| -1 | tests included | 0m 0s | The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. |
| +1 | javac | 7m 35s | There were no new javac warning messages. |
| +1 | javadoc | 9m 37s | There were no new javadoc warning messages. |
| -1 | release audit | 0m 18s | The applied patch generated 1 release audit warnings. |
| -1 | checkstyle | 1m 21s | The applied patch generated 1 new checkstyle issues (total was 18, now 19). |
| +1 | whitespace | 0m 0s | The patch has no lines that end in whitespace. |
| +1 | install | 1m 34s | mvn install still works. |
| +1 | eclipse:eclipse | 0m 33s | The patch built with eclipse:eclipse. |
| +1 | findbugs | 3m 32s | The patch does not introduce any new Findbugs (version 3.0.0) warnings. |
| +1 | yarn tests | 1m 58s | Tests passed in hadoop-yarn-common. |
| +1 | yarn tests | 3m 6s | Tests passed in hadoop-yarn-server-applicationhistoryservice. |
| +1 | yarn tests | 0m 24s | Tests passed in hadoop-yarn-server-common. |
| 48m 13s |
This message was automatically generated.
Submitting the updated patch
| -1 overall |
| Vote | Subsystem | Runtime | Comment |
|---|---|---|---|
| -1 | patch | 0m 0s | The patch command could not apply the patch during dryrun. |
| Subsystem | Report/Notes |
|---|---|
| Patch URL | http://issues.apache.org/jira/secure/attachment/12742897/YARN-3840-1.patch |
| Optional Tests | javadoc javac unit findbugs checkstyle |
| git revision | trunk / 076948d |
| Console output | https://builds.apache.org/job/PreCommit-YARN-Build/8392/console |
This message was automatically generated.
Thanks Mohammad Shahid Khan for the patch.
Patch is not getting applied, can you please check it?
There are some comments at high level.
1. Can you also check the same for Node Manager Web UI Running Applications and Running Containers tables?
2. Newly added js code is missing the format, Please follow this coding guide line.
- Indent two spaces per level, not four.
Hi Devaraj K ,
Please ignore the first patch. in the current patch have taken the nodemanager web ui issue as well.
The current patch is using the natural sort algorithm of the natural,js a plugin used for datatable to sort the data.
The natural sort plugin " https://github.com/DataTables/Plugins/blob/1.10.7/sorting/natural.js " is having the MIT license.
As per MIT license we can redistribute the code but we have to keep the license header.
The haddop patch verification tool does not allow the auther info
As of now i have not removed the @author tag from the path file.
Please help me to address this issue.
| -1 overall |
| Vote | Subsystem | Runtime | Comment |
|---|---|---|---|
| -1 | pre-patch | 19m 20s | Pre-patch trunk has 3 extant Findbugs (version 3.0.0) warnings. |
| -1 | @author | 0m 0s | The patch appears to contain 1 @author tags which the Hadoop community has agreed to not allow in code contributions. |
| -1 | tests included | 0m 0s | The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. |
| +1 | javac | 7m 44s | There were no new javac warning messages. |
| +1 | javadoc | 9m 48s | There were no new javadoc warning messages. |
| -1 | release audit | 0m 17s | The applied patch generated 1 release audit warnings. |
| -1 | checkstyle | 2m 36s | The applied patch generated 1 new checkstyle issues (total was 8, now 9). |
| +1 | whitespace | 0m 0s | The patch has no lines that end in whitespace. |
| +1 | install | 1m 33s | mvn install still works. |
| +1 | eclipse:eclipse | 0m 33s | The patch built with eclipse:eclipse. |
| +1 | findbugs | 4m 41s | The patch does not introduce any new Findbugs (version 3.0.0) warnings. |
| +1 | yarn tests | 1m 57s | Tests passed in hadoop-yarn-common. |
| +1 | yarn tests | 3m 10s | Tests passed in hadoop-yarn-server-applicationhistoryservice. |
| +1 | yarn tests | 0m 23s | Tests passed in hadoop-yarn-server-common. |
| +1 | yarn tests | 6m 4s | Tests passed in hadoop-yarn-server-nodemanager. |
| 58m 9s |
This message was automatically generated.
You can probably package the plugin js file which is compatible for the dt-1.9.4 release(currently YARN uses) similar to the one we have already in hadoop-yarn-project\hadoop-yarn\hadoop-yarn-common\src\main\resources\webapps\static\dt-1.9.4\js\jquery.dataTables.min.js.gz.
| -1 overall |
| Vote | Subsystem | Runtime | Comment |
|---|---|---|---|
| -1 | pre-patch | 23m 1s | Pre-patch trunk has 3 extant Findbugs (version 3.0.0) warnings. |
| +1 | @author | 0m 0s | The patch does not contain any @author tags. |
| -1 | tests included | 0m 0s | The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. |
| +1 | javac | 8m 11s | There were no new javac warning messages. |
| +1 | javadoc | 9m 58s | There were no new javadoc warning messages. |
| +1 | release audit | 0m 24s | The applied patch does not increase the total number of release audit warnings. |
| +1 | checkstyle | 2m 44s | There were no new checkstyle issues. |
| +1 | whitespace | 0m 0s | The patch has no lines that end in whitespace. |
| +1 | install | 1m 39s | mvn install still works. |
| +1 | eclipse:eclipse | 0m 34s | The patch built with eclipse:eclipse. |
| +1 | findbugs | 4m 46s | The patch does not introduce any new Findbugs (version 3.0.0) warnings. |
| +1 | yarn tests | 1m 58s | Tests passed in hadoop-yarn-common. |
| +1 | yarn tests | 3m 14s | Tests passed in hadoop-yarn-server-applicationhistoryservice. |
| +1 | yarn tests | 0m 24s | Tests passed in hadoop-yarn-server-common. |
| +1 | yarn tests | 6m 17s | Tests passed in hadoop-yarn-server-nodemanager. |
| 63m 15s |
This message was automatically generated.
Attached patch having test cases
| -1 overall |
| Vote | Subsystem | Runtime | Comment |
|---|---|---|---|
| -1 | pre-patch | 22m 30s | Pre-patch trunk has 4 extant Findbugs (version 3.0.0) warnings. |
| +1 | @author | 0m 0s | The patch does not contain any @author tags. |
| +1 | tests included | 0m 0s | The patch appears to include 2 new or modified test files. |
| +1 | javac | 7m 36s | There were no new javac warning messages. |
| +1 | javadoc | 9m 35s | There were no new javadoc warning messages. |
| +1 | release audit | 0m 22s | The applied patch does not increase the total number of release audit warnings. |
| +1 | checkstyle | 3m 51s | There were no new checkstyle issues. |
| +1 | whitespace | 0m 1s | The patch has no lines that end in whitespace. |
| +1 | install | 1m 34s | mvn install still works. |
| +1 | eclipse:eclipse | 0m 33s | The patch built with eclipse:eclipse. |
| +1 | findbugs | 7m 17s | The patch does not introduce any new Findbugs (version 3.0.0) warnings. |
| +1 | mapreduce tests | 9m 3s | Tests passed in hadoop-mapreduce-client-app. |
| +1 | yarn tests | 1m 57s | Tests passed in hadoop-yarn-common. |
| +1 | yarn tests | 3m 12s | Tests passed in hadoop-yarn-server-applicationhistoryservice. |
| +1 | yarn tests | 0m 25s | Tests passed in hadoop-yarn-server-common. |
| +1 | yarn tests | 6m 4s | Tests passed in hadoop-yarn-server-nodemanager. |
| +1 | yarn tests | 51m 3s | Tests passed in hadoop-yarn-server-resourcemanager. |
| 125m 6s |
This message was automatically generated.
I want somebody to review the solution.
In the mean-time, if you can't run a patched Hadoop, the following is a bookmarklet that will fix the UI if you:
javascript:(function(){var myRegex = /(<.*>application_[0-9]+_)([0-9]+)(<..>)/;var tmp;for (var i = 0; i < appsTableData.length; i++) { tmp = myRegex.exec(appsTableData[i][0]); appsTableData[i][0] = tmp[1] + ("0000000" + parseInt(tmp[2])).substr(-7,7) + tmp[3];}appsDataTable.fnClearTable();appsDataTable.fnAddData(appsTableData);})();
| -1 overall |
| Vote | Subsystem | Runtime | Comment |
|---|---|---|---|
| -1 | patch | 0m 0s | The patch command could not apply the patch during dryrun. |
| Subsystem | Report/Notes |
|---|---|
| Patch URL | http://issues.apache.org/jira/secure/attachment/12743548/YARN-3840-6.patch |
| Optional Tests | javadoc javac unit findbugs checkstyle |
| git revision | trunk / 39285e6 |
| Console output | https://builds.apache.org/job/PreCommit-YARN-Build/9303/console |
This message was automatically generated.
Rebase
This patch contains binary file so please use
git apply patch-patch - file
| -1 overall |
| Vote | Subsystem | Runtime | Comment |
|---|---|---|---|
| -1 | pre-patch | 33m 27s | Findbugs (version ) appears to be broken on trunk. |
| +1 | @author | 0m 0s | The patch does not contain any @author tags. |
| +1 | tests included | 0m 0s | The patch appears to include 2 new or modified test files. |
| +1 | javac | 11m 24s | There were no new javac warning messages. |
| +1 | javadoc | 14m 18s | There were no new javadoc warning messages. |
| +1 | release audit | 0m 36s | The applied patch does not increase the total number of release audit warnings. |
| +1 | checkstyle | 4m 18s | There were no new checkstyle issues. |
| +1 | whitespace | 0m 2s | The patch has no lines that end in whitespace. |
| +1 | install | 2m 11s | mvn install still works. |
| +1 | eclipse:eclipse | 0m 49s | The patch built with eclipse:eclipse. |
| -1 | findbugs | 10m 32s | The patch appears to introduce 3 new Findbugs (version 3.0.0) warnings. |
| -1 | mapreduce tests | 11m 34s | Tests failed in hadoop-mapreduce-client-app. |
| +1 | yarn tests | 2m 38s | Tests passed in hadoop-yarn-common. |
| -1 | yarn tests | 3m 54s | Tests failed in hadoop-yarn-server-applicationhistoryservice. |
| +1 | yarn tests | 0m 35s | Tests passed in hadoop-yarn-server-common. |
| -1 | yarn tests | 10m 33s | Tests failed in hadoop-yarn-server-nodemanager. |
| -1 | yarn tests | 0m 35s | Tests failed in hadoop-yarn-server-resourcemanager. |
| 107m 34s |
| Reason | Tests |
|---|---|
| FindBugs | module:hadoop-yarn-common |
| Failed unit tests | hadoop.mapreduce.v2.app.job.impl.TestJobImpl |
| hadoop.mapreduce.v2.app.webapp.TestAMWebServicesAttempt | |
| hadoop.yarn.server.applicationhistoryservice.webapp.TestAHSWebApp | |
| hadoop.yarn.server.nodemanager.TestNodeStatusUpdaterForLabels | |
| Failed build | hadoop-yarn-server-resourcemanager |
This message was automatically generated.
Mohammad Shahid Khan, thanks for working on this. could you check if the unit test failures are related ? thanks !
| -1 overall |
| Vote | Subsystem | Runtime | Comment |
|---|---|---|---|
| 0 | reexec | 0m 11s | docker + precommit patch detected. |
| +1 | @author | 0m 0s | The patch does not contain any @author tags. |
| +1 | test4tests | 0m 0s | The patch appears to include 2 new or modified test files. |
| +1 | mvninstall | 3m 31s | trunk passed |
| +1 | compile | 4m 29s | trunk passed with JDK v1.8.0_60 |
| +1 | compile | 4m 14s | trunk passed with JDK v1.7.0_79 |
| +1 | checkstyle | 0m 57s | trunk passed |
| +1 | mvneclipse | 1m 18s | trunk passed |
| -1 | findbugs | 1m 13s | hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common in trunk has 3 extant Findbugs warnings. |
| +1 | javadoc | 1m 57s | trunk passed with JDK v1.8.0_60 |
| +1 | javadoc | 2m 18s | trunk passed with JDK v1.7.0_79 |
| +1 | mvninstall | 2m 14s | the patch passed |
| +1 | compile | 4m 17s | the patch passed with JDK v1.8.0_60 |
| +1 | javac | 4m 17s | the patch passed |
| +1 | compile | 4m 10s | the patch passed with JDK v1.7.0_79 |
| +1 | javac | 4m 10s | the patch passed |
| +1 | checkstyle | 0m 56s | the patch passed |
| +1 | mvneclipse | 1m 21s | the patch passed |
| +1 | whitespace | 0m 0s | Patch has no whitespace issues. |
| +1 | findbugs | 6m 13s | the patch passed |
| +1 | javadoc | 1m 54s | the patch passed with JDK v1.8.0_60 |
| +1 | javadoc | 2m 18s | the patch passed with JDK v1.7.0_79 |
| +1 | unit | 1m 47s | hadoop-yarn-common in the patch passed with JDK v1.8.0_60. |
| +1 | unit | 2m 53s | hadoop-yarn-server-applicationhistoryservice in the patch passed with JDK v1.8.0_60. |
| +1 | unit | 0m 21s | hadoop-yarn-server-common in the patch passed with JDK v1.8.0_60. |
| +1 | unit | 8m 23s | hadoop-yarn-server-nodemanager in the patch passed with JDK v1.8.0_60. |
| -1 | unit | 58m 54s | hadoop-yarn-server-resourcemanager in the patch failed with JDK v1.8.0_60. |
| +1 | unit | 9m 39s | hadoop-mapreduce-client-app in the patch passed with JDK v1.8.0_60. |
| +1 | unit | 2m 1s | hadoop-yarn-common in the patch passed with JDK v1.7.0_79. |
| +1 | unit | 3m 7s | hadoop-yarn-server-applicationhistoryservice in the patch passed with JDK v1.7.0_79. |
| +1 | unit | 0m 24s | hadoop-yarn-server-common in the patch passed with JDK v1.7.0_79. |
| +1 | unit | 9m 35s | hadoop-yarn-server-nodemanager in the patch passed with JDK v1.7.0_79. |
| -1 | unit | 59m 19s | hadoop-yarn-server-resourcemanager in the patch failed with JDK v1.7.0_79. |
| +1 | unit | 9m 36s | hadoop-mapreduce-client-app in the patch passed with JDK v1.7.0_79. |
| -1 | asflicense | 0m 26s | Patch generated 7 ASF License warnings. |
| 216m 7s |
| Reason | Tests |
|---|---|
| JDK v1.8.0_60 Failed junit tests | hadoop.yarn.server.resourcemanager.TestAMAuthorization |
| hadoop.yarn.server.resourcemanager.TestClientRMTokens | |
| JDK v1.7.0_79 Failed junit tests | hadoop.yarn.server.resourcemanager.TestAMAuthorization |
| hadoop.yarn.server.resourcemanager.TestClientRMTokens |
| Subsystem | Report/Notes |
|---|---|
| Docker | Client=1.7.1 Server=1.7.1 Image:test-patch-base-hadoop-date2015-11-05 |
| JIRA Patch URL | https://issues.apache.org/jira/secure/attachment/12768768/yarn-3840-7.patch |
| JIRA Issue | |
| Optional Tests | asflicense javac javadoc mvninstall unit findbugs checkstyle compile |
| uname | Linux d4590580c43d 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | /home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/patchprocess/apache-yetus-ee5baeb/precommit/personality/hadoop.sh |
| git revision | trunk / 21c0e3e |
| Default Java | 1.7.0_79 |
| Multi-JDK versions | /usr/lib/jvm/java-8-oracle:1.8.0_60 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_79 |
| findbugs | v3.0.0 |
| findbugs | https://builds.apache.org/job/PreCommit-YARN-Build/9632/artifact/patchprocess/branch-findbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-common-warnings.html |
| unit | https://builds.apache.org/job/PreCommit-YARN-Build/9632/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager-jdk1.8.0_60.txt |
| unit | https://builds.apache.org/job/PreCommit-YARN-Build/9632/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager-jdk1.7.0_79.txt |
| unit test logs | https://builds.apache.org/job/PreCommit-YARN-Build/9632/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager-jdk1.8.0_60.txt https://builds.apache.org/job/PreCommit-YARN-Build/9632/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager-jdk1.7.0_79.txt |
| JDK v1.7.0_79 Test Results | https://builds.apache.org/job/PreCommit-YARN-Build/9632/testReport/ |
| asflicense | https://builds.apache.org/job/PreCommit-YARN-Build/9632/artifact/patchprocess/patch-asflicense-problems.txt |
| modules | C: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: . |
| Max memory used | 228MB |
| Powered by | Apache Yetus http://yetus.apache.org |
| Console output | https://builds.apache.org/job/PreCommit-YARN-Build/9632/console |
This message was automatically generated.
UT failiure – not related to current patch
findbugs – not related to current patch
SUCCESS: Integrated in Hadoop-trunk-Commit #8780 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8780/)
YARN-3840. Resource Manager web ui issue when sorting application by id (jianhe: rev 8fbea531d7f7b665f6f55af54c8ebf330118ff37)
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/AppAttemptPage.java
- hadoop-yarn-project/CHANGES.txt
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/webapp/view/JQueryUI.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/AllApplicationsPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/static/dt-plugin-1.10.7/sorting/natural.js.gz
- hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/TasksPage.java
- hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/TaskPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebPageUtils.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/AllContainersPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/TestAHSWebApp.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/AppPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebApp.java
FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #647 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/647/)
YARN-3840. Resource Manager web ui issue when sorting application by id (jianhe: rev 8fbea531d7f7b665f6f55af54c8ebf330118ff37)
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/AllContainersPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebPageUtils.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/static/dt-plugin-1.10.7/sorting/natural.js.gz
- hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/TaskPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebApp.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/AllApplicationsPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/AppAttemptPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/AppPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/webapp/view/JQueryUI.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/TestAHSWebApp.java
- hadoop-yarn-project/CHANGES.txt
- hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/TasksPage.java
FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #658 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/658/)
YARN-3840. Resource Manager web ui issue when sorting application by id (jianhe: rev 8fbea531d7f7b665f6f55af54c8ebf330118ff37)
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/AppPage.java
- hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/TaskPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebApp.java
- hadoop-yarn-project/CHANGES.txt
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/TestAHSWebApp.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/static/dt-plugin-1.10.7/sorting/natural.js.gz
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/AllApplicationsPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebPageUtils.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/webapp/view/JQueryUI.java
- hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/TasksPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/AllContainersPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/AppAttemptPage.java
FAILURE: Integrated in Hadoop-Yarn-trunk #1381 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/1381/)
YARN-3840. Resource Manager web ui issue when sorting application by id (jianhe: rev 8fbea531d7f7b665f6f55af54c8ebf330118ff37)
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebApp.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/AllApplicationsPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/webapp/view/JQueryUI.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/static/dt-plugin-1.10.7/sorting/natural.js.gz
- hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/TasksPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/AppAttemptPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/TestAHSWebApp.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/AllContainersPage.java
- hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/TaskPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebPageUtils.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/AppPage.java
- hadoop-yarn-project/CHANGES.txt
Committed to trunk, branch-2, and branch-2.7, thanks Mohammad Shahid Khan !
FAILURE: Integrated in Hadoop-Mapreduce-trunk #2588 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2588/)
YARN-3840. Resource Manager web ui issue when sorting application by id (jianhe: rev 8fbea531d7f7b665f6f55af54c8ebf330118ff37)
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/AppPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/AllContainersPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/static/dt-plugin-1.10.7/sorting/natural.js.gz
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/AppAttemptPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebApp.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/webapp/view/JQueryUI.java
- hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/TaskPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebPageUtils.java
- hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/TasksPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/AllApplicationsPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/TestAHSWebApp.java
- hadoop-yarn-project/CHANGES.txt
FAILURE: Integrated in Hadoop-Hdfs-trunk #2528 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2528/)
YARN-3840. Resource Manager web ui issue when sorting application by id (jianhe: rev 8fbea531d7f7b665f6f55af54c8ebf330118ff37)
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/webapp/view/JQueryUI.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebApp.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/static/dt-plugin-1.10.7/sorting/natural.js.gz
- hadoop-yarn-project/CHANGES.txt
- hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/TasksPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/TestAHSWebApp.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/AppPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/AppAttemptPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/AllContainersPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/AllApplicationsPage.java
- hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/TaskPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebPageUtils.java
FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #589 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/589/)
YARN-3840. Resource Manager web ui issue when sorting application by id (jianhe: rev 8fbea531d7f7b665f6f55af54c8ebf330118ff37)
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/AllApplicationsPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/static/dt-plugin-1.10.7/sorting/natural.js.gz
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebApp.java
- hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/TasksPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/AppPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebPageUtils.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/AppAttemptPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/webapp/view/JQueryUI.java
- hadoop-yarn-project/CHANGES.txt
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/TestAHSWebApp.java
- hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/TaskPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/AllContainersPage.java
Did anyone do a performance test with this change? Recently I'm seeing the main RM UI page taking a lot longer to load with a full set of 10,000+ applications, and it appears to all be client-side processing. It takes so long the client-side browser is complaining:
A script on this page may be busy, or it may have stopped responding. You can stop the script now, open the script in the debugger, or let the script continue. Script: http://rmhost:8088/static/dt-plugin-1.10.7/sorting/natural.js
Filed YARN-4357 to track the performance issue with the apps page.
Jason Lowe, thanks for reporting this. I did local test with a small number of apps only.
I'm going to revert this patch to avoid regression.
I verified locally by simulating 10k apps. the patch does affect the browser performance.
Mohammad Shahid Khan, would you like to take a crack at it?
FAILURE: Integrated in Hadoop-trunk-Commit #8811 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8811/)
Revert "YARN-3840. Resource Manager web ui issue when sorting (jianhe: rev fcd7888029a8e07cb0b22d1f47f9e7df82c4a304)
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/AllApplicationsPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/AllContainersPage.java
- hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/TasksPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebApp.java
- hadoop-yarn-project/CHANGES.txt
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/webapp/view/JQueryUI.java
- hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/TaskPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/AppPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/AppAttemptPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/static/dt-plugin-1.10.7/sorting/natural.js.gz
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebPageUtils.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/TestAHSWebApp.java
FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #684 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/684/)
Revert "YARN-3840. Resource Manager web ui issue when sorting (jianhe: rev fcd7888029a8e07cb0b22d1f47f9e7df82c4a304)
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/TestAHSWebApp.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/webapp/view/JQueryUI.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/AppPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/AllApplicationsPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/AppAttemptPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/static/dt-plugin-1.10.7/sorting/natural.js.gz
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebApp.java
- hadoop-yarn-project/CHANGES.txt
- hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/TaskPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebPageUtils.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/AllContainersPage.java
- hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/TasksPage.java
FAILURE: Integrated in Hadoop-Yarn-trunk #1408 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/1408/)
Revert "YARN-3840. Resource Manager web ui issue when sorting (jianhe: rev fcd7888029a8e07cb0b22d1f47f9e7df82c4a304)
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebPageUtils.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/AppAttemptPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/webapp/view/JQueryUI.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebApp.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/TestAHSWebApp.java
- hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/TasksPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/AllContainersPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/AppPage.java
- hadoop-yarn-project/CHANGES.txt
- hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/TaskPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/AllApplicationsPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/static/dt-plugin-1.10.7/sorting/natural.js.gz
FAILURE: Integrated in Hadoop-Mapreduce-trunk #2613 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2613/)
Revert "YARN-3840. Resource Manager web ui issue when sorting (jianhe: rev fcd7888029a8e07cb0b22d1f47f9e7df82c4a304)
- hadoop-yarn-project/CHANGES.txt
- hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/TaskPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebPageUtils.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/TestAHSWebApp.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/AllContainersPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/static/dt-plugin-1.10.7/sorting/natural.js.gz
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/webapp/view/JQueryUI.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/AllApplicationsPage.java
- hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/TasksPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebApp.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/AppPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/AppAttemptPage.java
FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #672 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/672/)
Revert "YARN-3840. Resource Manager web ui issue when sorting (jianhe: rev fcd7888029a8e07cb0b22d1f47f9e7df82c4a304)
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/AppPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/AppAttemptPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/webapp/view/JQueryUI.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/static/dt-plugin-1.10.7/sorting/natural.js.gz
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebPageUtils.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/TestAHSWebApp.java
- hadoop-yarn-project/CHANGES.txt
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebApp.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/AllContainersPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/AllApplicationsPage.java
- hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/TasksPage.java
- hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/TaskPage.java
FAILURE: Integrated in Hadoop-Hdfs-trunk #2548 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2548/)
Revert "YARN-3840. Resource Manager web ui issue when sorting (jianhe: rev fcd7888029a8e07cb0b22d1f47f9e7df82c4a304)
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebPageUtils.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/TestAHSWebApp.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/AllApplicationsPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/webapp/view/JQueryUI.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/static/dt-plugin-1.10.7/sorting/natural.js.gz
- hadoop-yarn-project/CHANGES.txt
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/AllContainersPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebApp.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/AppPage.java
- hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/TaskPage.java
- hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/TasksPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/AppAttemptPage.java
ABORTED: Integrated in Hadoop-Hdfs-trunk-Java8 #610 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/610/)
Revert "YARN-3840. Resource Manager web ui issue when sorting (jianhe: rev fcd7888029a8e07cb0b22d1f47f9e7df82c4a304)
- hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/TasksPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebApp.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/static/dt-plugin-1.10.7/sorting/natural.js.gz
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/webapp/view/JQueryUI.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/AppAttemptPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebPageUtils.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/TestAHSWebApp.java
- hadoop-yarn-project/CHANGES.txt
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/AllApplicationsPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/AllContainersPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/AppPage.java
- hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/TaskPage.java
Jian He, Shahid is in my team and currently on leave.
Let me see if I can find a solution to this before he comes back.
natural.js has a lot of extraneous logic which is not directly related to what we want to do for sorting appIds'. Let me see if removing code improves performance.
thanks Varun ! appreciate your help
Rewrote the logic for sorting.
In my tests, with 10000 finished apps and RM idle(no running apps), it takes more than 1 minute to load the apps page with previous script.
With the script in patch, it takes a few seconds.
| -1 overall |
| Vote | Subsystem | Runtime | Comment |
|---|---|---|---|
| 0 | reexec | 0m 0s | Docker mode activated. |
| +1 | @author | 0m 0s | The patch does not contain any @author tags. |
| +1 | test4tests | 0m 0s | The patch appears to include 2 new or modified test files. |
| +1 | mvninstall | 7m 27s | trunk passed |
| +1 | compile | 7m 39s | trunk passed with JDK v1.8.0_66 |
| +1 | compile | 8m 33s | trunk passed with JDK v1.7.0_85 |
| +1 | checkstyle | 1m 0s | trunk passed |
| +1 | mvnsite | 2m 50s | trunk passed |
| +1 | mvneclipse | 1m 21s | trunk passed |
| -1 | findbugs | 1m 17s | hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common in trunk has 3 extant Findbugs warnings. |
| +1 | javadoc | 1m 56s | trunk passed with JDK v1.8.0_66 |
| +1 | javadoc | 2m 20s | trunk passed with JDK v1.7.0_85 |
| +1 | mvninstall | 2m 36s | the patch passed |
| +1 | compile | 7m 43s | the patch passed with JDK v1.8.0_66 |
| +1 | javac | 7m 43s | the patch passed |
| +1 | compile | 8m 29s | the patch passed with JDK v1.7.0_85 |
| +1 | javac | 8m 29s | the patch passed |
| +1 | checkstyle | 0m 58s | the patch passed |
| +1 | mvnsite | 2m 50s | the patch passed |
| +1 | mvneclipse | 1m 21s | the patch passed |
| +1 | whitespace | 0m 0s | Patch has no whitespace issues. |
| +1 | findbugs | 6m 15s | the patch passed |
| +1 | javadoc | 1m 53s | the patch passed with JDK v1.8.0_66 |
| +1 | javadoc | 2m 21s | the patch passed with JDK v1.7.0_85 |
| -1 | unit | 1m 50s | hadoop-yarn-common in the patch failed with JDK v1.8.0_66. |
| +1 | unit | 2m 53s | hadoop-yarn-server-applicationhistoryservice in the patch passed with JDK v1.8.0_66. |
| +1 | unit | 0m 22s | hadoop-yarn-server-common in the patch passed with JDK v1.8.0_66. |
| +1 | unit | 8m 25s | hadoop-yarn-server-nodemanager in the patch passed with JDK v1.8.0_66. |
| -1 | unit | 58m 22s | hadoop-yarn-server-resourcemanager in the patch failed with JDK v1.8.0_66. |
| -1 | unit | 9m 8s | hadoop-mapreduce-client-app in the patch failed with JDK v1.8.0_66. |
| -1 | unit | 2m 6s | hadoop-yarn-common in the patch failed with JDK v1.7.0_85. |
| -1 | unit | 3m 11s | hadoop-yarn-server-applicationhistoryservice in the patch failed with JDK v1.7.0_85. |
| +1 | unit | 0m 26s | hadoop-yarn-server-common in the patch passed with JDK v1.7.0_85. |
| +1 | unit | 8m 57s | hadoop-yarn-server-nodemanager in the patch passed with JDK v1.7.0_85. |
| -1 | unit | 60m 14s | hadoop-yarn-server-resourcemanager in the patch failed with JDK v1.7.0_85. |
| -1 | unit | 10m 7s | hadoop-mapreduce-client-app in the patch failed with JDK v1.7.0_85. |
| -1 | asflicense | 0m 26s | Patch generated 7 ASF License warnings. |
| 250m 57s |
| Reason | Tests |
|---|---|
| JDK v1.8.0_66 Failed junit tests | hadoop.yarn.webapp.TestWebApp |
| hadoop.yarn.server.resourcemanager.TestAMAuthorization | |
| hadoop.yarn.server.resourcemanager.TestClientRMTokens | |
| hadoop.mapreduce.v2.app.TestMRAppMaster | |
| JDK v1.7.0_85 Failed junit tests | hadoop.yarn.webapp.TestWebApp |
| hadoop.yarn.server.applicationhistoryservice.webapp.TestAHSWebApp | |
| hadoop.yarn.server.resourcemanager.webapp.TestRMWebApp | |
| hadoop.yarn.server.resourcemanager.TestAMAuthorization | |
| hadoop.yarn.server.resourcemanager.TestClientRMTokens | |
| hadoop.mapreduce.v2.app.TestMRAppMaster |
This message was automatically generated.
Attaching same patch again to invoke Jenkins.
| -1 overall |
| Vote | Subsystem | Runtime | Comment |
|---|---|---|---|
| 0 | reexec | 0m 0s | Docker mode activated. |
| +1 | @author | 0m 0s | The patch does not contain any @author tags. |
| +1 | test4tests | 0m 0s | The patch appears to include 2 new or modified test files. |
| +1 | mvninstall | 9m 26s | trunk passed |
| +1 | compile | 11m 18s | trunk passed with JDK v1.8.0_66 |
| +1 | compile | 10m 13s | trunk passed with JDK v1.7.0_85 |
| +1 | checkstyle | 1m 7s | trunk passed |
| +1 | mvnsite | 3m 11s | trunk passed |
| +1 | mvneclipse | 1m 28s | trunk passed |
| -1 | findbugs | 1m 29s | hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common in trunk has 3 extant Findbugs warnings. |
| +1 | javadoc | 2m 17s | trunk passed with JDK v1.8.0_66 |
| +1 | javadoc | 2m 34s | trunk passed with JDK v1.7.0_85 |
| +1 | mvninstall | 2m 56s | the patch passed |
| +1 | compile | 9m 37s | the patch passed with JDK v1.8.0_66 |
| +1 | javac | 9m 37s | the patch passed |
| +1 | compile | 10m 7s | the patch passed with JDK v1.7.0_85 |
| +1 | javac | 10m 7s | the patch passed |
| +1 | checkstyle | 1m 10s | the patch passed |
| +1 | mvnsite | 3m 27s | the patch passed |
| +1 | mvneclipse | 1m 32s | the patch passed |
| +1 | whitespace | 0m 0s | Patch has no whitespace issues. |
| +1 | findbugs | 8m 5s | the patch passed |
| +1 | javadoc | 2m 33s | the patch passed with JDK v1.8.0_66 |
| +1 | javadoc | 2m 50s | the patch passed with JDK v1.7.0_85 |
| -1 | unit | 2m 22s | hadoop-yarn-common in the patch failed with JDK v1.8.0_66. |
| +1 | unit | 4m 14s | hadoop-yarn-server-applicationhistoryservice in the patch passed with JDK v1.8.0_66. |
| +1 | unit | 0m 29s | hadoop-yarn-server-common in the patch passed with JDK v1.8.0_66. |
| +1 | unit | 9m 36s | hadoop-yarn-server-nodemanager in the patch passed with JDK v1.8.0_66. |
| -1 | unit | 67m 33s | hadoop-yarn-server-resourcemanager in the patch failed with JDK v1.8.0_66. |
| -1 | unit | 9m 55s | hadoop-mapreduce-client-app in the patch failed with JDK v1.8.0_66. |
| -1 | unit | 2m 20s | hadoop-yarn-common in the patch failed with JDK v1.7.0_85. |
| +1 | unit | 4m 7s | hadoop-yarn-server-applicationhistoryservice in the patch passed with JDK v1.7.0_85. |
| +1 | unit | 0m 30s | hadoop-yarn-server-common in the patch passed with JDK v1.7.0_85. |
| +1 | unit | 9m 32s | hadoop-yarn-server-nodemanager in the patch passed with JDK v1.7.0_85. |
| -1 | unit | 67m 5s | hadoop-yarn-server-resourcemanager in the patch failed with JDK v1.7.0_85. |
| -1 | unit | 10m 22s | hadoop-mapreduce-client-app in the patch failed with JDK v1.7.0_85. |
| -1 | asflicense | 0m 27s | Patch generated 7 ASF License warnings. |
| 281m 6s |
| Reason | Tests |
|---|---|
| JDK v1.8.0_66 Failed junit tests | hadoop.yarn.webapp.TestWebApp |
| hadoop.yarn.server.resourcemanager.TestClientRMTokens | |
| hadoop.yarn.server.resourcemanager.TestAMAuthorization | |
| hadoop.yarn.server.resourcemanager.scheduler.fair.TestFairScheduler | |
| hadoop.mapreduce.v2.app.TestMRAppMaster | |
| JDK v1.7.0_85 Failed junit tests | hadoop.yarn.webapp.TestWebApp |
| hadoop.yarn.server.resourcemanager.TestClientRMTokens | |
| hadoop.yarn.server.resourcemanager.TestAMAuthorization | |
| hadoop.mapreduce.v2.app.TestMRAppMaster |
This message was automatically generated.
Jian He / Jason Lowe, kindly review.
Test failures unrelated.
Raised YARN-4379 and MAPREDUCE-6555 for 2 of the failures. For others, JIRA exist as well.
Findbugs warnings are unrelated as well. Had raised YARN-4298 for it earlier.
I have only changed the javascript file(natural.js). Rewrote the logic for natural sort from scratch keeping in mind the way our application ids', attempt ids', task ids', etc. are.
Other code is exactly the same as what Shahid had written.
Added an image to show sorted app ids' with the script in the patch
Jian He, kindly review.
Mohammad Shahid Khan, probably you can have a look as well.
latest patch looks good to me, thanks Varun Saxena,
+1
Latest path looks good to me, thanks Varun Saxena, for handling the performance issue
FAILURE: Integrated in Hadoop-trunk-Commit #8914 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8914/)
YARN-3840. Resource Manager web ui issue when sorting application by id (jianhe: rev 9f77ccad735f4843ce2c38355de9f434838d4507)
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/AppAttemptPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/AllApplicationsPage.java
- hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/TasksPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/AllContainersPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/TestAHSWebApp.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/AppPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/webapp/view/JQueryUI.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/static/dt-sorting/natural.js
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebApp.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebPageUtils.java
- hadoop-yarn-project/CHANGES.txt
- hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/TaskPage.java
Committed to trunk, branch-2, branch-2.7
thanks Varun Saxena !
ABORTED: Integrated in Hadoop-Hdfs-trunk-Java8 #662 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/662/)
YARN-3840. Resource Manager web ui issue when sorting application by id (jianhe: rev 9f77ccad735f4843ce2c38355de9f434838d4507)
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/static/dt-sorting/natural.js
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/webapp/view/JQueryUI.java
- hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/TaskPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebPageUtils.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/AppPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebApp.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/AllApplicationsPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/TestAHSWebApp.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/AppAttemptPage.java
- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/AllContainersPage.java
- hadoop-yarn-project/CHANGES.txt
- hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/TasksPage.java
Thanks Jian He for the commit.
Reopening the issue since commit has missed in branch-2.8.
Since this JIRA adds natural.js file which was not committed in branch-2.8, and its dependency JIRA were failing in regression. see MAPREDUCE-6700
Renamed the patch and submitted.
Thanks Varun!! Patch apply cleanly in branch-2.8. Before committing I will wait for Jenkins to run to make sure everything works fine in branch-2.8
| -1 overall |
| Vote | Subsystem | Runtime | Comment |
|---|---|---|---|
| 0 | reexec | 0m 16s | Docker mode activated. |
| +1 | @author | 0m 0s | The patch does not contain any @author tags. |
| +1 | test4tests | 0m 0s | The patch appears to include 2 new or modified test files. |
| 0 | mvndep | 9m 30s | Maven dependency ordering for branch |
| +1 | mvninstall | 7m 48s | branch-2.8 passed |
| +1 | compile | 7m 37s | branch-2.8 passed with JDK v1.8.0_91 |
| +1 | compile | 7m 15s | branch-2.8 passed with JDK v1.7.0_101 |
| +1 | checkstyle | 1m 11s | branch-2.8 passed |
| +1 | mvnsite | 3m 12s | branch-2.8 passed |
| +1 | mvneclipse | 1m 21s | branch-2.8 passed |
| +1 | findbugs | 5m 29s | branch-2.8 passed |
| +1 | javadoc | 2m 13s | branch-2.8 passed with JDK v1.8.0_91 |
| +1 | javadoc | 2m 22s | branch-2.8 passed with JDK v1.7.0_101 |
| 0 | mvndep | 0m 14s | Maven dependency ordering for patch |
| +1 | mvninstall | 2m 27s | the patch passed |
| +1 | compile | 7m 41s | the patch passed with JDK v1.8.0_91 |
| +1 | javac | 7m 41s | the patch passed |
| +1 | compile | 7m 12s | the patch passed with JDK v1.7.0_101 |
| +1 | javac | 7m 12s | the patch passed |
| +1 | checkstyle | 1m 6s | root: patch generated 0 new + 50 unchanged - 7 fixed = 50 total (was 57) |
| +1 | mvnsite | 2m 47s | the patch passed |
| +1 | mvneclipse | 1m 16s | the patch passed |
| +1 | whitespace | 0m 0s | Patch has no whitespace issues. |
| +1 | findbugs | 6m 36s | the patch passed |
| +1 | javadoc | 2m 13s | the patch passed with JDK v1.8.0_91 |
| +1 | javadoc | 2m 21s | the patch passed with JDK v1.7.0_101 |
| +1 | unit | 2m 14s | hadoop-yarn-common in the patch passed with JDK v1.8.0_91. |
| +1 | unit | 0m 24s | hadoop-yarn-server-common in the patch passed with JDK v1.8.0_91. |
| -1 | unit | 9m 15s | hadoop-yarn-server-nodemanager in the patch failed with JDK v1.8.0_91. |
| -1 | unit | 3m 4s | hadoop-yarn-server-applicationhistoryservice in the patch failed with JDK v1.8.0_91. |
| -1 | unit | 65m 43s | hadoop-yarn-server-resourcemanager in the patch failed with JDK v1.8.0_91. |
| +1 | unit | 9m 13s | hadoop-mapreduce-client-app in the patch passed with JDK v1.8.0_91. |
| +1 | unit | 2m 25s | hadoop-yarn-common in the patch passed with JDK v1.7.0_101. |
| +1 | unit | 0m 26s | hadoop-yarn-server-common in the patch passed with JDK v1.7.0_101. |
| -1 | unit | 9m 37s | hadoop-yarn-server-nodemanager in the patch failed with JDK v1.7.0_101. |
| -1 | unit | 3m 14s | hadoop-yarn-server-applicationhistoryservice in the patch failed with JDK v1.7.0_101. |
| -1 | unit | 66m 45s | hadoop-yarn-server-resourcemanager in the patch failed with JDK v1.7.0_101. |
| +1 | unit | 9m 29s | hadoop-mapreduce-client-app in the patch passed with JDK v1.7.0_101. |
| +1 | asflicense | 0m 23s | Patch does not generate ASF License warnings. |
| 266m 26s |
| Reason | Tests |
|---|---|
| JDK v1.8.0_91 Failed junit tests | hadoop.yarn.server.nodemanager.containermanager.TestNMProxy |
| hadoop.yarn.server.applicationhistoryservice.TestFileSystemApplicationHistoryStore | |
| hadoop.yarn.server.resourcemanager.TestAMAuthorization | |
| hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesApps | |
| hadoop.yarn.server.resourcemanager.TestClientRMTokens | |
| JDK v1.7.0_101 Failed junit tests | hadoop.yarn.server.nodemanager.containermanager.TestNMProxy |
| hadoop.yarn.server.applicationhistoryservice.TestFileSystemApplicationHistoryStore | |
| hadoop.yarn.server.resourcemanager.TestAMAuthorization | |
| hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesApps | |
| hadoop.yarn.server.resourcemanager.TestClientRMTokens |
This message was automatically generated.
| -1 overall |
| Vote | Subsystem | Runtime | Comment |
|---|---|---|---|
| 0 | reexec | 0m 17s | Docker mode activated. |
| +1 | @author | 0m 0s | The patch does not contain any @author tags. |
| +1 | test4tests | 0m 0s | The patch appears to include 2 new or modified test files. |
| 0 | mvndep | 2m 2s | Maven dependency ordering for branch |
| +1 | mvninstall | 7m 1s | branch-2.8 passed |
| +1 | compile | 7m 29s | branch-2.8 passed with JDK v1.8.0_91 |
| +1 | compile | 7m 6s | branch-2.8 passed with JDK v1.7.0_101 |
| +1 | checkstyle | 1m 6s | branch-2.8 passed |
| +1 | mvnsite | 2m 48s | branch-2.8 passed |
| +1 | mvneclipse | 1m 16s | branch-2.8 passed |
| +1 | findbugs | 5m 21s | branch-2.8 passed |
| +1 | javadoc | 2m 15s | branch-2.8 passed with JDK v1.8.0_91 |
| +1 | javadoc | 2m 17s | branch-2.8 passed with JDK v1.7.0_101 |
| 0 | mvndep | 0m 14s | Maven dependency ordering for patch |
| +1 | mvninstall | 2m 28s | the patch passed |
| +1 | compile | 7m 40s | the patch passed with JDK v1.8.0_91 |
| +1 | javac | 7m 40s | the patch passed |
| +1 | compile | 7m 10s | the patch passed with JDK v1.7.0_101 |
| +1 | javac | 7m 10s | the patch passed |
| +1 | checkstyle | 1m 4s | root: patch generated 0 new + 50 unchanged - 7 fixed = 50 total (was 57) |
| +1 | mvnsite | 2m 47s | the patch passed |
| +1 | mvneclipse | 1m 16s | the patch passed |
| +1 | whitespace | 0m 0s | Patch has no whitespace issues. |
| +1 | findbugs | 6m 42s | the patch passed |
| +1 | javadoc | 2m 10s | the patch passed with JDK v1.8.0_91 |
| +1 | javadoc | 2m 20s | the patch passed with JDK v1.7.0_101 |
| +1 | unit | 2m 15s | hadoop-yarn-common in the patch passed with JDK v1.8.0_91. |
| +1 | unit | 0m 22s | hadoop-yarn-server-common in the patch passed with JDK v1.8.0_91. |
| -1 | unit | 9m 14s | hadoop-yarn-server-nodemanager in the patch failed with JDK v1.8.0_91. |
| -1 | unit | 3m 5s | hadoop-yarn-server-applicationhistoryservice in the patch failed with JDK v1.8.0_91. |
| -1 | unit | 65m 38s | hadoop-yarn-server-resourcemanager in the patch failed with JDK v1.8.0_91. |
| +1 | unit | 9m 16s | hadoop-mapreduce-client-app in the patch passed with JDK v1.8.0_91. |
| +1 | unit | 2m 24s | hadoop-yarn-common in the patch passed with JDK v1.7.0_101. |
| +1 | unit | 0m 26s | hadoop-yarn-server-common in the patch passed with JDK v1.7.0_101. |
| -1 | unit | 9m 40s | hadoop-yarn-server-nodemanager in the patch failed with JDK v1.7.0_101. |
| -1 | unit | 3m 14s | hadoop-yarn-server-applicationhistoryservice in the patch failed with JDK v1.7.0_101. |
| -1 | unit | 66m 35s | hadoop-yarn-server-resourcemanager in the patch failed with JDK v1.7.0_101. |
| +1 | unit | 9m 33s | hadoop-mapreduce-client-app in the patch passed with JDK v1.7.0_101. |
| +1 | asflicense | 0m 21s | Patch does not generate ASF License warnings. |
| 257m 0s |
| Reason | Tests |
|---|---|
| JDK v1.8.0_91 Failed junit tests | hadoop.yarn.server.nodemanager.containermanager.TestNMProxy |
| hadoop.yarn.server.applicationhistoryservice.TestFileSystemApplicationHistoryStore | |
| hadoop.yarn.server.resourcemanager.TestAMAuthorization | |
| hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesApps | |
| hadoop.yarn.server.resourcemanager.TestClientRMTokens | |
| JDK v1.7.0_101 Failed junit tests | hadoop.yarn.server.nodemanager.containermanager.localizer.TestResourceLocalizationService |
| hadoop.yarn.server.nodemanager.containermanager.TestNMProxy | |
| hadoop.yarn.server.applicationhistoryservice.TestFileSystemApplicationHistoryStore | |
| hadoop.yarn.server.resourcemanager.TestAMAuthorization | |
| hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesApps | |
| hadoop.yarn.server.resourcemanager.TestClientRMTokens |
This message was automatically generated.
| -1 overall |
| Vote | Subsystem | Runtime | Comment |
|---|---|---|---|
| 0 | reexec | 0m 18s | Docker mode activated. |
| +1 | @author | 0m 0s | The patch does not contain any @author tags. |
| +1 | test4tests | 0m 0s | The patch appears to include 2 new or modified test files. |
| 0 | mvndep | 3m 0s | Maven dependency ordering for branch |
| +1 | mvninstall | 7m 32s | branch-2.8 passed |
| +1 | compile | 7m 11s | branch-2.8 passed with JDK v1.8.0_74 |
| +1 | compile | 6m 57s | branch-2.8 passed with JDK v1.7.0_95 |
| +1 | checkstyle | 1m 11s | branch-2.8 passed |
| +1 | mvnsite | 2m 47s | branch-2.8 passed |
| +1 | mvneclipse | 1m 23s | branch-2.8 passed |
| +1 | findbugs | 5m 18s | branch-2.8 passed |
| +1 | javadoc | 2m 7s | branch-2.8 passed with JDK v1.8.0_74 |
| +1 | javadoc | 2m 30s | branch-2.8 passed with JDK v1.7.0_95 |
| 0 | mvndep | 0m 14s | Maven dependency ordering for patch |
| +1 | mvninstall | 2m 25s | the patch passed |
| +1 | compile | 6m 23s | the patch passed with JDK v1.8.0_74 |
| +1 | javac | 6m 23s | the patch passed |
| +1 | compile | 7m 9s | the patch passed with JDK v1.7.0_95 |
| +1 | javac | 7m 9s | the patch passed |
| +1 | checkstyle | 1m 4s | root: patch generated 0 new + 51 unchanged - 7 fixed = 51 total (was 58) |
| +1 | mvnsite | 2m 50s | the patch passed |
| +1 | mvneclipse | 1m 21s | the patch passed |
| +1 | whitespace | 0m 0s | Patch has no whitespace issues. |
| +1 | findbugs | 6m 41s | the patch passed |
| +1 | javadoc | 2m 19s | the patch passed with JDK v1.8.0_74 |
| +1 | javadoc | 2m 37s | the patch passed with JDK v1.7.0_95 |
| +1 | unit | 2m 24s | hadoop-yarn-common in the patch passed with JDK v1.8.0_74. |
| +1 | unit | 0m 27s | hadoop-yarn-server-common in the patch passed with JDK v1.8.0_74. |
| -1 | unit | 9m 54s | hadoop-yarn-server-nodemanager in the patch failed with JDK v1.8.0_74. |
| -1 | unit | 4m 26s | hadoop-yarn-server-applicationhistoryservice in the patch failed with JDK v1.8.0_74. |
| -1 | unit | 74m 32s | hadoop-yarn-server-resourcemanager in the patch failed with JDK v1.8.0_74. |
| +1 | unit | 8m 52s | hadoop-mapreduce-client-app in the patch passed with JDK v1.8.0_74. |
| +1 | unit | 2m 22s | hadoop-yarn-common in the patch passed with JDK v1.7.0_95. |
| +1 | unit | 0m 27s | hadoop-yarn-server-common in the patch passed with JDK v1.7.0_95. |
| -1 | unit | 9m 44s | hadoop-yarn-server-nodemanager in the patch failed with JDK v1.7.0_95. |
| -1 | unit | 3m 53s | hadoop-yarn-server-applicationhistoryservice in the patch failed with JDK v1.7.0_95. |
| -1 | unit | 71m 26s | hadoop-yarn-server-resourcemanager in the patch failed with JDK v1.7.0_95. |
| +1 | unit | 9m 38s | hadoop-mapreduce-client-app in the patch passed with JDK v1.7.0_95. |
| +1 | asflicense | 0m 22s | Patch does not generate ASF License warnings. |
| 274m 8s |
| Reason | Tests |
|---|---|
| JDK v1.8.0_74 Failed junit tests | hadoop.yarn.server.nodemanager.containermanager.TestNMProxy |
| hadoop.yarn.server.applicationhistoryservice.TestFileSystemApplicationHistoryStore | |
| hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesApps | |
| hadoop.yarn.server.resourcemanager.TestClientRMTokens | |
| hadoop.yarn.server.resourcemanager.TestAMAuthorization | |
| JDK v1.7.0_95 Failed junit tests | hadoop.yarn.server.nodemanager.containermanager.TestNMProxy |
| hadoop.yarn.server.applicationhistoryservice.TestFileSystemApplicationHistoryStore | |
| hadoop.yarn.server.resourcemanager.scheduler.fair.TestFairScheduler | |
| hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesApps | |
| hadoop.yarn.server.resourcemanager.TestResourceTrackerService | |
| hadoop.yarn.server.resourcemanager.TestClientRMTokens | |
| hadoop.yarn.server.resourcemanager.TestAMAuthorization |
This message was automatically generated.
At first glance, test failures looks not related!! Varun Saxena / Bibin A Chundatt would you also confirm QA result?
Myself cross verified the test cases, these are not related to current patch. Committing shortly!!
committed to branch-2.8!! thanks Varun for providing patch!! and Bibin for finding a issue in regression!!
Closing the JIRA as part of 2.7.3 release.
Thanks LINTE for reporting the issue.
Can you paste the exception if you see anything in the RM UI or in the RM logs?