Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-4742 [Umbrella] Enhancements to Distributed Scheduling
  3. YARN-2995

Enhance UI to show cluster resource utilization of various container Execution types

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.9.0, 3.0.0-alpha2
    • Component/s: resourcemanager
    • Labels:
      None

      Description

      This JIRA proposes to extend the Resource manager UI to show how cluster resources are being used to run guaranteed start and queueable containers. For example, a graph that shows over time, the fraction of running containers that are guaranteed start and the fraction of running containers that are queueable.

      1. all-nodes.png
        452 kB
        Konstantinos Karanasos
      2. all-nodes.png
        452 kB
        Konstantinos Karanasos
      3. opp-container.png
        116 kB
        Konstantinos Karanasos
      4. YARN-2995.001.patch
        53 kB
        Konstantinos Karanasos
      5. YARN-2995.002.patch
        65 kB
        Konstantinos Karanasos
      6. YARN-2995.003.patch
        75 kB
        Konstantinos Karanasos
      7. YARN-2995.004.patch
        77 kB
        Konstantinos Karanasos

        Activity

        Hide
        kkaranasos Konstantinos Karanasos added a comment -

        Adding first version of the patch.

        Show
        kkaranasos Konstantinos Karanasos added a comment - Adding first version of the patch.
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 13s Docker mode activated.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 3 new or modified test files.
        0 mvndep 0m 14s Maven dependency ordering for branch
        +1 mvninstall 7m 8s trunk passed
        +1 compile 7m 16s trunk passed
        +1 checkstyle 1m 30s trunk passed
        +1 mvnsite 1m 53s trunk passed
        +1 mvneclipse 1m 0s trunk passed
        +1 findbugs 2m 50s trunk passed
        +1 javadoc 1m 10s trunk passed
        0 mvndep 0m 14s Maven dependency ordering for patch
        +1 mvninstall 1m 29s the patch passed
        +1 compile 7m 6s the patch passed
        +1 cc 7m 6s the patch passed
        +1 javac 7m 6s the patch passed
        -1 checkstyle 1m 32s root: The patch generated 12 new + 226 unchanged - 1 fixed = 238 total (was 227)
        +1 mvnsite 1m 49s the patch passed
        +1 mvneclipse 0m 59s the patch passed
        +1 whitespace 0m 0s The patch has no whitespace issues.
        +1 findbugs 3m 10s the patch passed
        +1 javadoc 1m 6s the patch passed
        +1 unit 0m 27s hadoop-yarn-server-common in the patch passed.
        +1 unit 15m 14s hadoop-yarn-server-nodemanager in the patch passed.
        -1 unit 35m 42s hadoop-yarn-server-resourcemanager in the patch failed.
        +1 unit 1m 0s hadoop-sls in the patch passed.
        +1 asflicense 0m 21s The patch does not generate ASF License warnings.
        94m 32s



        Reason Tests
        Failed junit tests hadoop.yarn.server.resourcemanager.webapp.TestRMWebApp
          hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesNodes
          hadoop.yarn.server.resourcemanager.webapp.TestNodesPage



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:9560f25
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12830805/YARN-2995.001.patch
        JIRA Issue YARN-2995
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle cc
        uname Linux f0e0b7457c64 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / 44f48ee
        Default Java 1.8.0_101
        findbugs v3.0.0
        checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/13281/artifact/patchprocess/diff-checkstyle-root.txt
        unit https://builds.apache.org/job/PreCommit-YARN-Build/13281/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
        unit test logs https://builds.apache.org/job/PreCommit-YARN-Build/13281/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
        Test Results https://builds.apache.org/job/PreCommit-YARN-Build/13281/testReport/
        modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager hadoop-tools/hadoop-sls U: .
        Console output https://builds.apache.org/job/PreCommit-YARN-Build/13281/console
        Powered by Apache Yetus 0.3.0 http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 13s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 3 new or modified test files. 0 mvndep 0m 14s Maven dependency ordering for branch +1 mvninstall 7m 8s trunk passed +1 compile 7m 16s trunk passed +1 checkstyle 1m 30s trunk passed +1 mvnsite 1m 53s trunk passed +1 mvneclipse 1m 0s trunk passed +1 findbugs 2m 50s trunk passed +1 javadoc 1m 10s trunk passed 0 mvndep 0m 14s Maven dependency ordering for patch +1 mvninstall 1m 29s the patch passed +1 compile 7m 6s the patch passed +1 cc 7m 6s the patch passed +1 javac 7m 6s the patch passed -1 checkstyle 1m 32s root: The patch generated 12 new + 226 unchanged - 1 fixed = 238 total (was 227) +1 mvnsite 1m 49s the patch passed +1 mvneclipse 0m 59s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 findbugs 3m 10s the patch passed +1 javadoc 1m 6s the patch passed +1 unit 0m 27s hadoop-yarn-server-common in the patch passed. +1 unit 15m 14s hadoop-yarn-server-nodemanager in the patch passed. -1 unit 35m 42s hadoop-yarn-server-resourcemanager in the patch failed. +1 unit 1m 0s hadoop-sls in the patch passed. +1 asflicense 0m 21s The patch does not generate ASF License warnings. 94m 32s Reason Tests Failed junit tests hadoop.yarn.server.resourcemanager.webapp.TestRMWebApp   hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesNodes   hadoop.yarn.server.resourcemanager.webapp.TestNodesPage Subsystem Report/Notes Docker Image:yetus/hadoop:9560f25 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12830805/YARN-2995.001.patch JIRA Issue YARN-2995 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle cc uname Linux f0e0b7457c64 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 44f48ee Default Java 1.8.0_101 findbugs v3.0.0 checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/13281/artifact/patchprocess/diff-checkstyle-root.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/13281/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt unit test logs https://builds.apache.org/job/PreCommit-YARN-Build/13281/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/13281/testReport/ modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager hadoop-tools/hadoop-sls U: . Console output https://builds.apache.org/job/PreCommit-YARN-Build/13281/console Powered by Apache Yetus 0.3.0 http://yetus.apache.org This message was automatically generated.
        Hide
        asuresh Arun Suresh added a comment -

        Thanks for the patch Konstantinos Karanasos

        Couple of comments:

        • Can we add javadoc for all the methods in OpportunisticContainersStatus.
        • opport_cores_used can be int32 instead of int64.
        • rename RMNodeStatusEvent::getContainerQueueInfo to getOpportunisticContainersInfo()
        Show
        asuresh Arun Suresh added a comment - Thanks for the patch Konstantinos Karanasos Couple of comments: Can we add javadoc for all the methods in OpportunisticContainersStatus . opport_cores_used can be int32 instead of int64. rename RMNodeStatusEvent::getContainerQueueInfo to getOpportunisticContainersInfo()
        Hide
        kkaranasos Konstantinos Karanasos added a comment -

        Uploading new version of the patch.
        Rebasing against trunk, addressing Arun Suresh's comments, fixing existing test cases, adding new test cases.

        Show
        kkaranasos Konstantinos Karanasos added a comment - Uploading new version of the patch. Rebasing against trunk, addressing Arun Suresh 's comments, fixing existing test cases, adding new test cases.
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 16s Docker mode activated.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 6 new or modified test files.
        0 mvndep 1m 32s Maven dependency ordering for branch
        +1 mvninstall 6m 40s trunk passed
        +1 compile 6m 54s trunk passed
        +1 checkstyle 1m 31s trunk passed
        +1 mvnsite 1m 50s trunk passed
        +1 mvneclipse 1m 0s trunk passed
        +1 findbugs 2m 50s trunk passed
        +1 javadoc 1m 15s trunk passed
        0 mvndep 0m 17s Maven dependency ordering for patch
        +1 mvninstall 1m 37s the patch passed
        +1 compile 6m 51s the patch passed
        +1 cc 6m 51s the patch passed
        +1 javac 6m 51s the patch passed
        -0 checkstyle 1m 34s root: The patch generated 13 new + 289 unchanged - 3 fixed = 302 total (was 292)
        +1 mvnsite 2m 3s the patch passed
        +1 mvneclipse 1m 14s the patch passed
        +1 whitespace 0m 0s The patch has no whitespace issues.
        +1 findbugs 3m 43s the patch passed
        +1 javadoc 1m 30s the patch passed
        +1 unit 0m 37s hadoop-yarn-server-common in the patch passed.
        +1 unit 15m 36s hadoop-yarn-server-nodemanager in the patch passed.
        -1 unit 36m 3s hadoop-yarn-server-resourcemanager in the patch failed.
        +1 unit 1m 4s hadoop-sls in the patch passed.
        +1 asflicense 0m 27s The patch does not generate ASF License warnings.
        120m 14s



        Reason Tests
        Failed junit tests hadoop.yarn.server.resourcemanager.TestRMRestart



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:9560f25
        JIRA Issue YARN-2995
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12835465/YARN-2995.002.patch
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle cc
        uname Linux af516a94a785 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / 9f32364
        Default Java 1.8.0_101
        findbugs v3.0.0
        checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/13530/artifact/patchprocess/diff-checkstyle-root.txt
        unit https://builds.apache.org/job/PreCommit-YARN-Build/13530/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
        Test Results https://builds.apache.org/job/PreCommit-YARN-Build/13530/testReport/
        modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager hadoop-tools/hadoop-sls U: .
        Console output https://builds.apache.org/job/PreCommit-YARN-Build/13530/console
        Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 16s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 6 new or modified test files. 0 mvndep 1m 32s Maven dependency ordering for branch +1 mvninstall 6m 40s trunk passed +1 compile 6m 54s trunk passed +1 checkstyle 1m 31s trunk passed +1 mvnsite 1m 50s trunk passed +1 mvneclipse 1m 0s trunk passed +1 findbugs 2m 50s trunk passed +1 javadoc 1m 15s trunk passed 0 mvndep 0m 17s Maven dependency ordering for patch +1 mvninstall 1m 37s the patch passed +1 compile 6m 51s the patch passed +1 cc 6m 51s the patch passed +1 javac 6m 51s the patch passed -0 checkstyle 1m 34s root: The patch generated 13 new + 289 unchanged - 3 fixed = 302 total (was 292) +1 mvnsite 2m 3s the patch passed +1 mvneclipse 1m 14s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 findbugs 3m 43s the patch passed +1 javadoc 1m 30s the patch passed +1 unit 0m 37s hadoop-yarn-server-common in the patch passed. +1 unit 15m 36s hadoop-yarn-server-nodemanager in the patch passed. -1 unit 36m 3s hadoop-yarn-server-resourcemanager in the patch failed. +1 unit 1m 4s hadoop-sls in the patch passed. +1 asflicense 0m 27s The patch does not generate ASF License warnings. 120m 14s Reason Tests Failed junit tests hadoop.yarn.server.resourcemanager.TestRMRestart Subsystem Report/Notes Docker Image:yetus/hadoop:9560f25 JIRA Issue YARN-2995 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12835465/YARN-2995.002.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle cc uname Linux af516a94a785 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 9f32364 Default Java 1.8.0_101 findbugs v3.0.0 checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/13530/artifact/patchprocess/diff-checkstyle-root.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/13530/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/13530/testReport/ modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager hadoop-tools/hadoop-sls U: . Console output https://builds.apache.org/job/PreCommit-YARN-Build/13530/console Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
        Hide
        asuresh Arun Suresh added a comment -

        Konstantinos Karanasos, thanks for updating the patch.
        Can you confirm the test failure is un-related. Also, Can you maybe paste a screen shot of the new web-UI ?

        +1 pending the above.

        Show
        asuresh Arun Suresh added a comment - Konstantinos Karanasos , thanks for updating the patch. Can you confirm the test failure is un-related. Also, Can you maybe paste a screen shot of the new web-UI ? +1 pending the above.
        Hide
        kkaranasos Konstantinos Karanasos added a comment -

        Adding new version of the patch.
        Fixed some more problems, the checkstyle issues, and added the execution type information at the container's page.
        The unit test that was failing looks unrelated.

        Show
        kkaranasos Konstantinos Karanasos added a comment - Adding new version of the patch. Fixed some more problems, the checkstyle issues, and added the execution type information at the container's page. The unit test that was failing looks unrelated.
        Hide
        kkaranasos Konstantinos Karanasos added a comment -

        Attaching two screenshots. The one is from the nodes page, showing an instance of the cluster with both guaranteed and opportunistic containers running, as well as some additional containers queued at the node.
        The second shows the details of a specific container, where the execution type is added ("OPPORTUNISTIC" in the specific case).

        Show
        kkaranasos Konstantinos Karanasos added a comment - Attaching two screenshots. The one is from the nodes page, showing an instance of the cluster with both guaranteed and opportunistic containers running, as well as some additional containers queued at the node. The second shows the details of a specific container, where the execution type is added ("OPPORTUNISTIC" in the specific case).
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 18s Docker mode activated.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 6 new or modified test files.
        0 mvndep 0m 15s Maven dependency ordering for branch
        +1 mvninstall 6m 46s trunk passed
        +1 compile 6m 56s trunk passed
        +1 checkstyle 1m 31s trunk passed
        +1 mvnsite 2m 20s trunk passed
        +1 mvneclipse 1m 18s trunk passed
        +1 findbugs 3m 25s trunk passed
        +1 javadoc 1m 34s trunk passed
        0 mvndep 0m 17s Maven dependency ordering for patch
        +1 mvninstall 2m 1s the patch passed
        +1 compile 6m 52s the patch passed
        +1 cc 6m 52s the patch passed
        +1 javac 6m 52s the patch passed
        -0 checkstyle 1m 35s root: The patch generated 2 new + 411 unchanged - 6 fixed = 413 total (was 417)
        +1 mvnsite 2m 35s the patch passed
        +1 mvneclipse 1m 33s the patch passed
        +1 whitespace 0m 0s The patch has no whitespace issues.
        +1 findbugs 4m 19s the patch passed
        -1 javadoc 0m 22s hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager generated 1 new + 235 unchanged - 0 fixed = 236 total (was 235)
        +1 unit 0m 32s hadoop-yarn-server-common in the patch passed.
        -1 unit 14m 57s hadoop-yarn-server-nodemanager in the patch failed.
        -1 unit 38m 43s hadoop-yarn-server-resourcemanager in the patch failed.
        +1 unit 8m 40s hadoop-mapreduce-client-app in the patch passed.
        +1 unit 1m 1s hadoop-sls in the patch passed.
        +1 asflicense 0m 28s The patch does not generate ASF License warnings.
        133m 57s



        Reason Tests
        Failed junit tests hadoop.yarn.server.nodemanager.webapp.TestNMWebServicesContainers
          hadoop.yarn.server.nodemanager.containermanager.queuing.TestQueuingContainerManager
          hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesNodes



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:9560f25
        JIRA Issue YARN-2995
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12836274/YARN-2995.003.patch
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle cc
        uname Linux 5a1c4816ade6 3.13.0-95-generic #142-Ubuntu SMP Fri Aug 12 17:00:09 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / 7ba74be
        Default Java 1.8.0_101
        findbugs v3.0.0
        checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/13714/artifact/patchprocess/diff-checkstyle-root.txt
        javadoc https://builds.apache.org/job/PreCommit-YARN-Build/13714/artifact/patchprocess/diff-javadoc-javadoc-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager.txt
        unit https://builds.apache.org/job/PreCommit-YARN-Build/13714/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager.txt
        unit https://builds.apache.org/job/PreCommit-YARN-Build/13714/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
        Test Results https://builds.apache.org/job/PreCommit-YARN-Build/13714/testReport/
        modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app hadoop-tools/hadoop-sls U: .
        Console output https://builds.apache.org/job/PreCommit-YARN-Build/13714/console
        Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 18s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 6 new or modified test files. 0 mvndep 0m 15s Maven dependency ordering for branch +1 mvninstall 6m 46s trunk passed +1 compile 6m 56s trunk passed +1 checkstyle 1m 31s trunk passed +1 mvnsite 2m 20s trunk passed +1 mvneclipse 1m 18s trunk passed +1 findbugs 3m 25s trunk passed +1 javadoc 1m 34s trunk passed 0 mvndep 0m 17s Maven dependency ordering for patch +1 mvninstall 2m 1s the patch passed +1 compile 6m 52s the patch passed +1 cc 6m 52s the patch passed +1 javac 6m 52s the patch passed -0 checkstyle 1m 35s root: The patch generated 2 new + 411 unchanged - 6 fixed = 413 total (was 417) +1 mvnsite 2m 35s the patch passed +1 mvneclipse 1m 33s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 findbugs 4m 19s the patch passed -1 javadoc 0m 22s hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager generated 1 new + 235 unchanged - 0 fixed = 236 total (was 235) +1 unit 0m 32s hadoop-yarn-server-common in the patch passed. -1 unit 14m 57s hadoop-yarn-server-nodemanager in the patch failed. -1 unit 38m 43s hadoop-yarn-server-resourcemanager in the patch failed. +1 unit 8m 40s hadoop-mapreduce-client-app in the patch passed. +1 unit 1m 1s hadoop-sls in the patch passed. +1 asflicense 0m 28s The patch does not generate ASF License warnings. 133m 57s Reason Tests Failed junit tests hadoop.yarn.server.nodemanager.webapp.TestNMWebServicesContainers   hadoop.yarn.server.nodemanager.containermanager.queuing.TestQueuingContainerManager   hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesNodes Subsystem Report/Notes Docker Image:yetus/hadoop:9560f25 JIRA Issue YARN-2995 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12836274/YARN-2995.003.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle cc uname Linux 5a1c4816ade6 3.13.0-95-generic #142-Ubuntu SMP Fri Aug 12 17:00:09 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 7ba74be Default Java 1.8.0_101 findbugs v3.0.0 checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/13714/artifact/patchprocess/diff-checkstyle-root.txt javadoc https://builds.apache.org/job/PreCommit-YARN-Build/13714/artifact/patchprocess/diff-javadoc-javadoc-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/13714/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/13714/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/13714/testReport/ modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app hadoop-tools/hadoop-sls U: . Console output https://builds.apache.org/job/PreCommit-YARN-Build/13714/console Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
        Hide
        kkaranasos Konstantinos Karanasos added a comment -

        Attaching new screenshot after some final fixes.

        Show
        kkaranasos Konstantinos Karanasos added a comment - Attaching new screenshot after some final fixes.
        Hide
        kkaranasos Konstantinos Karanasos added a comment -

        Adding new version of the patch.
        Rebased against trunk, fixed some more issues, and addressed the unit test failures.

        Note that there is a javadoc issue regarding using '_' as an identifier" (related to Java 8). I did not fix that, because it is actually used in multiple classes in the Web UI, and I followed the same style as in the rest of the code. I assume this should be fixed in all places at some point.

        Show
        kkaranasos Konstantinos Karanasos added a comment - Adding new version of the patch. Rebased against trunk, fixed some more issues, and addressed the unit test failures. Note that there is a javadoc issue regarding using '_' as an identifier" (related to Java 8). I did not fix that, because it is actually used in multiple classes in the Web UI, and I followed the same style as in the rest of the code. I assume this should be fixed in all places at some point.
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 18s Docker mode activated.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 7 new or modified test files.
        0 mvndep 0m 14s Maven dependency ordering for branch
        +1 mvninstall 6m 48s trunk passed
        +1 compile 6m 56s trunk passed
        +1 checkstyle 1m 33s trunk passed
        +1 mvnsite 2m 20s trunk passed
        +1 mvneclipse 1m 16s trunk passed
        +1 findbugs 3m 26s trunk passed
        +1 javadoc 1m 35s trunk passed
        0 mvndep 0m 17s Maven dependency ordering for patch
        +1 mvninstall 2m 1s the patch passed
        +1 compile 6m 56s the patch passed
        +1 cc 6m 56s the patch passed
        +1 javac 6m 56s the patch passed
        -0 checkstyle 1m 35s root: The patch generated 1 new + 430 unchanged - 4 fixed = 431 total (was 434)
        +1 mvnsite 2m 36s the patch passed
        +1 mvneclipse 1m 33s the patch passed
        +1 whitespace 0m 0s The patch has no whitespace issues.
        +1 findbugs 4m 18s the patch passed
        -1 javadoc 0m 23s hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager generated 1 new + 235 unchanged - 0 fixed = 236 total (was 235)
        +1 unit 0m 32s hadoop-yarn-server-common in the patch passed.
        -1 unit 15m 50s hadoop-yarn-server-nodemanager in the patch failed.
        +1 unit 38m 57s hadoop-yarn-server-resourcemanager in the patch passed.
        +1 unit 9m 26s hadoop-mapreduce-client-app in the patch passed.
        -1 unit 0m 26s hadoop-sls in the patch failed.
        +1 asflicense 0m 27s The patch does not generate ASF License warnings.
        135m 30s



        Reason Tests
        Failed junit tests hadoop.yarn.server.nodemanager.containermanager.queuing.TestQueuingContainerManager



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:9560f25
        JIRA Issue YARN-2995
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12836674/YARN-2995.004.patch
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle cc
        uname Linux dbd88839d3d4 3.13.0-95-generic #142-Ubuntu SMP Fri Aug 12 17:00:09 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / 9b0c17f
        Default Java 1.8.0_101
        findbugs v3.0.0
        checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/13758/artifact/patchprocess/diff-checkstyle-root.txt
        javadoc https://builds.apache.org/job/PreCommit-YARN-Build/13758/artifact/patchprocess/diff-javadoc-javadoc-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager.txt
        unit https://builds.apache.org/job/PreCommit-YARN-Build/13758/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager.txt
        unit https://builds.apache.org/job/PreCommit-YARN-Build/13758/artifact/patchprocess/patch-unit-hadoop-tools_hadoop-sls.txt
        Test Results https://builds.apache.org/job/PreCommit-YARN-Build/13758/testReport/
        modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app hadoop-tools/hadoop-sls U: .
        Console output https://builds.apache.org/job/PreCommit-YARN-Build/13758/console
        Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 18s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 7 new or modified test files. 0 mvndep 0m 14s Maven dependency ordering for branch +1 mvninstall 6m 48s trunk passed +1 compile 6m 56s trunk passed +1 checkstyle 1m 33s trunk passed +1 mvnsite 2m 20s trunk passed +1 mvneclipse 1m 16s trunk passed +1 findbugs 3m 26s trunk passed +1 javadoc 1m 35s trunk passed 0 mvndep 0m 17s Maven dependency ordering for patch +1 mvninstall 2m 1s the patch passed +1 compile 6m 56s the patch passed +1 cc 6m 56s the patch passed +1 javac 6m 56s the patch passed -0 checkstyle 1m 35s root: The patch generated 1 new + 430 unchanged - 4 fixed = 431 total (was 434) +1 mvnsite 2m 36s the patch passed +1 mvneclipse 1m 33s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 findbugs 4m 18s the patch passed -1 javadoc 0m 23s hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager generated 1 new + 235 unchanged - 0 fixed = 236 total (was 235) +1 unit 0m 32s hadoop-yarn-server-common in the patch passed. -1 unit 15m 50s hadoop-yarn-server-nodemanager in the patch failed. +1 unit 38m 57s hadoop-yarn-server-resourcemanager in the patch passed. +1 unit 9m 26s hadoop-mapreduce-client-app in the patch passed. -1 unit 0m 26s hadoop-sls in the patch failed. +1 asflicense 0m 27s The patch does not generate ASF License warnings. 135m 30s Reason Tests Failed junit tests hadoop.yarn.server.nodemanager.containermanager.queuing.TestQueuingContainerManager Subsystem Report/Notes Docker Image:yetus/hadoop:9560f25 JIRA Issue YARN-2995 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12836674/YARN-2995.004.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle cc uname Linux dbd88839d3d4 3.13.0-95-generic #142-Ubuntu SMP Fri Aug 12 17:00:09 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 9b0c17f Default Java 1.8.0_101 findbugs v3.0.0 checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/13758/artifact/patchprocess/diff-checkstyle-root.txt javadoc https://builds.apache.org/job/PreCommit-YARN-Build/13758/artifact/patchprocess/diff-javadoc-javadoc-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/13758/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/13758/artifact/patchprocess/patch-unit-hadoop-tools_hadoop-sls.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/13758/testReport/ modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app hadoop-tools/hadoop-sls U: . Console output https://builds.apache.org/job/PreCommit-YARN-Build/13758/console Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
        Hide
        kkaranasos Konstantinos Karanasos added a comment -

        Regarding the remaining issues:

        • The checkstyle issue is about a method that takes more than 7 parameters in one of the test classes. That was already the case for that method; I just added some more parameters.
        • The javadoc issue, as I already explained in a comment above, is related to Java 8 complaining about using '_' as identifiers. This is used in multiple places in the Web UI classes, and should be treated in a separate JIRA.
        • The unit test issue regarding TestQueuingContainerManager is unrelated to the present JIRA and is tracked in YARN-5377.
        • There is a build issue in sls when running the corresponding tests, but it might be a Jenkins issue, since it builds fine for me locally. Just kicked-off Jenkins again to see if the problem persists.
        Show
        kkaranasos Konstantinos Karanasos added a comment - Regarding the remaining issues: The checkstyle issue is about a method that takes more than 7 parameters in one of the test classes. That was already the case for that method; I just added some more parameters. The javadoc issue, as I already explained in a comment above, is related to Java 8 complaining about using '_' as identifiers. This is used in multiple places in the Web UI classes, and should be treated in a separate JIRA. The unit test issue regarding TestQueuingContainerManager is unrelated to the present JIRA and is tracked in YARN-5377 . There is a build issue in sls when running the corresponding tests, but it might be a Jenkins issue, since it builds fine for me locally. Just kicked-off Jenkins again to see if the problem persists.
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 41s Docker mode activated.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 7 new or modified test files.
        0 mvndep 0m 16s Maven dependency ordering for branch
        +1 mvninstall 7m 6s trunk passed
        +1 compile 6m 58s trunk passed
        +1 checkstyle 1m 36s trunk passed
        +1 mvnsite 2m 22s trunk passed
        +1 mvneclipse 1m 23s trunk passed
        +1 findbugs 4m 32s trunk passed
        +1 javadoc 1m 44s trunk passed
        0 mvndep 0m 17s Maven dependency ordering for patch
        +1 mvninstall 2m 4s the patch passed
        +1 compile 7m 13s the patch passed
        +1 cc 7m 13s the patch passed
        +1 javac 7m 13s the patch passed
        -0 checkstyle 1m 38s root: The patch generated 1 new + 428 unchanged - 4 fixed = 429 total (was 432)
        +1 mvnsite 2m 41s the patch passed
        +1 mvneclipse 1m 33s the patch passed
        +1 whitespace 0m 0s The patch has no whitespace issues.
        +1 findbugs 4m 18s the patch passed
        -1 javadoc 0m 22s hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager generated 1 new + 235 unchanged - 0 fixed = 236 total (was 235)
        +1 unit 0m 32s hadoop-yarn-server-common in the patch passed.
        -1 unit 14m 57s hadoop-yarn-server-nodemanager in the patch failed.
        -1 unit 36m 18s hadoop-yarn-server-resourcemanager in the patch failed.
        +1 unit 9m 25s hadoop-mapreduce-client-app in the patch passed.
        -1 unit 0m 27s hadoop-sls in the patch failed.
        +1 asflicense 0m 28s The patch does not generate ASF License warnings.
        134m 19s



        Reason Tests
        Failed junit tests hadoop.yarn.server.nodemanager.containermanager.queuing.TestQueuingContainerManager
          hadoop.yarn.server.resourcemanager.scheduler.capacity.TestNodeLabelContainerAllocation



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:9560f25
        JIRA Issue YARN-2995
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12836674/YARN-2995.004.patch
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle cc
        uname Linux 93ef5fe18066 3.13.0-93-generic #140-Ubuntu SMP Mon Jul 18 21:21:05 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / 7534aee
        Default Java 1.8.0_101
        findbugs v3.0.0
        checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/13773/artifact/patchprocess/diff-checkstyle-root.txt
        javadoc https://builds.apache.org/job/PreCommit-YARN-Build/13773/artifact/patchprocess/diff-javadoc-javadoc-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager.txt
        unit https://builds.apache.org/job/PreCommit-YARN-Build/13773/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager.txt
        unit https://builds.apache.org/job/PreCommit-YARN-Build/13773/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
        unit https://builds.apache.org/job/PreCommit-YARN-Build/13773/artifact/patchprocess/patch-unit-hadoop-tools_hadoop-sls.txt
        Test Results https://builds.apache.org/job/PreCommit-YARN-Build/13773/testReport/
        modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app hadoop-tools/hadoop-sls U: .
        Console output https://builds.apache.org/job/PreCommit-YARN-Build/13773/console
        Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 41s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 7 new or modified test files. 0 mvndep 0m 16s Maven dependency ordering for branch +1 mvninstall 7m 6s trunk passed +1 compile 6m 58s trunk passed +1 checkstyle 1m 36s trunk passed +1 mvnsite 2m 22s trunk passed +1 mvneclipse 1m 23s trunk passed +1 findbugs 4m 32s trunk passed +1 javadoc 1m 44s trunk passed 0 mvndep 0m 17s Maven dependency ordering for patch +1 mvninstall 2m 4s the patch passed +1 compile 7m 13s the patch passed +1 cc 7m 13s the patch passed +1 javac 7m 13s the patch passed -0 checkstyle 1m 38s root: The patch generated 1 new + 428 unchanged - 4 fixed = 429 total (was 432) +1 mvnsite 2m 41s the patch passed +1 mvneclipse 1m 33s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 findbugs 4m 18s the patch passed -1 javadoc 0m 22s hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager generated 1 new + 235 unchanged - 0 fixed = 236 total (was 235) +1 unit 0m 32s hadoop-yarn-server-common in the patch passed. -1 unit 14m 57s hadoop-yarn-server-nodemanager in the patch failed. -1 unit 36m 18s hadoop-yarn-server-resourcemanager in the patch failed. +1 unit 9m 25s hadoop-mapreduce-client-app in the patch passed. -1 unit 0m 27s hadoop-sls in the patch failed. +1 asflicense 0m 28s The patch does not generate ASF License warnings. 134m 19s Reason Tests Failed junit tests hadoop.yarn.server.nodemanager.containermanager.queuing.TestQueuingContainerManager   hadoop.yarn.server.resourcemanager.scheduler.capacity.TestNodeLabelContainerAllocation Subsystem Report/Notes Docker Image:yetus/hadoop:9560f25 JIRA Issue YARN-2995 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12836674/YARN-2995.004.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle cc uname Linux 93ef5fe18066 3.13.0-93-generic #140-Ubuntu SMP Mon Jul 18 21:21:05 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 7534aee Default Java 1.8.0_101 findbugs v3.0.0 checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/13773/artifact/patchprocess/diff-checkstyle-root.txt javadoc https://builds.apache.org/job/PreCommit-YARN-Build/13773/artifact/patchprocess/diff-javadoc-javadoc-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/13773/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/13773/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/13773/artifact/patchprocess/patch-unit-hadoop-tools_hadoop-sls.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/13773/testReport/ modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app hadoop-tools/hadoop-sls U: . Console output https://builds.apache.org/job/PreCommit-YARN-Build/13773/console Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
        Hide
        asuresh Arun Suresh added a comment -

        +1, Committing this shortly to trunk

        Show
        asuresh Arun Suresh added a comment - +1, Committing this shortly to trunk
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10771 (See https://builds.apache.org/job/Hadoop-trunk-Commit/10771/)
        YARN-2995. Enhance UI to show cluster resource utilization of various (arun suresh: rev 0aafc122d401a2f49d0f9ca556343f9ba871e979)

        • (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmnode/RMNode.java
        • (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/ContainerPage.java
        • (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/dao/ContainerInfo.java
        • (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmnode/RMNodeImpl.java
        • (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/NodesPage.java
        • (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestNodesPage.java
        • (edit) hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/rm/RMContainerAllocator.java
        • (delete) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/api/records/QueuedContainersStatus.java
        • (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmnode/RMNodeStatusEvent.java
        • (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/webapp/TestNMWebServicesContainers.java
        • (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeStatusUpdaterImpl.java
        • (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebApp.java
        • (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/dao/NodeInfo.java
        • (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebServicesNodes.java
        • (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/MockNodes.java
        • (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/distributed/TestNodeQueueLoadMonitor.java
        • (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/ContainerManager.java
        • (edit) hadoop-tools/hadoop-sls/src/main/java/org/apache/hadoop/yarn/sls/scheduler/RMNodeWrapper.java
        • (delete) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/api/records/impl/pb/QueuedContainersStatusPBImpl.java
        • (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/test/java/org/apache/hadoop/yarn/server/api/protocolrecords/TestProtocolRecords.java
        • (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/api/records/NodeStatus.java
        • (edit) hadoop-tools/hadoop-sls/src/main/java/org/apache/hadoop/yarn/sls/nodemanager/NodeInfo.java
        • (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/api/records/impl/pb/NodeStatusPBImpl.java
        • (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/distributed/NodeQueueLoadMonitor.java
        • (add) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/api/records/impl/pb/OpportunisticContainersStatusPBImpl.java
        • (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/OpportunisticContainerAllocatorAMService.java
        • (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/ContainerManagerImpl.java
        • (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/monitor/ContainersMonitorImpl.java
        • (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/AbstractYarnScheduler.java
        • (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/proto/yarn_server_common_protos.proto
        • (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/queuing/QueuingContainerManagerImpl.java
        • (add) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/api/records/OpportunisticContainersStatus.java
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10771 (See https://builds.apache.org/job/Hadoop-trunk-Commit/10771/ ) YARN-2995 . Enhance UI to show cluster resource utilization of various (arun suresh: rev 0aafc122d401a2f49d0f9ca556343f9ba871e979) (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmnode/RMNode.java (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/ContainerPage.java (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/dao/ContainerInfo.java (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmnode/RMNodeImpl.java (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/NodesPage.java (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestNodesPage.java (edit) hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/rm/RMContainerAllocator.java (delete) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/api/records/QueuedContainersStatus.java (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmnode/RMNodeStatusEvent.java (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/webapp/TestNMWebServicesContainers.java (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeStatusUpdaterImpl.java (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebApp.java (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/dao/NodeInfo.java (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebServicesNodes.java (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/MockNodes.java (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/distributed/TestNodeQueueLoadMonitor.java (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/ContainerManager.java (edit) hadoop-tools/hadoop-sls/src/main/java/org/apache/hadoop/yarn/sls/scheduler/RMNodeWrapper.java (delete) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/api/records/impl/pb/QueuedContainersStatusPBImpl.java (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/test/java/org/apache/hadoop/yarn/server/api/protocolrecords/TestProtocolRecords.java (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/api/records/NodeStatus.java (edit) hadoop-tools/hadoop-sls/src/main/java/org/apache/hadoop/yarn/sls/nodemanager/NodeInfo.java (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/api/records/impl/pb/NodeStatusPBImpl.java (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/distributed/NodeQueueLoadMonitor.java (add) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/api/records/impl/pb/OpportunisticContainersStatusPBImpl.java (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/OpportunisticContainerAllocatorAMService.java (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/ContainerManagerImpl.java (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/monitor/ContainersMonitorImpl.java (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/AbstractYarnScheduler.java (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/proto/yarn_server_common_protos.proto (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/queuing/QueuingContainerManagerImpl.java (add) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/api/records/OpportunisticContainersStatus.java
        Hide
        asuresh Arun Suresh added a comment -

        Committing this to branch-2

        Show
        asuresh Arun Suresh added a comment - Committing this to branch-2

          People

          • Assignee:
            kkaranasos Konstantinos Karanasos
            Reporter:
            sriramsrao Sriram Rao
          • Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development