Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3703

ResourceManager should provide node lists in JMX output

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Critical Critical
    • Resolution: Fixed
    • Affects Version/s: 0.23.1
    • Fix Version/s: 0.23.1
    • Component/s: mrv2, resourcemanager
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      New JMX Bean in ResourceManager to provide list of live node managers:

      Hadoop:service=ResourceManager,name=RMNMInfo LiveNodeManagers
      Show
      New JMX Bean in ResourceManager to provide list of live node managers: Hadoop:service=ResourceManager,name=RMNMInfo LiveNodeManagers

      Description

      In 0.20.*, the JMX UI for the JobTracker (http://<JobTrackerHost>:50030/jmx) showed lists of Live and BlackListed Nodes under the JobTrackerInfo section.

      In 0.23, the ResourceManager JMX UI shows the number of active, decommissioned, lost, unhealthy, and rebooted nodes under the ClusterMetrics section, but does not give the list of nodes.

      At least the list of active nodes is needed in JSON format.

        Activity

        Hide
        Hitesh Shah added a comment -

        Would it be better to just provide a count of nodes in the jmx output and have additional webservice apis ( with appropriate filter/pagination params to reduce the size of returned data ) for querying the RM for all the active/unhealthy/rebooted/... nodes?

        I am aware that the jobtracker does emit this information today but on a large cluster, the amount of data being sent back in the json output could be potentially huge ( and a performance issue if any rogue layer pings the jmx servlet too many times)?

        Show
        Hitesh Shah added a comment - Would it be better to just provide a count of nodes in the jmx output and have additional webservice apis ( with appropriate filter/pagination params to reduce the size of returned data ) for querying the RM for all the active/unhealthy/rebooted/... nodes? I am aware that the jobtracker does emit this information today but on a large cluster, the amount of data being sent back in the json output could be potentially huge ( and a performance issue if any rogue layer pings the jmx servlet too many times)?
        Hide
        Eric Payne added a comment -

        @Hitesh,

        The timing and size did not seem unreasonable during my tests in a 0.20.205 security cluster with a large number of nodes (~4000 nodes).

        Size: ~800000 Megabytes
        Avg time after 10 accesses to the JMX service (using wget to access the jmx service):
        real: 0m0.1016s
        sys: 0m0.0050s
        user: 0m0.0014s

        Since the load seems reasonable, and since this service is provided in previous releases, I would like to provide it in 0.23 also.

        Show
        Eric Payne added a comment - @Hitesh, The timing and size did not seem unreasonable during my tests in a 0.20.205 security cluster with a large number of nodes (~4000 nodes). Size: ~800000 Megabytes Avg time after 10 accesses to the JMX service (using wget to access the jmx service): real: 0m0.1016s sys: 0m0.0050s user: 0m0.0014s Since the load seems reasonable, and since this service is provided in previous releases, I would like to provide it in 0.23 also.
        Hide
        Eric Payne added a comment -

        Here is the (pretty-fied) JSON output of the RMNMInfo bean from the Resourcemanager:

        {
            "name" : "Hadoop:service=ResourceManager,name=RMNMInfo",
            "modelerType" : "org.apache.hadoop.yarn.server.resourcemanager.RMNMInfo",
            "LiveNodeManagers" : "
                                  [
                                    { "HostName":"<HOSTNAME-1>"
                                      "NodeHTTPAddress":"<HOSTNAME-1>:<PORT>"
                                      "Rack":"/xxx.xxx.xxx.xxx"
                                      "NodeState":"RUNNING"
                                      "HealthStatus":"Healthy"
                                      "LastHealthyUpdate":1327351645595
                                      "HealthReport":""
                                      "UsedContainers":0
                                      "UsedMemory":0
                                      "AvailableMemory":<MEM-IN-MEG>
                                    }
                                    { "HostName":"<HOSTNAME-2>"
                                      "NodeHTTPAddress":"<HOSTNAME-2>:<PORT>"
                                      "Rack":"/xxx.xxx.xxx.xxx"
                                      "NodeState":"RUNNING"
                                      "HealthStatus":"Healthy"
                                      "LastHealthyUpdate":1327351645755
                                      "HealthReport":""
                                      "UsedContainers":0
                                      "UsedMemory":0
                                      "AvailableMemory":<MEM-IN-MEG>
                                    }
                                    ...
                                    { "HostName":"<HOSTNAME-n>"
                                      "NodeHTTPAddress":"<HOSTNAME-n>:<PORT>"
                                      "Rack":"/xxx.xxx.xxx.xxx"
                                      "NodeState":"RUNNING"
                                      "HealthStatus":"Healthy"
                                      "LastHealthyUpdate":1327351645423
                                      "HealthReport":""
                                      "UsedContainers":0
                                      "UsedMemory":0
                                      "AvailableMemory":<MEM-IN-MEG>
                                    }
                                  ]"
        }
        
        Show
        Eric Payne added a comment - Here is the (pretty-fied) JSON output of the RMNMInfo bean from the Resourcemanager: { "name" : "Hadoop:service=ResourceManager,name=RMNMInfo", "modelerType" : "org.apache.hadoop.yarn.server.resourcemanager.RMNMInfo", "LiveNodeManagers" : " [ { "HostName":"<HOSTNAME-1>" "NodeHTTPAddress":"<HOSTNAME-1>:<PORT>" "Rack":"/xxx.xxx.xxx.xxx" "NodeState":"RUNNING" "HealthStatus":"Healthy" "LastHealthyUpdate":1327351645595 "HealthReport":"" "UsedContainers":0 "UsedMemory":0 "AvailableMemory":<MEM-IN-MEG> } { "HostName":"<HOSTNAME-2>" "NodeHTTPAddress":"<HOSTNAME-2>:<PORT>" "Rack":"/xxx.xxx.xxx.xxx" "NodeState":"RUNNING" "HealthStatus":"Healthy" "LastHealthyUpdate":1327351645755 "HealthReport":"" "UsedContainers":0 "UsedMemory":0 "AvailableMemory":<MEM-IN-MEG> } ... { "HostName":"<HOSTNAME-n>" "NodeHTTPAddress":"<HOSTNAME-n>:<PORT>" "Rack":"/xxx.xxx.xxx.xxx" "NodeState":"RUNNING" "HealthStatus":"Healthy" "LastHealthyUpdate":1327351645423 "HealthReport":"" "UsedContainers":0 "UsedMemory":0 "AvailableMemory":<MEM-IN-MEG> } ]" }
        Hide
        Hitesh Shah added a comment -

        @Eric, 1 MB worth of data being pulled may be an issue depending on where the call is being made from. If most of the use cases are from more or less within the same network/colo, then latency may not be that big a factor ( unless someone hits the jmx url too often ). In any case, if no one has mentioned anything with respect to the jmx data size for the 0.20 branch, I guess there is no harm in adding it also to .23.

        Minor comments on the json keys:

        • could you change UsedMemory and AvailableMemory to UsedMemoryMB and AvailableMemoryMB.
        • Also, it would be good if the json output could be changed to have the keys match the elements used in the webservice apis.
        Show
        Hitesh Shah added a comment - @Eric, 1 MB worth of data being pulled may be an issue depending on where the call is being made from. If most of the use cases are from more or less within the same network/colo, then latency may not be that big a factor ( unless someone hits the jmx url too often ). In any case, if no one has mentioned anything with respect to the jmx data size for the 0.20 branch, I guess there is no harm in adding it also to .23. Minor comments on the json keys: could you change UsedMemory and AvailableMemory to UsedMemoryMB and AvailableMemoryMB. Also, it would be good if the json output could be changed to have the keys match the elements used in the webservice apis.
        Hide
        Eric Payne added a comment -

        The following are updates to the LiveNameNodes fields:

        {
            "name" : "Hadoop:service=ResourceManager,name=RMNMInfo",
            "modelerType" : "org.apache.hadoop.yarn.server.resourcemanager.RMNMInfo",
            "LiveNodeManagers" : "[
                                    {
                                      "HostName":"<HOSTNAME1>",
                                      "Rack":"/xxx.xxx.xxx.xxx",
                                      "State":"RUNNING",
                                      "NodeId":"<HOSTNAME1>:<PORT1>",
                                      "NodeHTTPAddress":"<HOSTNAME1>:<PORT2>",
                                      "HealthStatus":"Healthy",
                                      "LastHealthUpdate":1327442780185,
                                      "HealthReport":"",
                                      "NumContainersMB":0,
                                      "UsedMemoryMB":0,
                                      "AvailableMemoryMB":<MEM>
                                    },
                                    { ... },
                                    { ... },
                                    ...
                                  ]"
        } 
        
        
        Show
        Eric Payne added a comment - The following are updates to the LiveNameNodes fields: { "name" : "Hadoop:service=ResourceManager,name=RMNMInfo", "modelerType" : "org.apache.hadoop.yarn.server.resourcemanager.RMNMInfo", "LiveNodeManagers" : "[ { "HostName":"<HOSTNAME1>", "Rack":"/xxx.xxx.xxx.xxx", "State":"RUNNING", "NodeId":"<HOSTNAME1>:<PORT1>", "NodeHTTPAddress":"<HOSTNAME1>:<PORT2>", "HealthStatus":"Healthy", "LastHealthUpdate":1327442780185, "HealthReport":"", "NumContainersMB":0, "UsedMemoryMB":0, "AvailableMemoryMB":<MEM> }, { ... }, { ... }, ... ]" }
        Hide
        Hadoop QA added a comment -

        +1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12511861/MAPREDUCE-3703.1.txt
        against trunk revision .

        +1 @author. The patch does not contain any @author tags.

        +1 tests included. The patch appears to include 3 new or modified tests.

        +1 javadoc. The javadoc tool did not generate any warning messages.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 eclipse:eclipse. The patch built with eclipse:eclipse.

        +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        +1 core tests. The patch passed unit tests in .

        +1 contrib tests. The patch passed contrib unit tests.

        Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1673//testReport/
        Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1673//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - +1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12511861/MAPREDUCE-3703.1.txt against trunk revision . +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 3 new or modified tests. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 eclipse:eclipse. The patch built with eclipse:eclipse. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed unit tests in . +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1673//testReport/ Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1673//console This message is automatically generated.
        Hide
        Mahadev konar added a comment -

        +1 lgtm!

        Show
        Mahadev konar added a comment - +1 lgtm!
        Hide
        Mahadev konar added a comment -

        Actually now that I think of it, we never had anything exposed via jmx for the RM? Looks like this is the first bean we are adding. Is that right? I thought some of the work that Thomas did on web services was also exposed via jmx. No?

        Show
        Mahadev konar added a comment - Actually now that I think of it, we never had anything exposed via jmx for the RM? Looks like this is the first bean we are adding. Is that right? I thought some of the work that Thomas did on web services was also exposed via jmx. No?
        Hide
        Eric Payne added a comment -

        Actually, there are several ResourceManager beans. I couldn't find any that test JMX specifically, though, so I added a test for this new one. The ResourceManager beans are accessible via http://<rm-host>:<port>/jmx and are as follows:

        Hadoop:service=ResourceManager,name=UgiMetrics (login metrics)
        Hadoop:service=ResourceManager,name=MetricsSystem,sub=Stats (sources/sinks/ops/time)
        Hadoop:service=ResourceManager,name=QueueMetrics,q0=root,q1=<qname>
        Hadoop:service=ResourceManager,name=RpcDetailedActivityForPort<port> (NumOps/AvgTime)
        Hadoop:service=ResourceManager,name=ClusterMetrics (NumNodes, but not lists of nodes)
        Hadoop:service=ResourceManager,name=RMNMInfo (NEW: contains list and status of live nodes).

        Show
        Eric Payne added a comment - Actually, there are several ResourceManager beans. I couldn't find any that test JMX specifically, though, so I added a test for this new one. The ResourceManager beans are accessible via http://<rm-host>:<port>/jmx and are as follows: Hadoop:service=ResourceManager,name=UgiMetrics (login metrics) Hadoop:service=ResourceManager,name=MetricsSystem,sub=Stats (sources/sinks/ops/time) Hadoop:service=ResourceManager,name=QueueMetrics,q0=root,q1=<qname> Hadoop:service=ResourceManager,name=RpcDetailedActivityForPort<port> (NumOps/AvgTime) Hadoop:service=ResourceManager,name=ClusterMetrics (NumNodes, but not lists of nodes) Hadoop:service=ResourceManager,name=RMNMInfo (NEW: contains list and status of live nodes).
        Hide
        Mahadev konar added a comment -

        @Eric,
        You are right. Reviewing the code now.

        Show
        Mahadev konar added a comment - @Eric, You are right. Reviewing the code now.
        Hide
        Mahadev konar added a comment -

        Just committed this. Thanks a lot Eric!

        Show
        Mahadev konar added a comment - Just committed this. Thanks a lot Eric!
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-trunk-Commit #1690 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1690/)
        MAPREDUCE-3703. ResourceManager should provide node lists in JMX output. (Eric Payne via mahadev)

        mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1237920
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestRMNMInfo.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMNMInfo.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMNMInfoBeans.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-trunk-Commit #1690 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1690/ ) MAPREDUCE-3703 . ResourceManager should provide node lists in JMX output. (Eric Payne via mahadev) mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1237920 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestRMNMInfo.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMNMInfo.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMNMInfoBeans.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Common-trunk-Commit #1618 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1618/)
        MAPREDUCE-3703. ResourceManager should provide node lists in JMX output. (Eric Payne via mahadev)

        mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1237920
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestRMNMInfo.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMNMInfo.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMNMInfoBeans.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java
        Show
        Hudson added a comment - Integrated in Hadoop-Common-trunk-Commit #1618 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1618/ ) MAPREDUCE-3703 . ResourceManager should provide node lists in JMX output. (Eric Payne via mahadev) mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1237920 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestRMNMInfo.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMNMInfo.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMNMInfoBeans.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-0.23-Commit #438 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/438/)
        MAPREDUCE-3703. ResourceManager should provide node lists in JMX output. (Eric Payne via mahadev) - Merge r1237920 from trunk.

        mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1237921
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestRMNMInfo.java
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMNMInfo.java
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMNMInfoBeans.java
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-0.23-Commit #438 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/438/ ) MAPREDUCE-3703 . ResourceManager should provide node lists in JMX output. (Eric Payne via mahadev) - Merge r1237920 from trunk. mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1237921 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestRMNMInfo.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMNMInfo.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMNMInfoBeans.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Common-0.23-Commit #447 (See https://builds.apache.org/job/Hadoop-Common-0.23-Commit/447/)
        MAPREDUCE-3703. ResourceManager should provide node lists in JMX output. (Eric Payne via mahadev) - Merge r1237920 from trunk.

        mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1237921
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestRMNMInfo.java
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMNMInfo.java
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMNMInfoBeans.java
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java
        Show
        Hudson added a comment - Integrated in Hadoop-Common-0.23-Commit #447 (See https://builds.apache.org/job/Hadoop-Common-0.23-Commit/447/ ) MAPREDUCE-3703 . ResourceManager should provide node lists in JMX output. (Eric Payne via mahadev) - Merge r1237920 from trunk. mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1237921 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestRMNMInfo.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMNMInfo.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMNMInfoBeans.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-trunk-Commit #1635 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1635/)
        MAPREDUCE-3703. ResourceManager should provide node lists in JMX output. (Eric Payne via mahadev)

        mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1237920
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestRMNMInfo.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMNMInfo.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMNMInfoBeans.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk-Commit #1635 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1635/ ) MAPREDUCE-3703 . ResourceManager should provide node lists in JMX output. (Eric Payne via mahadev) mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1237920 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestRMNMInfo.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMNMInfo.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMNMInfoBeans.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-0.23-Commit #462 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/462/)
        MAPREDUCE-3703. ResourceManager should provide node lists in JMX output. (Eric Payne via mahadev) - Merge r1237920 from trunk.

        mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1237921
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestRMNMInfo.java
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMNMInfo.java
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMNMInfoBeans.java
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-0.23-Commit #462 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/462/ ) MAPREDUCE-3703 . ResourceManager should provide node lists in JMX output. (Eric Payne via mahadev) - Merge r1237920 from trunk. mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1237921 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestRMNMInfo.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMNMInfo.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMNMInfoBeans.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java
        Hide
        Eric Payne added a comment -

        Thank you Mahadev!

        Show
        Eric Payne added a comment - Thank you Mahadev!
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-trunk #942 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/942/)
        MAPREDUCE-3703. ResourceManager should provide node lists in JMX output. (Eric Payne via mahadev)

        mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1237920
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestRMNMInfo.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMNMInfo.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMNMInfoBeans.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-trunk #942 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/942/ ) MAPREDUCE-3703 . ResourceManager should provide node lists in JMX output. (Eric Payne via mahadev) mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1237920 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestRMNMInfo.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMNMInfo.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMNMInfoBeans.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-0.23-Build #155 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/155/)
        MAPREDUCE-3703. ResourceManager should provide node lists in JMX output. (Eric Payne via mahadev) - Merge r1237920 from trunk.

        mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1237921
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestRMNMInfo.java
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMNMInfo.java
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMNMInfoBeans.java
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-0.23-Build #155 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/155/ ) MAPREDUCE-3703 . ResourceManager should provide node lists in JMX output. (Eric Payne via mahadev) - Merge r1237920 from trunk. mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1237921 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestRMNMInfo.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMNMInfo.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMNMInfoBeans.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-0.23-Build #177 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/177/)
        MAPREDUCE-3703. ResourceManager should provide node lists in JMX output. (Eric Payne via mahadev) - Merge r1237920 from trunk.

        mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1237921
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestRMNMInfo.java
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMNMInfo.java
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMNMInfoBeans.java
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-0.23-Build #177 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/177/ ) MAPREDUCE-3703 . ResourceManager should provide node lists in JMX output. (Eric Payne via mahadev) - Merge r1237920 from trunk. mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1237921 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestRMNMInfo.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMNMInfo.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMNMInfoBeans.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-trunk #975 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/975/)
        MAPREDUCE-3703. ResourceManager should provide node lists in JMX output. (Eric Payne via mahadev)

        mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1237920
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestRMNMInfo.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMNMInfo.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMNMInfoBeans.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk #975 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/975/ ) MAPREDUCE-3703 . ResourceManager should provide node lists in JMX output. (Eric Payne via mahadev) mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1237920 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestRMNMInfo.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMNMInfo.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMNMInfoBeans.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java

          People

          • Assignee:
            Eric Payne
            Reporter:
            Eric Payne
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development