Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3059

QueueMetrics do not have metrics for aggregate containers-allocated and aggregate containers-released

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.23.0
    • Fix Version/s: 0.23.0
    • Component/s: mrv2
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      QueueMetrics for ResourceManager do not have any metrics for aggregate containers-allocated and containers-released.

      We need the aggregates of containers-allocated and containers-released to figure out the rate at which RM is dishing out containers. NodeManager do have containers-launched and container-released metrics, but this is not across all nodes; so to get the cluster level aggregate, we need to preprocess NM metrics from all nodes - which is troublesome.

      Currently, we do have AllocatedContainers and PendingContainers which reflect the running containers given out to AMs, and containers waiting for allocation respectively.

      1. MAPREDUCE-3059-1.patch
        11 kB
        Devaraj K
      2. MAPREDUCE-3059.patch
        9 kB
        Devaraj K

        Activity

        Hide
        Devaraj K added a comment -

        I think we can address this issue at a broader level.

        Metrics is definitely one of the important aspects.

        As Karam Singh mentioned, we do have metrics at NodeManager level.

        What if we gather all the metrics from all NodeManagers at the cetral point which is ResourceManager?

        Following points can be considered
        1. Minimal processing and communication overhead on the cluster.
        2. Addition of more metrics in future
        3. Configurable - e.g. OnDemand-admin should be to trigger it from resource manager web UI. or periodic refresh

        following two solutions i could think of.

        Solution 1:
        Either we can provide a configuration or a link On the ResourceManager UI or through jmx trigger point, we can provide a way to trigger the gathering of metrics from each node manager.
        It involves a service on ResourceManager side, which can be a RPC service, which will accept metrics update requests from all NodeManagers.
        When Administrator triggers the gathering of metrics, the NodeManager will be informed to report the metrics to ResourceManager through the heart beat response.

        Solution 2:
        ResourceManager, NodeManager, MRAppMaster everyone bydefault support for org.apache.hadoop.metrics.MetricsServlet which returns the data in JSON format.
        ResourceManager can have a service which connects to all NodeManager's MetricsSevlet and uses the JSON data to prepare the metrics information.

        please add your views.

        Show
        Devaraj K added a comment - I think we can address this issue at a broader level. Metrics is definitely one of the important aspects. As Karam Singh mentioned, we do have metrics at NodeManager level. What if we gather all the metrics from all NodeManagers at the cetral point which is ResourceManager? Following points can be considered 1. Minimal processing and communication overhead on the cluster. 2. Addition of more metrics in future 3. Configurable - e.g. OnDemand-admin should be to trigger it from resource manager web UI. or periodic refresh following two solutions i could think of. Solution 1: Either we can provide a configuration or a link On the ResourceManager UI or through jmx trigger point, we can provide a way to trigger the gathering of metrics from each node manager. It involves a service on ResourceManager side, which can be a RPC service, which will accept metrics update requests from all NodeManagers. When Administrator triggers the gathering of metrics, the NodeManager will be informed to report the metrics to ResourceManager through the heart beat response. Solution 2: ResourceManager, NodeManager, MRAppMaster everyone bydefault support for org.apache.hadoop.metrics.MetricsServlet which returns the data in JSON format. ResourceManager can have a service which connects to all NodeManager's MetricsSevlet and uses the JSON data to prepare the metrics information. please add your views.
        Hide
        Mahadev konar added a comment -

        Devaraj,
        Why cant we just calculate these metrics in the RM itself? We do not have to send such metrics from NM to RM and aggregate them. Its much easier to calculate the metrics in the RM itself (probably per queue as well). Anything I am missing?

        Show
        Mahadev konar added a comment - Devaraj, Why cant we just calculate these metrics in the RM itself? We do not have to send such metrics from NM to RM and aggregate them. Its much easier to calculate the metrics in the RM itself (probably per queue as well). Anything I am missing?
        Hide
        Devaraj K added a comment -

        Hi Mahadev,
        I agree that we can calculate the information w.r.t. containers at RM itself.

        But what i meant is not just container metrics information but any other metric information e.g. NodeManager jvm metrics information or similar metric information which might be of help to administrator to get an idea about what's happening on complete cluster.

        Show
        Devaraj K added a comment - Hi Mahadev, I agree that we can calculate the information w.r.t. containers at RM itself. But what i meant is not just container metrics information but any other metric information e.g. NodeManager jvm metrics information or similar metric information which might be of help to administrator to get an idea about what's happening on complete cluster.
        Hide
        Mahadev konar added a comment -

        Devaraj,
        I think we can skip aggregation of the metrics by sending it to the RM. Most of the information as stated in the jira should probably be calculated at the RM. Any aggregate information can be obtained by a metrics aggregator that uses data from metrics sinks. Thoughts?

        Show
        Mahadev konar added a comment - Devaraj, I think we can skip aggregation of the metrics by sending it to the RM. Most of the information as stated in the jira should probably be calculated at the RM. Any aggregate information can be obtained by a metrics aggregator that uses data from metrics sinks. Thoughts?
        Hide
        Devaraj K added a comment -

        This patch addresses the problem described in the description. For cluster level metrics MAPREDUCE-3172 has been filed.

        Show
        Devaraj K added a comment - This patch addresses the problem described in the description. For cluster level metrics MAPREDUCE-3172 has been filed.
        Hide
        Hadoop QA added a comment -

        +1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12498851/MAPREDUCE-3059.patch
        against trunk revision .

        +1 @author. The patch does not contain any @author tags.

        +1 tests included. The patch appears to include 3 new or modified tests.

        +1 javadoc. The javadoc tool did not generate any warning messages.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        +1 core tests. The patch passed unit tests in .

        +1 contrib tests. The patch passed contrib unit tests.

        Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1001//testReport/
        Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1001//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - +1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12498851/MAPREDUCE-3059.patch against trunk revision . +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 3 new or modified tests. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed unit tests in . +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1001//testReport/ Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1001//console This message is automatically generated.
        Hide
        Mahadev konar added a comment -

        @Devaraj,
        The patch looks good.

        One minor nit: I think we should probably use MutableCounterLong for the aggregate metrics.

        Show
        Mahadev konar added a comment - @Devaraj, The patch looks good. One minor nit: I think we should probably use MutableCounterLong for the aggregate metrics.
        Hide
        Devaraj K added a comment -

        Thanks Mahadev for taking a look into the patch.

        I updated the patch with MutableCounterLong for the aggregate metrics.

        Show
        Devaraj K added a comment - Thanks Mahadev for taking a look into the patch. I updated the patch with MutableCounterLong for the aggregate metrics.
        Hide
        Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12499000/MAPREDUCE-3059-1.patch
        against trunk revision .

        +1 @author. The patch does not contain any @author tags.

        +1 tests included. The patch appears to include 3 new or modified tests.

        -1 javadoc. The javadoc tool appears to have generated 20 warning messages.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        +1 core tests. The patch passed unit tests in .

        +1 contrib tests. The patch passed contrib unit tests.

        Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1017//testReport/
        Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1017//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12499000/MAPREDUCE-3059-1.patch against trunk revision . +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 3 new or modified tests. -1 javadoc. The javadoc tool appears to have generated 20 warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed unit tests in . +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1017//testReport/ Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1017//console This message is automatically generated.
        Hide
        Devaraj K added a comment -

        -1 javadoc. The javadoc tool appears to have generated 20 warning messages.

        These javadoc warnings are not related to this patch.

        Show
        Devaraj K added a comment - -1 javadoc. The javadoc tool appears to have generated 20 warning messages. These javadoc warnings are not related to this patch.
        Hide
        Mahadev konar added a comment -

        +1 lgtm. Will go ahead and commit.

        Show
        Mahadev konar added a comment - +1 lgtm. Will go ahead and commit.
        Hide
        Mahadev konar added a comment -

        Just pushed this. Thanks Devaraj.

        Show
        Mahadev konar added a comment - Just pushed this. Thanks Devaraj.
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Common-trunk-Commit #1085 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1085/)
        MAPREDUCE-3059. QueueMetrics do not have metrics for aggregate containers-allocated and aggregate containers-released. (Devaraj K via mahadev)

        mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1183540
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/QueueMetrics.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/TestQueueMetrics.java
        Show
        Hudson added a comment - Integrated in Hadoop-Common-trunk-Commit #1085 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1085/ ) MAPREDUCE-3059 . QueueMetrics do not have metrics for aggregate containers-allocated and aggregate containers-released. (Devaraj K via mahadev) mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1183540 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/QueueMetrics.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/TestQueueMetrics.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-trunk-Commit #1163 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1163/)
        MAPREDUCE-3059. QueueMetrics do not have metrics for aggregate containers-allocated and aggregate containers-released. (Devaraj K via mahadev)

        mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1183540
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/QueueMetrics.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/TestQueueMetrics.java
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-trunk-Commit #1163 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1163/ ) MAPREDUCE-3059 . QueueMetrics do not have metrics for aggregate containers-allocated and aggregate containers-released. (Devaraj K via mahadev) mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1183540 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/QueueMetrics.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/TestQueueMetrics.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-0.23-Commit #2 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/2/)
        MAPREDUCE-3059. QueueMetrics do not have metrics for aggregate containers-allocated and aggregate containers-released. (Devaraj K via mahadev) - Merging r1183540 from trunk

        mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1183542
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/QueueMetrics.java
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/TestQueueMetrics.java
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-0.23-Commit #2 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/2/ ) MAPREDUCE-3059 . QueueMetrics do not have metrics for aggregate containers-allocated and aggregate containers-released. (Devaraj K via mahadev) - Merging r1183540 from trunk mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1183542 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/QueueMetrics.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/TestQueueMetrics.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Common-0.23-Commit #2 (See https://builds.apache.org/job/Hadoop-Common-0.23-Commit/2/)
        MAPREDUCE-3059. QueueMetrics do not have metrics for aggregate containers-allocated and aggregate containers-released. (Devaraj K via mahadev) - Merging r1183540 from trunk

        mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1183542
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/QueueMetrics.java
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/TestQueueMetrics.java
        Show
        Hudson added a comment - Integrated in Hadoop-Common-0.23-Commit #2 (See https://builds.apache.org/job/Hadoop-Common-0.23-Commit/2/ ) MAPREDUCE-3059 . QueueMetrics do not have metrics for aggregate containers-allocated and aggregate containers-released. (Devaraj K via mahadev) - Merging r1183540 from trunk mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1183542 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/QueueMetrics.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/TestQueueMetrics.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-trunk-Commit #1104 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1104/)
        MAPREDUCE-3059. QueueMetrics do not have metrics for aggregate containers-allocated and aggregate containers-released. (Devaraj K via mahadev)

        mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1183540
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/QueueMetrics.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/TestQueueMetrics.java
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk-Commit #1104 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1104/ ) MAPREDUCE-3059 . QueueMetrics do not have metrics for aggregate containers-allocated and aggregate containers-released. (Devaraj K via mahadev) mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1183540 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/QueueMetrics.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/TestQueueMetrics.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-0.23-Commit #3 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/3/)
        MAPREDUCE-3059. QueueMetrics do not have metrics for aggregate containers-allocated and aggregate containers-released. (Devaraj K via mahadev) - Merging r1183540 from trunk

        mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1183542
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/QueueMetrics.java
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/TestQueueMetrics.java
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-0.23-Commit #3 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/3/ ) MAPREDUCE-3059 . QueueMetrics do not have metrics for aggregate containers-allocated and aggregate containers-released. (Devaraj K via mahadev) - Merging r1183540 from trunk mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1183542 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/QueueMetrics.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/TestQueueMetrics.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-0.23-Build #40 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/40/)
        MAPREDUCE-3059. QueueMetrics do not have metrics for aggregate containers-allocated and aggregate containers-released. (Devaraj K via mahadev) - Merging r1183540 from trunk

        mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1183542
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/QueueMetrics.java
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/TestQueueMetrics.java
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-0.23-Build #40 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/40/ ) MAPREDUCE-3059 . QueueMetrics do not have metrics for aggregate containers-allocated and aggregate containers-released. (Devaraj K via mahadev) - Merging r1183540 from trunk mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1183542 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/QueueMetrics.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/TestQueueMetrics.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-trunk #861 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/861/)
        MAPREDUCE-3059. QueueMetrics do not have metrics for aggregate containers-allocated and aggregate containers-released. (Devaraj K via mahadev)

        mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1183540
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/QueueMetrics.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/TestQueueMetrics.java
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk #861 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/861/ ) MAPREDUCE-3059 . QueueMetrics do not have metrics for aggregate containers-allocated and aggregate containers-released. (Devaraj K via mahadev) mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1183540 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/QueueMetrics.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/TestQueueMetrics.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-0.23-Build #52 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/52/)
        MAPREDUCE-3059. QueueMetrics do not have metrics for aggregate containers-allocated and aggregate containers-released. (Devaraj K via mahadev) - Merging r1183540 from trunk

        mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1183542
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/QueueMetrics.java
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/TestQueueMetrics.java
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-0.23-Build #52 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/52/ ) MAPREDUCE-3059 . QueueMetrics do not have metrics for aggregate containers-allocated and aggregate containers-released. (Devaraj K via mahadev) - Merging r1183540 from trunk mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1183542 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/QueueMetrics.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/TestQueueMetrics.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-trunk #831 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/831/)
        MAPREDUCE-3059. QueueMetrics do not have metrics for aggregate containers-allocated and aggregate containers-released. (Devaraj K via mahadev)

        mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1183540
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/QueueMetrics.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/TestQueueMetrics.java
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-trunk #831 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/831/ ) MAPREDUCE-3059 . QueueMetrics do not have metrics for aggregate containers-allocated and aggregate containers-released. (Devaraj K via mahadev) mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1183540 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/QueueMetrics.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/TestQueueMetrics.java

          People

          • Assignee:
            Devaraj K
            Reporter:
            Karam Singh
          • Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development