Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-10450

Add cpu and memory utilization per node and cluster-wide metrics

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 3.3.1
    • Fix Version/s: 3.2.2, 3.4.0, 3.3.1, 2.10.2, 3.2.3
    • Component/s: yarn
    • Labels:
      None

      Description

      Add metrics to show actual cpu and memory utilization for each node and aggregated for the entire cluster. This is information is already passed from NM to RM in the node status update.
      We have been running with this internally for quite a while and found it useful to be able to quickly see the actual cpu/memory utilization on the node/cluster. It's especially useful if some form of overcommit is used.

        Attachments

        1. NodesPage.png
          152 kB
          Jim Brennan
        2. YARN-10450.001.patch
          22 kB
          Jim Brennan
        3. YARN-10450.002.patch
          22 kB
          Jim Brennan
        4. YARN-10450.003.patch
          22 kB
          Jim Brennan
        5. YARN-10450-branch-2.10.003.patch
          21 kB
          Jim Brennan
        6. YARN-10450-branch-3.1.003.patch
          22 kB
          Jim Brennan
        7. YARN-10450-branch-3.2.003.patch
          22 kB
          Jim Brennan

        Issue Links

          Activity

            People

            • Assignee:
              Jim_Brennan Jim Brennan
              Reporter:
              Jim_Brennan Jim Brennan

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment