Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-10450

Add cpu and memory utilization per node and cluster-wide metrics

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 3.3.1
    • 3.2.2, 3.4.0, 3.3.1, 2.10.2, 3.2.3
    • yarn
    • None

    Description

      Add metrics to show actual cpu and memory utilization for each node and aggregated for the entire cluster. This is information is already passed from NM to RM in the node status update.
      We have been running with this internally for quite a while and found it useful to be able to quickly see the actual cpu/memory utilization on the node/cluster. It's especially useful if some form of overcommit is used.

      Attachments

        1. NodesPage.png
          152 kB
          Jim Brennan
        2. YARN-10450.001.patch
          22 kB
          Jim Brennan
        3. YARN-10450.002.patch
          22 kB
          Jim Brennan
        4. YARN-10450.003.patch
          22 kB
          Jim Brennan
        5. YARN-10450-branch-2.10.003.patch
          21 kB
          Jim Brennan
        6. YARN-10450-branch-3.1.003.patch
          22 kB
          Jim Brennan
        7. YARN-10450-branch-3.2.003.patch
          22 kB
          Jim Brennan

        Issue Links

          breaks

          Task - A task that needs to be done. YARN-10540 Node page is broken in YARN UI1 and UI2 including RMWebService api for nodes

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Activity

            People

              jbrennan Jim Brennan
              jbrennan Jim Brennan
              Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: