Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-4308

ContainersAggregated CPU resource utilization reports negative usage in first few heartbeats

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.7.1
    • Fix Version/s: 2.9.0, 3.0.0-alpha1
    • Component/s: nodemanager
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      NodeManager reports ContainerAggregated CPU resource utilization as -ve value in first few heartbeats cycles. I added a new debug print and received below values from heartbeats.

      INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: ContainersResource Utilization : CpuTrackerUsagePercent : -1.0 
      INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl:ContainersResource Utilization :  CpuTrackerUsagePercent : 198.94598
      

      Its better we send 0 as CPU usage rather than sending a negative values in heartbeats eventhough its happening in only first few heartbeats.

        Attachments

        1. 0001-YARN-4308.patch
          2 kB
          Sunil Govindan
        2. 0002-YARN-4308.patch
          3 kB
          Sunil Govindan
        3. 0003-YARN-4308.patch
          6 kB
          Sunil Govindan
        4. 0004-YARN-4308.patch
          6 kB
          Sunil Govindan
        5. 0005-YARN-4308.patch
          10 kB
          Sunil Govindan
        6. 0006-YARN-4308.patch
          13 kB
          Sunil Govindan
        7. 0007-YARN-4308.patch
          13 kB
          Sunil Govindan
        8. 0008-YARN-4308.patch
          14 kB
          Sunil Govindan
        9. 0009-YARN-4308.patch
          14 kB
          Sunil Govindan
        10. 0010-YARN-4308.patch
          15 kB
          Sunil Govindan

          Issue Links

            Activity

              People

              • Assignee:
                sunilg Sunil Govindan
                Reporter:
                sunilg Sunil Govindan
              • Votes:
                0 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: