[YARN-4712] CPU Usage Metric is not captured properly in YARN-2928

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.9.0, 3.0.0-alpha1
• Component/s: timelineserver
• Labels: yarn-2928-1st-milestone
• Hadoop Flags: Reviewed
• Assignee: Naganarasimha G R
• Reporter: Naganarasimha G R
• Created: 21/Feb/16 18:53
• Updated: 25/Oct/19 20:27
• Resolved: 18/Mar/16 17:53

Description

There are 2 issues with CPU usage collection

• I was able to observe that that many times CPU usage got from pTree.getCpuUsagePercent() is ResourceCalculatorProcessTree.UNAVAILABLE(i.e. -1) but ContainersMonitor do the calculation i.e. cpuUsageTotalCoresPercentage = cpuUsagePercentPerCore /resourceCalculatorPlugin.getNumProcessors() because of which UNAVAILABLE check in NMTimelinePublisher.reportContainerResourceUsage is not encountered. so proper checks needs to be handled
• EntityColumnPrefix.METRIC uses always LongConverter but ContainerMonitor is publishing decimal values for the CPU usage.

Issue Links

• relates to: YARN-4821 Have a separate NM timeline publishing-interval