[YARN-5553] [ATSv2] "metrics" for YARN_CONTAINERS are displayed as empty.

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Not A Problem
• Assignee: Unassigned
• Reporter: Rohith Sharma K S
• Created: 23/Aug/16 15:41
• Updated: 18/Oct/16 16:16
• Resolved: 18/Oct/16 16:16

Description

metrics for YARN_CONTAINER entity types are displayed as empty. For master containers some values are displayed but for other containers randomly it displays metric values.

I think the behavior is due to publishing of container metric in monitor thread from NodeManager. There are 2 issues I observe is

1. Some containers has metric values CPU-Memory, some are empty.
2. The CPU-Memory values taken are from current usage which monitor thread reports. But issue with it is aggregationOp is SUM. So Each time monitor thread reported values is being added and give some bigger values. But ideally it is not actual usage.

I think CPU-MEMORY metric values for yarn-containers entities should be allocated values.