[YARN-6375] App level aggregation should not consider metric values reported in the previous aggregation cycle

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.9.0, YARN-5355, YARN-5355-branch-2, 3.0.0-alpha4
• Component/s: timelineserver
• Target Version/s: 3.0.0-alpha4
• Hadoop Flags: Reviewed
• Assignee: Varun Saxena
• Reporter: Varun Saxena
• Created: 22/Mar/17 21:25
• Updated: 21/Oct/17 06:06
• Resolved: 04/May/17 22:34

Description

Currently app level aggregation is done every 15 seconds.
And we consider last reported metric value for each entity belonging to an app for aggregation.
We however merely update the corresponding metric values for the entity on put. We never remove the entries.
But it is possible that multiple entities finish during lifetime of an application. We however continue to consider them till the end.
We should however not consider metric values of entities unless reported within the 15 second period.

Consider containers. For a long running app, several containers would start and end at various times during the lifetime of an app.
To consider metrics for all the containers throughout the lifetime of app, hence wont be correct.