[MAPREDUCE-5696] Add Localization counters to MR

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: mrv2
• Assignee: Gera Shegalov
• Reporter: Gera Shegalov
• Created: 24/Dec/13 00:34
• Updated: 05/Feb/15 18:31

Description

Users are often unaware of localization cost that their jobs incur. To measure effectiveness of localization caches it is necessary to expose the overhead in the form of user-visible metrics. The purpose of this JIRA is to compliment YARN-1529. While YARN-1529 attempts to provide a cluster-wide view to cluster admins, this JIRA focuses on exposing the localization overhead on per-job basis to the job owner/user.

Issue Links

• requires: YARN-1529 Add Localization overhead metrics to NM