Details
-
New Feature
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
-
None
-
None
Description
Typically a user submits jobs with similar characteristics. Aggregating the following metrics based on users can help
quickly identify VIP users and how their jobs look like:
- slot-hours used for map tasks, for reduce tasks
- total jobs, jobs failed
- data-local-maps, rack-local-maps, remote-maps
- total map-input-bytes, reduce-output-records
- total map tasks, total reduce tasks
The granularity of the aggregation can be as coarse as daily. Data may be used to report top-K users in certain
categories. Data shall be available as chukwa records (namely, one record per day per user).