I think we should move all of the Counters that the framework updates into a single class called TaskMetrics. TaskMetrics would have specific fields for each of the metrics like input records, input bytes, output records, etc.
It would both reduce the serialized size of the heartbeats (by shrinking the Counters down to just the user's counters) and decrease the latency for updates to the JobTracker (since Counters are sent at most 1/minute instead of 1/heartbeat).
|Assignee||Devaraj Das [ devaraj ]||Arun C Murthy [ acmurthy ]|
|Fix Version/s||0.21.0 [ 12314045 ]|
|Assignee||Arun C Murthy [ acmurthy ]||Luke Lu [ vicaya ]|
|Status||Open [ 1 ]||Patch Available [ 10002 ]|
|Fix Version/s||0.23.0 [ 12315570 ]|
|Status||Patch Available [ 10002 ]||Resolved [ 5 ]|
|Resolution||Fixed [ 1 ]|
|Release Note||Efficient implementation of MapReduce framework counters.|
|Status||Resolved [ 5 ]||Closed [ 6 ]|