[GIRAPH-52] There should be a scheme to limit the counter

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.1.0
• Fix Version/s: 1.0.0
• Component/s: mapreduce
• Assignee: Zhiwei Gu
• Reporter: Zhiwei Gu
• Created: 14/Oct/11 00:14
• Updated: 12/May/20 18:21
• Resolved: 12/May/20 18:21

Description

For hadoop version above 0.20.203.0., the cluster-wise configuration mapreduce.job.counters.limit cannot be overrided, while the superstep iterations is not deterministic, the job might run several hundreds or even thousand of supersteps, it will always kill the job. This will limit the usage of Giraph and is tooooo bad.

Issue Links

• relates to: GIRAPH-43 GiraphJob: Counter Limit is not set