[HADOOP-1144] Hadoop should allow a configurable percentage of failed map tasks before declaring a job failed.

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.12.0
• Fix Version/s: 0.13.0
• Assignee: Arun Murthy
• Reporter: Christian Kunz
• Created: 22/Mar/07 05:09
• Updated: 08/Jul/09 16:52
• Resolved: 03/May/07 19:51

Description

In our environment it can occur that some map tasks will fail repeatedly because of corrupt input data, which sometimes is non-critical as long as the amount is limited. In this case it is annoying that the whole Hadoop job fails and cannot be restarted till the corrupt data are identified and eliminated from the input. It would be extremely helpful if the job configuration would allow to indicate how many map tasks are allowed to fail.

Issue Links

• incorporates: HADOOP-39 Create a job-configurable best effort for job execution