Details
-
Improvement
-
Status: Closed
-
Major
-
Resolution: Fixed
-
0.12.3
-
None
-
None
Description
After a couple of weeks of failed attempts I was able to finish a large job only after I changed MAX_TASK_FAILURES to a higher value. In light of HADOOP-1144 (allowing a certain amount of task failures without failing the job) it would be even better if this value could be configured separately for mappers and reducers, because often a success of a job requires the success of all reducers but not of all mappers.