Details
-
Bug
-
Status: Open
-
Major
-
Resolution: Unresolved
-
None
-
None
-
None
-
None
Description
By default, a task will be failed if 4 task attempts fail, which consequently fail the vertex and dag. By default, a node will be blacklisted if 10 task attempts fail on it. This number is higher than 4, so a single faulty node server can fail 4 task attempts by shuffle error, which finally fail the job, before this node is blacklisted. Even we can reschedule a task after it's blamed for input read error, we cannot avoid multiple tasks go to the same bad node and continue to cause shuffle error.
Attachments
Issue Links
- relates to
-
TEZ-1673 Update the default value for allowed node failures, num events per heartbeat and counter update interval
- Closed