[TEZ-814] Improve heuristic for determining a task has failed outputs

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.7.1, 0.5.5, 0.6.3
• Hadoop Flags: Reviewed
• Assignee: Bikas Saha
• Reporter: Bikas Saha
• Created: 07/Feb/14 07:15
• Updated: 18/May/16 04:55
• Resolved: 18/Sep/15 06:30

Description

Currently 25% of consumers need to report failure. However we may not always have those many error reports. Eg. this is the last consumer and it the source is lost. Or some consumers are cut off from the source. The job may hang on those consumers waiting for a re-run.