[TEZ-3161] Allow task to report different kinds of errors - fatal / kill

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.8.3
• Target Version/s: 0.8.3
• Assignee: Siddharth Seth
• Reporter: Siddharth Seth
• Created: 10/Mar/16 21:32
• Updated: 18/May/16 04:57
• Resolved: 06/Apr/16 03:41

Description

In some cases, task failures will be the same across all attempts - e.g. exceeding memory utilization on an operation. In this case, there's no point in running another attempt of the same task.

There's other cases where a task may want to mark itself as KILLED - i.e. a temporary error. An example of this is pipelined shuffle.

Tez should allow both operations.

cc vikram.dixit, rajesh.balamohan

Issue Links

• is depended upon by: TEZ-3190 Tez UI: Display FATAL/NON-FATAL task failures