[TEZ-3857] Tez TaskImpl can throw Invalid state transition for leaf tasks that do Retro Active Transition

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.9.1
• Assignee: Kuhu Shukla
• Reporter: Kuhu Shukla
• Created: 20/Oct/17 21:39
• Updated: 05/Jan/18 00:17
• Resolved: 01/Nov/17 16:59

Description

Invalid event T_ATTEMPT_FAILED on Task task_1234_5678_1_01_000001

The task had more than one running attempts (because of speculative execution), while one of them succeeded and the task was marked succeeded, the second failed and caused the Task state machine to enter error state since the task was in a leaf vertex and does the following:

if (task.leafVertex) {
        LOG.error("Unexpected event for task of leaf vertex " + event.getType() + ", taskId: "
            + task.getTaskId());
        task.internalError(event.getType());
      }

This JIRA tracks fixing this invalid state.