Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-3857

Tez TaskImpl can throw Invalid state transition for leaf tasks that do Retro Active Transition

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.9.1
    • Component/s: None
    • Labels:
      None

      Description

      Invalid event T_ATTEMPT_FAILED on Task task_1234_5678_1_01_000001
      

      The task had more than one running attempts (because of speculative execution), while one of them succeeded and the task was marked succeeded, the second failed and caused the Task state machine to enter error state since the task was in a leaf vertex and does the following:

      if (task.leafVertex) {
              LOG.error("Unexpected event for task of leaf vertex " + event.getType() + ", taskId: "
                  + task.getTaskId());
              task.internalError(event.getType());
            }
      

      This JIRA tracks fixing this invalid state.

        Attachments

        1. TEZ-3857.001.patch
          5 kB
          Kuhu Shukla
        2. TEZ-3857.002.patch
          6 kB
          Kuhu Shukla
        3. TEZ-3857.003.patch
          6 kB
          Kuhu Shukla

          Activity

            People

            • Assignee:
              kshukla Kuhu Shukla
              Reporter:
              kshukla Kuhu Shukla
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: