Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-5835

Killing Task might cause the job to go to ERROR state

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 2.4.0
    • Fix Version/s: 2.4.1
    • Component/s: None
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      There could be a race condition if job is killed right after task attempt receives TA_DONE event. In that case, TaskImpl might receive T_ATTEMPT_SUCCEEDED followed by T_ATTEMPTED_KILLED for the same attempt, thus transition job to ERROR state.

      a. The task is in KILL_WAIT.
      b. TA receives TA_DONE event.
      c. Before TA transitions to SUCCEEDED state, Task sends TA_KILL event.
      d. TA transitions to SUCCEEDED state and thus send T_ATTEMPT_SUCCEEDED to the task. The task transitions to KILLED state.
      e. TA processes TA_KILL event and sends T_ATTEMPT_KILLED to the task.
      f. When task is in KILLED state, it can't handle T_ATTEMPT_KILLED event, thus transition job to ERROR state.

        Attachments

        1. MAPREDUCE-5835.patch
          5 kB
          Ming Ma

          Activity

            People

            • Assignee:
              mingma Ming Ma
              Reporter:
              mingma Ming Ma
            • Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: