Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-5473

Race condition in command-line kill for a task

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.20.0
    • None
    • None
    • Reviewed

    Description

      The race condition occurs in following sequence of events:
      1. User issues a command-line kill for a RUNNING map-task. JT stores the task in tasksToKill mapping.
      2. TT reports the task status as SUCCEEDED.
      3. JT creates a TaskCompletionEvent as SUCCEEDED. Also sends a killTaskAction.
      4. Reducers fail fetching the map output.
      5. finally, the task would fail with Fetch failures. After HADOOP-4759, the task is left as FAILED_UNCLEAN task, since the task is present in tasksToKill mapping.

      Attachments

        1. patch-5473-2.txt
          2 kB
          Amareshwari Sriramadasu
        2. patch-5473-1.txt
          2 kB
          Amareshwari Sriramadasu

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            amareshwari Amareshwari Sriramadasu
            amareshwari Amareshwari Sriramadasu
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment