Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-5982

Task attempts that fail from the ASSIGNED state can disappear

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.23.10, 2.2.1, 2.7.1
    • Fix Version/s: 2.8.0, 2.7.2, 2.6.4, 3.0.0-alpha1
    • Component/s: mr-am
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      If a task attempt fails in the ASSIGNED state, e.g.: container launch fails, then it can disappear from the job history. The task overview page will show subsequent attempts but the attempt in question is simply missing. For example attempt ID 1 appears but the attempt ID 0 is missing. Similarly in the job overview page the task attempt doesn't appear in any of the failed/killed/succeeded counts or pages. It's as if the task attempt never existed, but the AM logs show otherwise.

        Attachments

        1. MAPREDUCE-5982.2.patch
          13 kB
          Chang Li
        2. MAPREDUCE-5982.3.patch
          13 kB
          Chang Li
        3. MAPREDUCE-5982.4.patch
          13 kB
          Chang Li
        4. MAPREDUCE-5982.5.patch
          15 kB
          Chang Li
        5. MAPREDUCE-5982.6.patch
          15 kB
          Chang Li
        6. MAPREDUCE-5982.branch.2.7.patch
          15 kB
          Chang Li
        7. MAPREDUCE-5982.patch
          13 kB
          Chang Li

        Issue Links

          Activity

            People

            • Assignee:
              lichangleo Chang Li
              Reporter:
              jlowe Jason Darrell Lowe

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment