Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3858

Task attempt failure during commit results in task never completing

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Critical Critical
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.23.1
    • Component/s: mrv2
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      On a terasort job a task attempt failed during the commit phase. Another attempt was rescheduled, but when it tried to commit it failed.

      attempt_1329019187148_0083_r_000586_0 already given a go for committing the task output, so killing attempt_1329019187148_0083_r_000586_1
      

      The job hung as new attempts kept getting scheduled only to fail during commit.

        Issue Links

          Activity

          Tom White created issue -
          Tom White made changes -
          Field Original Value New Value
          Attachment MAPREDUCE-3858.patch [ 12514431 ]
          Tom White made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Mahadev konar made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags Reviewed [ 10343 ]
          Target Version/s 0.23.2 [ 12319851 ] 0.23.1 [ 12318883 ]
          Fix Version/s 0.23.1 [ 12318883 ]
          Resolution Fixed [ 1 ]
          Arun C Murthy made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Rahul Jain made changes -
          Link This issue is related to MAPREDUCE-5255 [ MAPREDUCE-5255 ]

            People

            • Assignee:
              Tom White
              Reporter:
              Tom White
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development