Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4992

AM hangs in RecoveryService when recovering tasks with speculative attempts

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 2.0.2-alpha, 0.23.6
    • 0.23.7, 2.1.0-beta
    • mr-am
    • None

    Description

      A job hung in the Recovery Service on an AM restart. There were four map tasks events that were not processed and that prevented the complete task count from reaching zero which exits the recovery service. All four tasks were speculative

      Attachments

        1. MAPREDUCE-4992v1.patch
          15 kB
          Robert Parker
        2. MAPREDUCE-4992v2.patch
          15 kB
          Robert Parker

        Issue Links

          is related to

          Improvement - An improvement or enhancement to an existing feature or task. MAPREDUCE-5079 Recovery should restore task state from job history info directly

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. MAPREDUCE-5003 AM recovery should recreate records for attempts that were incomplete

          • Major - Major loss of function.
          • Patch Available

          Activity

            People

              robsparker Robert Parker
              robsparker Robert Parker
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: