Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-5003

AM recovery should recreate records for attempts that were incomplete

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • None
    • None
    • mr-am
    • None

    Description

      As discussed in MAPREDUCE-4992, it would be nice if the AM recovered task attempt entries for all task attempts launched by the prior app attempt even if those task attempts did not complete. The attempts would have to be marked as killed or something similar to indicate it is no longer running. Having records for the task attempts enables the user to see what nodes were associated with the attempts and potentially access their logs.

      Attachments

        1. MAPREDUCE-5003.1.patch
          3 kB
          Chang Li
        2. MAPREDUCE-5003.2.patch
          3 kB
          Chang Li
        3. MAPREDUCE-5003.3.patch
          5 kB
          Chang Li
        4. MAPREDUCE-5003.4.patch
          16 kB
          Chang Li
        5. MAPREDUCE-5003.5.patch
          24 kB
          Chang Li
        6. MAPREDUCE-5003.5.patch
          24 kB
          Chang Li
        7. MAPREDUCE-5003.6.patch
          24 kB
          Chang Li
        8. MAPREDUCE-5003.7.patch
          32 kB
          Chang Li
        9. MAPREDUCE-5003.8.patch
          32 kB
          Chang Li
        10. MAPREDUCE-5003.9.patch
          32 kB
          Chang Li
        11. MAPREDUCE-5003.9.patch
          32 kB
          Chang Li
        12. MAPREDUCE-5003.10.patch
          32 kB
          Chang Li

        Issue Links

          is related to

          Improvement - An improvement or enhancement to an existing feature or task. MAPREDUCE-5079 Recovery should restore task state from job history info directly

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          relates to

          Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-4992 AM hangs in RecoveryService when recovering tasks with speculative attempts

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Activity

            People

              lichangleo Chang Li
              jlowe Jason Darrell Lowe
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated: