Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-5003

AM recovery should recreate records for attempts that were incomplete

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Patch Available
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: mr-am
    • Labels:
      None

      Description

      As discussed in MAPREDUCE-4992, it would be nice if the AM recovered task attempt entries for all task attempts launched by the prior app attempt even if those task attempts did not complete. The attempts would have to be marked as killed or something similar to indicate it is no longer running. Having records for the task attempts enables the user to see what nodes were associated with the attempts and potentially access their logs.

        Attachments

        1. MAPREDUCE-5003.1.patch
          3 kB
          Chang Li
        2. MAPREDUCE-5003.2.patch
          3 kB
          Chang Li
        3. MAPREDUCE-5003.3.patch
          5 kB
          Chang Li
        4. MAPREDUCE-5003.4.patch
          16 kB
          Chang Li
        5. MAPREDUCE-5003.5.patch
          24 kB
          Chang Li
        6. MAPREDUCE-5003.5.patch
          24 kB
          Chang Li
        7. MAPREDUCE-5003.6.patch
          24 kB
          Chang Li
        8. MAPREDUCE-5003.7.patch
          32 kB
          Chang Li
        9. MAPREDUCE-5003.8.patch
          32 kB
          Chang Li
        10. MAPREDUCE-5003.9.patch
          32 kB
          Chang Li
        11. MAPREDUCE-5003.9.patch
          32 kB
          Chang Li
        12. MAPREDUCE-5003.10.patch
          32 kB
          Chang Li

          Issue Links

            Activity

              People

              • Assignee:
                lichangleo Chang Li
                Reporter:
                jlowe Jason Darrell Lowe
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated: