Details

    • Type: Sub-task Sub-task
    • Status: Closed
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.23.0
    • Fix Version/s: 0.23.0
    • Component/s: applicationmaster, mrv2
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Enhance OutputCommitter and FileOutputCommitter to allow for recover of tasks across job restart.

      Description

      In MR AM recovers from a crash, it only reruns the non completed tasks. The completed tasks (along with their output, if any) needs to be recovered from the previous life. This would require some changes in OutputCommitter.

      1. MAPREDUCE-2702.patch
        21 kB
        Arun C Murthy
      2. MAPREDUCE-2702.patch
        21 kB
        Arun C Murthy
      3. MAPREDUCE-2702.patch
        20 kB
        Arun C Murthy
      4. mr2702_v4.patch
        20 kB
        Sharad Agarwal
      5. mr2702_v3.patch
        20 kB
        Sharad Agarwal
      6. mr2702_v2.patch
        20 kB
        Sharad Agarwal
      7. mr2702_v1.patch
        26 kB
        Sharad Agarwal

        Issue Links

          Activity

            People

            • Assignee:
              Sharad Agarwal
              Reporter:
              Sharad Agarwal
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development