Details

    • Type: Sub-task
    • Status: Closed
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.23.0
    • Fix Version/s: 0.23.0
    • Component/s: applicationmaster, mrv2
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Enhance OutputCommitter and FileOutputCommitter to allow for recover of tasks across job restart.

      Description

      In MR AM recovers from a crash, it only reruns the non completed tasks. The completed tasks (along with their output, if any) needs to be recovered from the previous life. This would require some changes in OutputCommitter.

        Attachments

        1. mr2702_v4.patch
          20 kB
          Sharad Agarwal
        2. mr2702_v3.patch
          20 kB
          Sharad Agarwal
        3. mr2702_v2.patch
          20 kB
          Sharad Agarwal
        4. mr2702_v1.patch
          26 kB
          Sharad Agarwal
        5. MAPREDUCE-2702.patch
          20 kB
          Arun C Murthy
        6. MAPREDUCE-2702.patch
          21 kB
          Arun C Murthy
        7. MAPREDUCE-2702.patch
          21 kB
          Arun C Murthy

          Issue Links

            Activity

              People

              • Assignee:
                sharadag Sharad Agarwal
                Reporter:
                sharadag Sharad Agarwal
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: