Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4590

ReduceTask preemption

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • task
    • None

    Description

      With a facility for addressing subsequences of the reduce input keygroups (such as MAPREDUCE-4587), a ReduceTask can efficiently checkpoint and restart itself. In some cases, a memento (i.e., a key in the stream) may be a sufficient checkpoint of the ReduceTask state.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              cdouglas Christopher Douglas
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated: