Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-5196

CheckpointAMPreemptionPolicy implements preemption in MR AM via checkpointing

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.0.0-alpha1
    • Component/s: mr-am, mrv2
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      This JIRA tracks a checkpoint-based AM preemption policy. The policy handles propagation of the preemption requests received from the RM to the appropriate tasks, and bookeeping of checkpoints. Actual checkpointing of the task state is handled in upcoming JIRAs.

        Attachments

        1. MAPREDUCE-5196.patch
          58 kB
          Carlo Curino
        2. MAPREDUCE-5196.patch
          58 kB
          Carlo Curino
        3. MAPREDUCE-5196.3.patch
          79 kB
          Chris Douglas
        4. MAPREDUCE-5196.2.patch
          69 kB
          Chris Douglas
        5. MAPREDUCE-5196.1.patch
          73 kB
          Carlo Curino

          Issue Links

            Activity

              People

              • Assignee:
                curino Carlo Curino
                Reporter:
                curino Carlo Curino
              • Votes:
                0 Vote for this issue
                Watchers:
                10 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: