Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4584 Umbrella: Preemption and restart of MapReduce tasks
  3. MAPREDUCE-5189

Basic AM changes to support preemption requests (per YARN-45)

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.0.0-alpha1
    • mr-am, mrv2
    • None
    • Reviewed

    Description

      This JIRA tracks the minimum amount of changes necessary in the mapreduce AM to receive preemption requests (per YARN-45) and invoke a local policy that manages preemption. (advanced policies and mechanisms will be tracked separately)

      Attachments

        1. MAPREDUCE-5189.1.patch
          35 kB
          Carlo Curino
        2. MAPREDUCE-5189.2.patch
          48 kB
          Carlo Curino
        3. MAPREDUCE-5189.3.patch
          49 kB
          Christopher Douglas
        4. MAPREDUCE-5189.4.patch
          43 kB
          Christopher Douglas
        5. MAPREDUCE-5189.patch
          19 kB
          Christopher Douglas
        6. MAPREDUCE-5189.patch
          17 kB
          Carlo Curino

        Issue Links

          is depended upon by

          Improvement - An improvement or enhancement to an existing feature or task. MAPREDUCE-5196 CheckpointAMPreemptionPolicy implements preemption in MR AM via checkpointing

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. MAPREDUCE-5269 Preemption of Reducer (and Shuffle) via checkpointing

          • Major - Major loss of function.
          • Patch Available
          is related to

          Sub-task - The sub-task of the issue MAPREDUCE-5176 Preemptable annotations (to support preemption in MR)

          • Major - Major loss of function.
          • Closed

          Sub-task - The sub-task of the issue YARN-567 RM changes to support preemption for FairScheduler and CapacityScheduler

          • Major - Major loss of function.
          • Closed

          Sub-task - The sub-task of the issue YARN-568 FairScheduler: support for work-preserving preemption

          • Major - Major loss of function.
          • Closed

          Sub-task - The sub-task of the issue YARN-569 CapacityScheduler: support for preemption (using a capacity monitor)

          • Major - Major loss of function.
          • Closed

          Activity

            People

              curino Carlo Curino
              curino Carlo Curino
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: