Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-6176

To limit the map task number or reduce task number of an application

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: 2.4.0, 2.5.0, 2.4.1, 2.5.1, 2.5.2
    • Fix Version/s: None
    • Component/s: mr-am, mrv2
    • Labels:

      Description

      As MapReduce is a batch framework of calculation, so people may want to run application A as well as application B 、C, and a limit resource be put on A. A good way to do so is that we can limit the number of application's map task or reduce task. If we set mapreduce.map.num.max as M, then the map task number will not exceed M. At the same time, if we set mapreduce.map.num.max as R, then the reduce task number will not exceed R

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                yanghaogn Yang Hao
                Reporter:
                yanghaogn Yang Hao
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: