Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-7274

Enable to limit running map and reduce tasks when job is running

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Patch Available
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: mr-am, mrv2
    • Labels:
      None

      Description

      MRv2 enabled users to control the number of map or reduce tasks running simultaneously by configuration  mapreduce.job.running.map.limit or mapreduce.job.running.reduce.limit. But users can only set limit number before submitting the job to rm. So, it's meaningful  to enable users to set the limit of running map or reduce tasks when job is running, which can help users to restrict  resource usage of job and give resources to high-priority job.

        Attachments

        1. MAPREDUCE-7274.patch
          47 kB
          Chengwei Wang
        2. MAPREDUCE-7274.002.patch
          50 kB
          Chengwei Wang

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                smarthan Chengwei Wang
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated: