Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1723

Capacity Scheduler should allow configuration of Map & Reduce task slots independently per queue

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Won't Fix
    • 0.20.1
    • None
    • capacity-sched
    • None
    • all

    Description

      The Capacity Scheduler allows configuration of percentage of task slots per queue. We have a scenario in which our biggest queue (50% quota) has Jobs with mainly Map tasks & we need to enforce strict capacity limits per queue due to SLA requirements. So other smaller queues which require Reduce tasks gets starved even though the Reduce slots are idle. The Grid can be more efficiently utilized if Capacity Scheduler allows configuration of Map & Reduce task slots capacity independently per queue.

      Attachments

        Activity

          People

            Unassigned Unassigned
            subru Subramaniam Krishnan
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: