Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-853

Support a hierarchy of queues in the Map/Reduce framework

    Details

    • Type: New Feature
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.21.0
    • Component/s: jobtracker
    • Labels:
      None

      Description

      In MAPREDUCE-824, we proposed introducing a hierarchy of queues in the capacity scheduler. Currently, the M/R framework provides the notion of job queues and handles some functionality related to queues in a scheduler-agnostic manner. This functionality includes:

      • Managing the list of ACLs for queues
      • Managing the run state of queues - running or stopped
      • Displaying scheduling information about queues in the jobtracker web UI and job client CLI
      • Displaying list of jobs in a queue in the jobtracker web UI and job client CLI
      • Providing APIs for list queues and queue information in JobClient.

      Since it would be beneficial to extend this functionality to hierarchical queues, this JIRA is proposing introducing the concept into the map/reduce framework as well. We could treat this as an umbrella JIRA and file additional tasks for each of the changes involved, sticking to the high level approach in this JIRA.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              yhemanth Hemanth Yamijala
            • Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: