Details

    • Type: Sub-task Sub-task
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.21.0
    • Component/s: jobtracker
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      Added support for hierarchical queues in the Map/Reduce framework with the following changes:
      - mapred-queues.xml is modified to a new XML template as mentioned in the JIRA.
      - Modified JobQueueInfo to contain a handle to child queues.
      - Added new APIs in the client to get 'root' queues, so that the entire hierarchy of queues can be iterated.
      -Added new APIs to get the child queues for a given queue .
      Show
      Added support for hierarchical queues in the Map/Reduce framework with the following changes: - mapred-queues.xml is modified to a new XML template as mentioned in the JIRA. - Modified JobQueueInfo to contain a handle to child queues. - Added new APIs in the client to get 'root' queues, so that the entire hierarchy of queues can be iterated. -Added new APIs to get the child queues for a given queue .

      Description

      MAPREDUCE-853 proposes to introduce a hierarchy of queues into the Map/Reduce framework. This JIRA is for defining changes to the configuration related to queues.

      The current format for defining a queue and its properties is as follows: mapred.queue.<queue-name>.<property-name>. For e.g. mapred.queue.<queue-name>.acl-submit-job. The reason for using this verbose format was to be able to reuse the Configuration parser in Hadoop. However, administrators currently using the queue configuration have already indicated a very strong desire for a more manageable format. Since, this becomes more unwieldy with hierarchical queues, the time may be good to introduce a new format for representing queue configuration.

      1. MAPREDUCE-861-1.patch
        114 kB
        rahul k singh
      2. MAPREDUCE-861-2.patch
        127 kB
        Sreekanth Ramakrishnan
      3. MAPREDUCE-861-3.patch
        172 kB
        rahul k singh
      4. MAPREDUCE-861-4.patch
        168 kB
        rahul k singh
      5. MAPREDUCE-861-5.patch
        166 kB
        rahul k singh
      6. MAPREDUCE-861-6.patch
        178 kB
        rahul k singh
      7. MAPREDUCE-861-7.patch
        179 kB
        rahul k singh

        Issue Links

          Activity

          Hemanth Yamijala created issue -
          rahul k singh made changes -
          Field Original Value New Value
          Assignee rahul k singh [ rksingh ]
          Vinod Kumar Vavilapalli made changes -
          Link This issue blocks MAPREDUCE-893 [ MAPREDUCE-893 ]
          rahul k singh made changes -
          Attachment MAPREDUCE-861-1.patch [ 12417912 ]
          rahul k singh made changes -
          Attachment MAPREDUCE-860-2.patch [ 12418100 ]
          rahul k singh made changes -
          Attachment MAPREDUCE-860-2.patch [ 12418100 ]
          Sreekanth Ramakrishnan made changes -
          Attachment MAPREDUCE-861-2.patch [ 12418111 ]
          rahul k singh made changes -
          Attachment MAPREDUCE-861-3.patch [ 12418482 ]
          rahul k singh made changes -
          Attachment MAPREDUCE-861-4.patch [ 12418776 ]
          rahul k singh made changes -
          Attachment MAPREDUCE-861-5.patch [ 12418777 ]
          rahul k singh made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          rahul k singh made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          rahul k singh made changes -
          Attachment MAPREDUCE-861-6.patch [ 12419063 ]
          rahul k singh made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          rahul k singh made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          rahul k singh made changes -
          Attachment MAPREDUCE-861-7.patch [ 12419265 ]
          rahul k singh made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          rahul k singh made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          rahul k singh made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Hemanth Yamijala made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Hemanth Yamijala made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Hemanth Yamijala made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags [Reviewed]
          Fix Version/s 0.21.0 [ 12314045 ]
          Resolution Fixed [ 1 ]
          Hemanth Yamijala made changes -
          Release Note Added support for hierarchical queues in the Map/Reduce framework with the following changes:
          - mapred-queues.xml is modified to a new XML template as mentioned in the JIRA.
          - Modified JobQueueInfo to contain a handle to child queues.
          - Added new APIs in the client to get 'root' queues, so that the entire hierarchy of queues can be iterated.
          Component/s jobtracker [ 12312907 ]
          rahul k singh made changes -
          Release Note Added support for hierarchical queues in the Map/Reduce framework with the following changes:
          - mapred-queues.xml is modified to a new XML template as mentioned in the JIRA.
          - Modified JobQueueInfo to contain a handle to child queues.
          - Added new APIs in the client to get 'root' queues, so that the entire hierarchy of queues can be iterated.
          Added support for hierarchical queues in the Map/Reduce framework with the following changes:
          - mapred-queues.xml is modified to a new XML template as mentioned in the JIRA.
          - Modified JobQueueInfo to contain a handle to child queues.
          - Added new APIs in the client to get 'root' queues, so that the entire hierarchy of queues can be iterated.
          -Added new APIs to get the child queues for a given queue .
          Tom White made changes -
          Status Resolved [ 5 ] Closed [ 6 ]

            People

            • Assignee:
              rahul k singh
              Reporter:
              Hemanth Yamijala
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development