Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-807

When querying apps by queue, iterating over all apps is inefficient and limiting

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.0.4-alpha
    • Fix Version/s: 2.3.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      The question "which apps are in queue x" can be asked via the RM REST APIs, through the ClientRMService, and through the command line. In all these cases, the question is answered by scanning through every RMApp and filtering by the app's queue name.

      All schedulers maintain a mapping of queues to applications. I think it would make more sense to ask the schedulers which applications are in a given queue. This is what was done in MR1. This would also have the advantage of allowing a parent queue to return all the applications on leaf queues under it, and allow queue name aliases, as in the way that "root.default" and "default" refer to the same queue in the fair scheduler.

        Attachments

        1. YARN-807-4.patch
          36 kB
          Sandy Ryza
        2. YARN-807-3.patch
          35 kB
          Sandy Ryza
        3. YARN-807-2.patch
          30 kB
          Sandy Ryza
        4. YARN-807-1.patch
          33 kB
          Sandy Ryza
        5. YARN-807.patch
          31 kB
          Sandy Ryza

          Issue Links

            Activity

              People

              • Assignee:
                sandyr Sandy Ryza
                Reporter:
                sandyr Sandy Ryza
              • Votes:
                0 Vote for this issue
                Watchers:
                13 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: