Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-807

When querying apps by queue, iterating over all apps is inefficient and limiting

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 2.0.4-alpha
    • 2.3.0
    • None
    • None
    • Reviewed

    Description

      The question "which apps are in queue x" can be asked via the RM REST APIs, through the ClientRMService, and through the command line. In all these cases, the question is answered by scanning through every RMApp and filtering by the app's queue name.

      All schedulers maintain a mapping of queues to applications. I think it would make more sense to ask the schedulers which applications are in a given queue. This is what was done in MR1. This would also have the advantage of allowing a parent queue to return all the applications on leaf queues under it, and allow queue name aliases, as in the way that "root.default" and "default" refer to the same queue in the fair scheduler.

      Attachments

        1. YARN-807.patch
          31 kB
          Sandy Ryza
        2. YARN-807-1.patch
          33 kB
          Sandy Ryza
        3. YARN-807-2.patch
          30 kB
          Sandy Ryza
        4. YARN-807-3.patch
          35 kB
          Sandy Ryza
        5. YARN-807-4.patch
          36 kB
          Sandy Ryza

        Issue Links

          Activity

            People

              sandyr Sandy Ryza
              sandyr Sandy Ryza
              Votes:
              0 Vote for this issue
              Watchers:
              13 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: