Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-807

When querying apps by queue, iterating over all apps is inefficient and limiting

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 2.0.4-alpha
    • 2.3.0
    • None
    • None
    • Reviewed

    Description

      The question "which apps are in queue x" can be asked via the RM REST APIs, through the ClientRMService, and through the command line. In all these cases, the question is answered by scanning through every RMApp and filtering by the app's queue name.

      All schedulers maintain a mapping of queues to applications. I think it would make more sense to ask the schedulers which applications are in a given queue. This is what was done in MR1. This would also have the advantage of allowing a parent queue to return all the applications on leaf queues under it, and allow queue name aliases, as in the way that "root.default" and "default" refer to the same queue in the fair scheduler.

      Attachments

        1. YARN-807-4.patch
          36 kB
          Sandy Ryza
        2. YARN-807-3.patch
          35 kB
          Sandy Ryza
        3. YARN-807-2.patch
          30 kB
          Sandy Ryza
        4. YARN-807-1.patch
          33 kB
          Sandy Ryza
        5. YARN-807.patch
          31 kB
          Sandy Ryza

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            sandyr Sandy Ryza
            sandyr Sandy Ryza
            Votes:
            0 Vote for this issue
            Watchers:
            13 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment