Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-5724

[Umbrella] Better Queue Management in YARN

    XMLWordPrintableJSON

    Details

    • Type: Task
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: capacity scheduler
    • Labels:
      None

      Description

      This serves as an umbrella ticket for tasks related to better queue management in YARN.

      Today's the only way to manage the queue is through admins editing configuration files and then issuing a refresh command. This will bring many inconveniences. For example, the users can not create / delete /modify their own queues without talking to site level admins.

      Even in today's approach (configuration-based), we still have several places needed to improve:

      • It is possible today to add or modify queues without restarting the RM, via a CS refresh. But for deleting queue, we have to restart the resourcemanager.
      • When a queue is STOPPED, resources allocated to the queue can be handled better. Currently, they'll only be used if the other queues are setup to go over their capacity.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                xgong Xuan Gong
                Reporter:
                xgong Xuan Gong
              • Votes:
                1 Vote for this issue
                Watchers:
                23 Start watching this issue

                Dates

                • Created:
                  Updated: