Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-1941

Yarn scheduler ACL improvement

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 2.3.0
    • None
    • scheduler

    Description

      Defect:
      1. Currently, in Yarn Capacity Scheduler and Yarn Fair Scheduler, the queue ACL is always checked when submitting a app to scheduler, regardless of the property "yarn.acl.enable".
      But for killing an app, the ACL is checked when yarn.acl.enable is set.
      The behaviour is not consistent.

      2. default ACL for root queue is EVERYBODY_ACL( * ), while default ACL for other queues is NODODY_ACL( ). From users' view, this is error prone and not easy to understand the ACL policy of Yarn scheduler. root queue should not be so special compared with other parent queues.
      For example, if I want to set capacity scheduler ACL, the ACL of root has to be set explicitly. Otherwise, everyone can submit APP to yarn scheduler. Because root queue ACL is EVERYBODY_ACL.
      This is hard for user to administrate yarn scheduler.

      So, I propose to improve the ACL of yarn scheduler in the following aspects.
      1. only enable scheduler queue ACL when yarn.acl.enable is set to true.
      2. set the default ACL of root queue as NOBODY_ACL( ). Make all the parent queues' ACL consistent.

      Attachments

        Issue Links

          Activity

            People

              wangg23 Gordon Wang
              wangg23 Gordon Wang
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated: