Uploaded image for project: 'Apache YuniKorn'
  1. Apache YuniKorn
  2. YUNIKORN-1573

[Umbrella] User & Group Based Quota Enforcement

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 1.4.0
    • None

    Description

      Enforcing resource allocation usage is currently limited to a queue. As part of the allocation process for an application, which owns the allocation, triggers an update of the resource usage for users and groups. Please read the design doc https://docs.google.com/document/d/1yCZSoHTrsistHktmPwgreY05u26eI35XwOYdHWP0LrQ/edit#

      Attachments

        1.
        Configuration processing to support limit new wildcard interpretation syntax checking Sub-task Closed Qi Zhu
        2.
        Check there must be one more limit setting for group with specific name defined in the config when use wildcard group limit Sub-task Closed Qi Zhu
        3.
        Configuration processing should support limit quota check at the same level. Sub-task Closed Qi Zhu
        4.
        Configuration processing should support limit hierarchical quota check. Sub-task Closed Qi Zhu
        5.
        Configuration updates and storage for limit Sub-task Closed Manikandan R
        6.
        Enforcement changes for User Based Quota Sub-task Closed Manikandan R
        7.
        publish quota enforcement design doc Sub-task Closed Wilfred Spiegelenburg
        8.
        Doc need to change for new limit wildcard interpretation syntax rule check. Sub-task Closed Manikandan R
        9.
        Add E2E test for User & Group Based Quota Enforcement Sub-task Closed PoAn Yang
        10.
        Remove manager#cleaner method Sub-task Closed PoAn Yang
        11.
        Calculate user/group headroom Sub-task Closed Manikandan R
        12.
        User belong to zero or multiple groups Sub-task Closed Manikandan R
        13.
        Refactoring QueueTracker Sub-task Closed Manikandan R
        14.
        Handle group resource usage properly during config changes Sub-task Closed Manikandan R
        15.
        Remove unused code in processUserConfig and processGroupConfig Sub-task Closed PoAn Yang
        16.
        Apply wild card group limit settings for users without any matching group Sub-task Closed Manikandan R
        17.
        Improving test coverage for whole user/group enforcement feature Sub-task Closed PoAn Yang
        18.
        Remove misleading error message from QueueTracker Sub-task Closed Manikandan R
        19.
        Expose app wise resource usage in REST API Sub-task Closed Manikandan R
        20.
        Group tracker decrease resource usage incorrectly Sub-task Closed PoAn Yang
        21.
        Align headroom and resource tracking resolution logic Sub-task Closed Wilfred Spiegelenburg
        22.
        Align maxApplications and resource tracking resolution logic Sub-task Closed PoAn Yang
        23.
        headroom calculation fails if parent has usage and max set Sub-task Closed Wilfred Spiegelenburg
        24.
        Keep group tracker if it's from a specific limit to wildcard limit Sub-task Closed PoAn Yang
        25.
        Auto scaling logic should consider the user based quota Sub-task Closed Qi Zhu
        26.
        Remove getChildQueuePath method Sub-task Closed PoAn Yang
        27.
        Queue Limits configuration at same level should not compare each other Sub-task Closed Manikandan R
        28.
        canRunApp should be called from tryReservedAllocate also Sub-task Closed PoAn Yang
        29.
        group quota is not considered during pod scheduling Sub-task Closed Manikandan R
        30.
        Add base type to UserTracker and GroupTracker to reduce code duplications Sub-task Closed Peter Bacsko
        31.
        Queue tracker object is not cleaned up when a queue is deleted Sub-task Closed Qi Zhu
        32.
        QueueTracker: extract common code from increaseTrackedResource/decreaseTrackedResource and remove getRunningApplications() Sub-task Closed Peter Bacsko
        33.
        [website] REST API doc changes in Yunikorn Website Sub-task Closed Qi Zhu

        Activity

          People

            zhuqi Qi Zhu
            as2 Jagadeesan A S
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: