Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-2572

Enhancements to the ReservationSytem/Planner

Add voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

      Description

      YARN-1051 introduces a ReservationSytem/Planner that enables the YARN RM to handle time expilicitly, i.e. users can now "reserve" capacity ahead of time which is predictably allocated to them. This is an umbrella JIRA to enhance the reservation system by integrating with FairScheduler, RM failover mechanism, etc.

        Attachments

        Issue Links

        1.
        Track time-to-allocation for different size containers Sub-task Resolved Carlo Curino Actions
        2.
        Create separate ACLs for Reservation create/update/delete/list ops Sub-task Resolved Sean Po Actions
        3.
        Example of use for the ReservationSystem Sub-task Open Carlo Curino Actions
        4.
        Improve RM webapp to expose info about reservations. Sub-task Patch Available Íñigo Goiri Actions
        5.
        Improve Gridmix (synthetic generator + reservation support) Sub-task Resolved Carlo Curino Actions
        6.
        Add efficient merge operation to RLESparseResourceAllocation Sub-task Resolved Carlo Curino Actions
        7.
        Allow jobs to be submitted to reservation that is active but does not have any allocations Sub-task Closed Subramaniam Krishnan Actions
        8.
        Refactor the reservation system test cases to use parameterized base test Sub-task Resolved Subramaniam Krishnan Actions
        9.
        LowCost: A Cost-Based Placement Agent for YARN Reservations Sub-task Resolved Jonathan Yaniv Actions
        10.
        REST API for submit/update/delete Reservations Sub-task Resolved Carlo Curino Actions
        11.
        Add "list" API to reservation system Sub-task Resolved Sean Po Actions
        12.
        Improve relationship between SharingPolicy and ReservationAgent Sub-task Resolved Carlo Curino Actions
        13.
        Improve GreedyReservationAgent to support "early" allocations, and performance improvements Sub-task Resolved Carlo Curino Actions
        14.
        Add REST API for List Reservations Sub-task Resolved Sean Po Actions
        15.
        Document the general ReservationSystem functionality, and the REST API Sub-task Resolved Carlo Curino Actions
        16.
        Document the List Reservations REST API Sub-task Resolved Sean Po Actions
        17.
        Document Reservation ACLs Sub-task Resolved Sean Po Actions
        18.
        Refactor the nested reservation id field in listReservation to simple string field Sub-task Resolved Subramaniam Krishnan Actions
        19.
        Replace numbers with enums for ReservationRequestInterpreter in Reservation REST APIs Sub-task Open Subramaniam Krishnan Actions
        20.
        Remove redundant code in ClientRMService::listReservations Sub-task Resolved Subramaniam Krishnan Actions
        21.
        Document configuration of ReservationSystem for CapacityScheduler Sub-task Resolved Subramaniam Krishnan Actions
        22.
        Document configuration of ReservationSystem for FairScheduler Sub-task Resolved Yufei Gu Actions
        23.
        [Bug] Unable to submit a job to a reservation when using FairScheduler Sub-task Resolved Yufei Gu Actions
        24.
        Document how to pass ReservationId through the RM REST API Sub-task Resolved Subramaniam Krishnan Actions
        25.
        Add getNewReservation in ApplicationClientProtocol Sub-task Resolved Sean Po Actions
        26.
        Use plan RLE to improve CapacityOverTimePolicy efficiency Sub-task Resolved Carlo Curino Actions
        27.
        Fix NoOvercommitPolicy to take advantage of RLE representation of plan Sub-task Resolved Carlo Curino Actions
        28.
        StageAllocaterGreedyRLE: Fix NPE in corner case Sub-task Resolved Carlo Curino Actions
        29.
        Fix bug in RLESparseResourceAllocation.getRangeOverlapping(...) Sub-task Resolved Ishai Menache Actions
        30.
        Fix TestRMWebServicesReservation parametrization for fair scheduler Sub-task Resolved Yufei Gu Actions
        31.
        Extending Synthetic Load Generator and SLS for recurring reservation Sub-task Patch Available Carlo Curino Actions

          Activity

            People

            • Assignee:
              subru Subramaniam Krishnan
              Reporter:
              subru Subramaniam Krishnan

              Dates

              • Created:
                Updated:

                Issue deployment