Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-2572

Enhancements to the ReservationSytem/Planner

    XMLWordPrintableJSON

Details

    Description

      YARN-1051 introduces a ReservationSytem/Planner that enables the YARN RM to handle time expilicitly, i.e. users can now "reserve" capacity ahead of time which is predictably allocated to them. This is an umbrella JIRA to enhance the reservation system by integrating with FairScheduler, RM failover mechanism, etc.

      Attachments

        Issue Links

          is related to

          Improvement - An improvement or enhancement to an existing feature or task. YARN-1051 YARN Admission Control/Planner: enhancing the resource allocation model with time.

          • Major - Major loss of function.
          • Closed
          relates to

          Sub-task - The sub-task of the issue YARN-3656 LowCost: A Cost-Based Placement Agent for YARN Reservations

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. YARN-5326 Support for recurring reservations in the YARN ReservationSystem

          • Major - Major loss of function.
          • Resolved
          1.
          		 Track time-to-allocation for different size containers Sub-task Resolved Carlo Curino
          2.
          		 Create separate ACLs for Reservation create/update/delete/list ops Sub-task Resolved Sean Po
          3.
          		 Example of use for the ReservationSystem Sub-task Open Carlo Curino
          4.
          		 Improve RM webapp to expose info about reservations. Sub-task Patch Available Íñigo Goiri
          5.
          		 Improve Gridmix (synthetic generator + reservation support) Sub-task Resolved Carlo Curino
          6.
          		 Add efficient merge operation to RLESparseResourceAllocation Sub-task Resolved Carlo Curino
          7.
          		 Allow jobs to be submitted to reservation that is active but does not have any allocations Sub-task Closed Subramaniam Krishnan
          8.
          		 Refactor the reservation system test cases to use parameterized base test Sub-task Resolved Subramaniam Krishnan
          9.
          		 LowCost: A Cost-Based Placement Agent for YARN Reservations Sub-task Resolved Jonathan Yaniv
          10.
          		 REST API for submit/update/delete Reservations Sub-task Resolved Carlo Curino
          11.
          		 Add "list" API to reservation system Sub-task Resolved Sean Po
          12.
          		 Improve relationship between SharingPolicy and ReservationAgent Sub-task Resolved Carlo Curino
          13.
          		 Improve GreedyReservationAgent to support "early" allocations, and performance improvements Sub-task Resolved Carlo Curino
          14.
          		 Add REST API for List Reservations Sub-task Resolved Sean Po
          15.
          		 Document the general ReservationSystem functionality, and the REST API Sub-task Resolved Carlo Curino
          16.
          		 Document the List Reservations REST API Sub-task Resolved Sean Po
          17.
          		 Document Reservation ACLs Sub-task Resolved Sean Po
          18.
          		 Refactor the nested reservation id field in listReservation to simple string field Sub-task Resolved Subramaniam Krishnan
          19.
          		 Replace numbers with enums for ReservationRequestInterpreter in Reservation REST APIs Sub-task Open Subramaniam Krishnan
          20.
          		 Remove redundant code in ClientRMService::listReservations Sub-task Resolved Subramaniam Krishnan
          21.
          		 Document configuration of ReservationSystem for CapacityScheduler Sub-task Resolved Subramaniam Krishnan
          22.
          		 Document configuration of ReservationSystem for FairScheduler Sub-task Resolved Yufei Gu
          23.
          		 [Bug] Unable to submit a job to a reservation when using FairScheduler Sub-task Resolved Yufei Gu
          24.
          		 Document how to pass ReservationId through the RM REST API Sub-task Resolved Subramaniam Krishnan
          25.
          		 Add getNewReservation in ApplicationClientProtocol Sub-task Resolved Sean Po
          26.
          		 Use plan RLE to improve CapacityOverTimePolicy efficiency Sub-task Resolved Carlo Curino
          27.
          		 Fix NoOvercommitPolicy to take advantage of RLE representation of plan Sub-task Resolved Carlo Curino
          28.
          		 StageAllocaterGreedyRLE: Fix NPE in corner case Sub-task Resolved Carlo Curino
          29.
          		 Fix bug in RLESparseResourceAllocation.getRangeOverlapping(...) Sub-task Resolved Ishai Menache
          30.
          		 Fix TestRMWebServicesReservation parametrization for fair scheduler Sub-task Resolved Yufei Gu
          31.
          		 Extending Synthetic Load Generator and SLS for recurring reservation Sub-task Patch Available Carlo Curino

          Activity

            People

              subru Subramaniam Krishnan
              subru Subramaniam Krishnan
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated: