Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-2572

Enhancements to the ReservationSytem/Planner

    Details

      Description

      YARN-1051 introduces a ReservationSytem/Planner that enables the YARN RM to handle time expilicitly, i.e. users can now "reserve" capacity ahead of time which is predictably allocated to them. This is an umbrella JIRA to enhance the reservation system by integrating with FairScheduler, RM failover mechanism, etc.

        Attachments

          Issue Links

          1.
          Track time-to-allocation for different size containers Sub-task Resolved Carlo Curino
          2.
          Create separate ACLs for Reservation create/update/delete/list ops Sub-task Resolved Sean Po
          3.
          Example of use for the ReservationSystem Sub-task Open Carlo Curino
          4.
          Improve RM webapp to expose info about reservations. Sub-task Patch Available Íñigo Goiri
          5.
          Improve Gridmix (synthetic generator + reservation support) Sub-task Resolved Carlo Curino
          6.
          Add efficient merge operation to RLESparseResourceAllocation Sub-task Resolved Carlo Curino
          7.
          Allow jobs to be submitted to reservation that is active but does not have any allocations Sub-task Closed Subru Krishnan
          8.
          Refactor the reservation system test cases to use parameterized base test Sub-task Resolved Subru Krishnan
          9.
          LowCost: A Cost-Based Placement Agent for YARN Reservations Sub-task Resolved Jonathan Yaniv
          10.
          REST API for submit/update/delete Reservations Sub-task Resolved Carlo Curino
          11.
          Add "list" API to reservation system Sub-task Resolved Sean Po
          12.
          Improve relationship between SharingPolicy and ReservationAgent Sub-task Resolved Carlo Curino
          13.
          Improve GreedyReservationAgent to support "early" allocations, and performance improvements Sub-task Resolved Carlo Curino
          14.
          Add REST API for List Reservations Sub-task Resolved Sean Po
          15.
          Document the general ReservationSystem functionality, and the REST API Sub-task Resolved Carlo Curino
          16.
          Document the List Reservations REST API Sub-task Resolved Sean Po
          17.
          Document Reservation ACLs Sub-task Resolved Sean Po
          18.
          Refactor the nested reservation id field in listReservation to simple string field Sub-task Resolved Subru Krishnan
          19.
          Replace numbers with enums for ReservationRequestInterpreter in Reservation REST APIs Sub-task Open Subru Krishnan
          20.
          Remove redundant code in ClientRMService::listReservations Sub-task Resolved Subru Krishnan
          21.
          Document configuration of ReservationSystem for CapacityScheduler Sub-task Resolved Subru Krishnan
          22.
          Document configuration of ReservationSystem for FairScheduler Sub-task Resolved Yufei Gu
          23.
          [Bug] Unable to submit a job to a reservation when using FairScheduler Sub-task Resolved Yufei Gu
          24.
          Document how to pass ReservationId through the RM REST API Sub-task Resolved Subru Krishnan
          25.
          Add getNewReservation in ApplicationClientProtocol Sub-task Resolved Sean Po
          26.
          Use plan RLE to improve CapacityOverTimePolicy efficiency Sub-task Resolved Carlo Curino
          27.
          Fix NoOvercommitPolicy to take advantage of RLE representation of plan Sub-task Resolved Carlo Curino
          28.
          StageAllocaterGreedyRLE: Fix NPE in corner case Sub-task Resolved Carlo Curino
          29.
          Fix bug in RLESparseResourceAllocation.getRangeOverlapping(...) Sub-task Resolved Ishai Menache
          30.
          Fix TestRMWebServicesReservation parametrization for fair scheduler Sub-task Resolved Yufei Gu
          31.
          Extending Synthetic Load Generator and SLS for recurring reservation Sub-task Patch Available Carlo Curino

            Activity

              People

              • Assignee:
                subru Subru Krishnan
                Reporter:
                subru Subru Krishnan
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated: