Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-2572 Enhancements to the ReservationSytem/Planner
  3. YARN-5164

Use plan RLE to improve CapacityOverTimePolicy efficiency

    XMLWordPrintableJSON

Details

    • Reviewed

    Description

      As a consequence small time granularities (e.g., 1 sec) and long time horizon for a reservation (e.g., months) run rather slow (10 sec).

      Proposed resolution is to switch to interval math in checking, similar to how YARN-4359 does for agents.

      Attachments

        1. YARN-5164.1.patch
          12 kB
          Carlo Curino
        2. YARN-5164.2.patch
          13 kB
          Carlo Curino
        3. YARN-5164.5.patch
          16 kB
          Carlo Curino
        4. YARN-5164.6.patch
          16 kB
          Carlo Curino
        5. YARN-5164.7.patch
          21 kB
          Carlo Curino
        6. YARN-5164.8.patch
          21 kB
          Carlo Curino
        7. YARN-5164-example.pdf
          137 kB
          Carlo Curino
        8. YARN-5164-inclusive.4.patch
          23 kB
          Carlo Curino
        9. YARN-5164-inclusive.5.patch
          23 kB
          Carlo Curino

        Issue Links

          depends upon

          Sub-task - The sub-task of the issue YARN-4525 Fix bug in RLESparseResourceAllocation.getRangeOverlapping(...)

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue YARN-5185 StageAllocaterGreedyRLE: Fix NPE in corner case

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              curino Carlo Curino
              curino Carlo Curino
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: