Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-2572 Enhancements to the ReservationSytem/Planner
  3. YARN-3454

Add efficient merge operation to RLESparseResourceAllocation

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.8.0, 2.7.1, 2.6.2
    • 2.8.0, 3.0.0-alpha1
    • resourcemanager
    • None

    Description

      The RLESparseResourceAllocation.removeInterval(...) method handles well exact match interval removals, but does not handles correctly partial overlaps.
      In the context of this fix, we also introduced static methods to "merge" two RLESparseResourceAllocation, while applying an operator in the process (add/subtract/min/max/subtractTestPositive)

      Attachments

        1. YARN-3454.5.patch
          42 kB
          Carlo Curino
        2. YARN-3454.4.patch
          42 kB
          Carlo Curino
        3. YARN-3454.3.patch
          41 kB
          Carlo Curino
        4. YARN-3454.2.patch
          41 kB
          Carlo Curino
        5. YARN-3454.1.patch
          37 kB
          Carlo Curino
        6. YARN-3454.patch
          36 kB
          Carlo Curino

        Issue Links

          is depended upon by

          Sub-task - The sub-task of the issue YARN-4358 Improve relationship between SharingPolicy and ReservationAgent

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              curino Carlo Curino
              curino Carlo Curino
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: