Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-2572 Enhancements to the ReservationSytem/Planner
  3. YARN-4360

Improve GreedyReservationAgent to support "early" allocations, and performance improvements

    XMLWordPrintableJSON

Details

    Description

      The GreedyReservationAgent allocates "as late as possible". Per various conversations, it seems useful to have a mirror behavior that allocates as early as possible. Also in the process we leverage improvements from YARN-4358, and implement an RLE-aware StageAllocatorGreedy(RLE), which significantly speeds up allocation.

      Attachments

        1. YARN-4360.2.patch
          40 kB
          Carlo Curino
        2. YARN-4360.3.patch
          40 kB
          Carlo Curino
        3. YARN-4360.5.patch
          41 kB
          Carlo Curino
        4. YARN-4360.6.patch
          41 kB
          Carlo Curino
        5. YARN-4360.7.patch
          40 kB
          Carlo Curino
        6. YARN-4360.8.patch
          40 kB
          Carlo Curino
        7. YARN-4360.patch
          40 kB
          Carlo Curino

        Issue Links

          depends upon

          Sub-task - The sub-task of the issue YARN-4358 Improve relationship between SharingPolicy and ReservationAgent

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              curino Carlo Curino
              curino Carlo Curino
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: