Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-2572 Enhancements to the ReservationSytem/Planner
  3. YARN-4360

Improve GreedyReservationAgent to support "early" allocations, and performance improvements

VotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    Description

      The GreedyReservationAgent allocates "as late as possible". Per various conversations, it seems useful to have a mirror behavior that allocates as early as possible. Also in the process we leverage improvements from YARN-4358, and implement an RLE-aware StageAllocatorGreedy(RLE), which significantly speeds up allocation.

      Attachments

        1. YARN-4360.patch
          40 kB
          Carlo Curino
        2. YARN-4360.2.patch
          40 kB
          Carlo Curino
        3. YARN-4360.3.patch
          40 kB
          Carlo Curino
        4. YARN-4360.5.patch
          41 kB
          Carlo Curino
        5. YARN-4360.6.patch
          41 kB
          Carlo Curino
        6. YARN-4360.7.patch
          40 kB
          Carlo Curino
        7. YARN-4360.8.patch
          40 kB
          Carlo Curino

        Issue Links

        depends upon

        Sub-task - The sub-task of the issue YARN-4358 Improve relationship between SharingPolicy and ReservationAgent

        • Major - Major loss of function.
        • Resolved

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            curino Carlo Curino
            curino Carlo Curino
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment