Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-5541 Handling of opportunistic containers in the NM
  3. YARN-5887

Policies for choosing which opportunistic containers to kill

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      When a guaranteed container arrives at an NM but there are no resources to start its execution, opportunistic containers will be killed to make space for the guaranteed container.

      At the moment, we kill opportunistic containers in reverse order of arrival (first the most recently started ones). This is not always the right decision.
      For example, we might want to minimize the number of containers killed: to start a 6GB container, we could kill one 6GB opportunistic or three 2GB ones.
      Another example would be to refrain from killing containers of jobs that are very close to completion (we have to pass job completion information to the NM in that case).

        Attachments

          Activity

            People

            • Assignee:
              abmodi Abhishek Modi
              Reporter:
              kkaranasos Konstantinos Karanasos
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated: