Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-5541 Handling of opportunistic containers in the NM
  3. YARN-5887

Policies for choosing which opportunistic containers to kill

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      When a guaranteed container arrives at an NM but there are no resources to start its execution, opportunistic containers will be killed to make space for the guaranteed container.

      At the moment, we kill opportunistic containers in reverse order of arrival (first the most recently started ones). This is not always the right decision.
      For example, we might want to minimize the number of containers killed: to start a 6GB container, we could kill one 6GB opportunistic or three 2GB ones.
      Another example would be to refrain from killing containers of jobs that are very close to completion (we have to pass job completion information to the NM in that case).

      Attachments

        Activity

          People

            abmodi Abhishek Modi
            kkaranasos Konstantinos Karanasos
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated: