Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-5541 Handling of opportunistic containers in the NM
  3. YARN-5886

Dynamically prioritize execution of opportunistic containers (NM queue reordering)

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Currently the ContainerScheduler in the NM picks the next queued opportunistic container to be executed in a FIFO manner. That is, we first execute containers that arrived first at the NM.

      This JIRA proposes to add pluggable queue reordering strategies at the NM that will dynamically determine which opportunistic container will be executed next.
      For example, we can choose to prioritize containers that belong to jobs which are closer to completion, or containers that are short-running (if such information is available).

        Attachments

          Activity

            People

            • Assignee:
              abmodi Abhishek Modi
              Reporter:
              kkaranasos Konstantinos Karanasos
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated: