Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-5541 Handling of opportunistic containers in the NM
  3. YARN-5886

Dynamically prioritize execution of opportunistic containers (NM queue reordering)

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      Currently the ContainerScheduler in the NM picks the next queued opportunistic container to be executed in a FIFO manner. That is, we first execute containers that arrived first at the NM.

      This JIRA proposes to add pluggable queue reordering strategies at the NM that will dynamically determine which opportunistic container will be executed next.
      For example, we can choose to prioritize containers that belong to jobs which are closer to completion, or containers that are short-running (if such information is available).

      Attachments

        Activity

          People

            abmodi Abhishek Modi
            kkaranasos Konstantinos Karanasos
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated: