Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-6828 [Umbrella] Container preemption using OPPORTUNISTIC containers
  3. YARN-6808

Allow Schedulers to return OPPORTUNISTIC containers when queues go over configured capacity

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      This is based on discussions with kasha and kkaranasos.
      Currently, when a Queues goes over capacity, apps on starved queues must wait either for containers to complete or for them to be pre-empted by the scheduler to get resources.
      This JIRA proposes to allow Schedulers to:

      1. Allocate all containers over the configured queue capacity/weight as OPPORTUNISTIC.
      2. Auto-promote running OPPORTUNISTIC containers of apps as and when their GUARANTEED containers complete.

      Attachments

        1. YARN-6808.002.patch
          34 kB
          Arun Suresh
        2. YARN-6808.001.patch
          22 kB
          Arun Suresh

        Activity

          People

            asuresh Arun Suresh
            asuresh Arun Suresh
            Votes:
            0 Vote for this issue
            Watchers:
            12 Start watching this issue

            Dates

              Created:
              Updated: