Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-45 [Preemption] Scheduler feedback to AM to release containers
  3. YARN-3784

Indicate preemption timout along with the list of containers to AM (preemption message)

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • scheduler preemption

    Description

      Currently during preemption, AM is notified with a list of containers which are marked for preemption. Introducing a timeout duration also along with this container list so that AM can know how much time it will get to do a graceful shutdown to its containers (assuming one of preemption policy is loaded in AM).
      This will help in decommissioning NM scenarios, where NM will be decommissioned after a timeout (also killing containers on it). This timeout will be helpful to indicate AM that those containers can be killed by RM forcefully after the timeout.

      Attachments

        1. 0004-YARN-3784.patch
          34 kB
          Sunil G
        2. 0003-YARN-3784.patch
          34 kB
          Sunil G
        3. 0002-YARN-3784.patch
          34 kB
          Sunil G
        4. 0001-YARN-3784.patch
          23 kB
          Sunil G

        Issue Links

          Activity

            People

              sunilg Sunil G
              sunilg Sunil G
              Votes:
              0 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

                Created:
                Updated: