Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-5990 [Umbrella] Follow-up (phase-2) FairScheduler preemption improvements
  3. YARN-6163

FS Preemption is a trickle for severely starved applications

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.9.0
    • 2.9.0, 3.0.0-alpha4
    • fairscheduler
    • None
    • Reviewed

    Description

      With current logic, only one RR is considered per each instance of marking an application starved. This marking happens only on the update call that runs every 500ms. Due to this, an application that is severely starved takes forever to reach fairshare based on preemptions.

      Attachments

        1. yarn-6163-1.patch
          40 kB
          Karthik Kambatla
        2. yarn-6163-2.patch
          49 kB
          Karthik Kambatla
        3. YARN-6163.004.patch
          50 kB
          Karthik Kambatla
        4. YARN-6163.005.patch
          50 kB
          Karthik Kambatla
        5. YARN-6163.006.patch
          51 kB
          Karthik Kambatla

        Issue Links

          blocks

          Sub-task - The sub-task of the issue YARN-5832 Preemption should consider more resource-requests of a starved app if the initial set can not be satisfied

          • Major - Major loss of function.
          • Open

          Sub-task - The sub-task of the issue YARN-6193 FairScheduler might not trigger preemption when using DRF

          • Major - Major loss of function.
          • Resolved
          links to

          Web Link GitHub Pull Request #192

          Activity

            People

              kasha Karthik Kambatla
              kasha Karthik Kambatla
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: