Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-7496

CS Intra-queue preemption user-limit calculations are not in line with LeafQueue user-limit calculations

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.8.2
    • Fix Version/s: 2.8.3
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Only a problem in 2.8.

      Preemption could oscillate due to the difference in how user limit is calculated between 2.8 and later releases.

      Basically (ignoring ULF, MULP, and maybe others), the calculation for user limit on the Capacity Scheduler side in 2.8 is total used resources / number of active users while the calculation in later releases is total active resources / number of active users. When intra-queue preemption was backported to 2.8, it's calculations for user limit were more aligned with the latter algorithm, which is in 2.9 and later releases.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                eepayne Eric Payne
                Reporter:
                eepayne Eric Payne
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: