Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-3945

maxApplicationsPerUser is wrongly calculated

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 2.7.1
    • None
    • capacityscheduler
    • None

    Description

      maxApplicationsPerUser is currently calculated based on the formula
      maxApplicationsPerUser = (int)(maxApplications * (userLimit / 100.0f) * userLimitFactor) but description of userlimit is

      Each queue enforces a limit on the percentage of resources allocated to a user at any given time, if there is demand for resources. The user limit can vary between a minimum and maximum value. The the former (the minimum value) is set to this property value and the latter (the maximum value) depends on the number of users who have submitted applications. For e.g., suppose the value of this property is 25. If two users have submitted applications to a queue, no single user can use more than 50% of the queue resources. If a third user submits an application, no single user can use more than 33% of the queue resources. With 4 or more users, no user can use more than 25% of the queues resources. A value of 100 implies no user limits are imposed. The default is 100. Value is specified as a integer.

      configuration related to minimum limit should not be made used in a formula to calculate max applications for a user

      Attachments

        1. YARN-3945.20150728-1.patch
          6 kB
          Naganarasimha G R
        2. YARN-3945.20150729-1.patch
          9 kB
          Naganarasimha G R
        3. YARN-3945.V1.003.patch
          9 kB
          Naganarasimha G R

        Activity

          People

            Naganarasimha Naganarasimha G R
            Naganarasimha Naganarasimha G R
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated: