Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-4256

YARN fair scheduler vcores with decimal values

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 2.7.1
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: fairscheduler
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      When the queue with vcores is in decimal value, the value after the decimal point is taken as vcores by FairScheduler.

      For the below queue,

      <minResources>20000 mb,20 vcores,20.25 disks</minResources>
      <maxResources>30000 mb,40.2 vcores,30.25 disks</maxResources>

      When many applications submitted parallely into queue, all were in PENDING state as the vcores is taken as 2 skipping the value 40.

      The code FairSchedulerConfiguration.java to Pattern match the vcores has to be improved in such a way either throw AllocationConfigurationException("Missing resource") or consider the value before decimal.

        Attachments

        1. YARN-4256.001.patch
          3 kB
          Jun Gong
        2. YARN-4256.002.patch
          3 kB
          Jun Gong

          Activity

            People

            • Assignee:
              hex108 Jun Gong
              Reporter:
              Prabhu Joseph Prabhu Joseph
            • Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: