Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-9173

FairShare calculation broken for large values after YARN-8833

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.3.0
    • Fix Version/s: 3.0.4, 3.1.2, 3.3.0, 3.2.1
    • Component/s: fairscheduler
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      After the fix for the infinite loop in YARN-8833 we now get the wrong values back for fairshare calculations under certain circumstances. The current implementation works when the total resource is smaller than Integer.MAXVALUE.

      When the total resource goes above that value the number of iterations is not enough to converge to the correct value.

      The new test testResourceUsedWithWeightToResourceRatio() only checks that the calculation does not hang but does not check the outcome of the calculation.

        Attachments

        1. YARN-9137-branch-3.1.001.patch
          14 kB
          Weiwei Yang
        2. YARN-9137-branch3.1.001.patch
          14 kB
          Wilfred Spiegelenburg
        3. YARN-9173.002.patch
          15 kB
          Wilfred Spiegelenburg
        4. YARN-9173.001.patch
          14 kB
          Wilfred Spiegelenburg

          Issue Links

            Activity

              People

              • Assignee:
                wilfreds Wilfred Spiegelenburg
                Reporter:
                wilfreds Wilfred Spiegelenburg
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: