Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-6769

Make schedulables without demand less needy in FairSharePolicy#compare

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.7.2
    • Fix Version/s: 2.9.0, 3.0.0-beta1
    • Component/s: fairscheduler
    • Labels:
      None
    • Target Version/s:

      Description

      When use fairsheduler as RM scheduler, before assign container we will sort all queues or applications.
      We will use FairSharePolicy#compare as the comparator´╝î but the comparator is not so perfect.
      It have a problem as blow:
      1. when a queue use resource over minShare(minResources), it will put behind the queue whose demand is zeor.
      so it will greater opportunity to get the resource although it do not want. It will waste schedule time when assign container
      to queue or application.

      I have fix it, and I will upload the patch to the jira.

        Attachments

        1. YARN-6769.001.patch
          2 kB
          YunFan Zhou
        2. YARN-6769.002.patch
          7 kB
          YunFan Zhou
        3. YARN-6769.003.patch
          5 kB
          YunFan Zhou
        4. YARN-6769.004.patch
          5 kB
          YunFan Zhou

          Activity

            People

            • Assignee:
              daemon YunFan Zhou
              Reporter:
              daemon YunFan Zhou
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: