Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-6769

Make schedulables without demand less needy in FairSharePolicy#compare

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.7.2
    • 2.9.0, 3.0.0-beta1
    • fairscheduler
    • None

    Description

      When use fairsheduler as RM scheduler, before assign container we will sort all queues or applications.
      We will use FairSharePolicy#compare as the comparator, but the comparator is not so perfect.
      It have a problem as blow:
      1. when a queue use resource over minShare(minResources), it will put behind the queue whose demand is zeor.
      so it will greater opportunity to get the resource although it do not want. It will waste schedule time when assign container
      to queue or application.

      I have fix it, and I will upload the patch to the jira.

      Attachments

        1. YARN-6769.001.patch
          2 kB
          YunFan Zhou
        2. YARN-6769.002.patch
          7 kB
          YunFan Zhou
        3. YARN-6769.003.patch
          5 kB
          YunFan Zhou
        4. YARN-6769.004.patch
          5 kB
          YunFan Zhou

        Activity

          People

            daemon YunFan Zhou
            daemon YunFan Zhou
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: