Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-5453

FairScheduler#update may skip update demand resource of child queue/app if current demand reached maxResource

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Reviewed

    Description

            demand = Resources.createResource(0);
            for (FSQueue childQueue : childQueues) {
              childQueue.updateDemand();
              Resource toAdd = childQueue.getDemand();
              demand = Resources.add(demand, toAdd);
              demand = Resources.componentwiseMin(demand, maxRes);
              if (Resources.equals(demand, maxRes)) {
                break;
              }
            }
      

      if one singe queue's demand resource exceed maxRes, the other queue's demand resource will not update.

      Attachments

        1. YARN-5453.05.patch
          6 kB
          sandflee
        2. YARN-5453.04.patch
          3 kB
          sandflee
        3. YARN-5453.03.patch
          3 kB
          sandflee
        4. YARN-5453.02.patch
          19 kB
          sandflee
        5. YARN-5453.01.patch
          4 kB
          sandflee

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            sandflee sandflee
            sandflee sandflee
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment