Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-23

FairScheduler: FSQueueSchedulable#updateDemand() - potential redundant aggregation

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.0.0-alpha
    • Fix Version/s: 2.0.3-alpha
    • Component/s: scheduler
    • Labels:
      None

      Description

      In FS, FSQueueSchedulable#updateDemand() limits the demand to maxTasks only after iterating though all the pools and computing the final demand.

      By checking if the demand has reached maxTasks in every iteration, we can avoid redundant work, at the expense of one condition check every iteration.

        Attachments

        1. trunk-MR-4518.patch
          5 kB
          Karthik Kambatla
        2. trunk-MR-4518.patch
          2 kB
          Karthik Kambatla
        3. YARN-23.patch
          5 kB
          Karthik Kambatla
        4. YARN-23.patch
          5 kB
          Karthik Kambatla

        Issue Links

          Activity

            People

            • Assignee:
              kasha Karthik Kambatla
              Reporter:
              kasha Karthik Kambatla

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment