Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-23

FairScheduler: FSQueueSchedulable#updateDemand() - potential redundant aggregation

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 2.0.0-alpha
    • 2.0.3-alpha
    • scheduler
    • None

    Description

      In FS, FSQueueSchedulable#updateDemand() limits the demand to maxTasks only after iterating though all the pools and computing the final demand.

      By checking if the demand has reached maxTasks in every iteration, we can avoid redundant work, at the expense of one condition check every iteration.

      Attachments

        1. trunk-MR-4518.patch
          2 kB
          Karthik Kambatla
        2. trunk-MR-4518.patch
          5 kB
          Karthik Kambatla
        3. YARN-23.patch
          5 kB
          Karthik Kambatla
        4. YARN-23.patch
          5 kB
          Karthik Kambatla

        Issue Links

          Activity

            People

              kasha Karthik Kambatla
              kasha Karthik Kambatla
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: