Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-23

FairScheduler: FSQueueSchedulable#updateDemand() - potential redundant aggregation

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.0.0-alpha
    • Fix Version/s: 2.0.3-alpha
    • Component/s: scheduler
    • Labels:
      None

      Description

      In FS, FSQueueSchedulable#updateDemand() limits the demand to maxTasks only after iterating though all the pools and computing the final demand.

      By checking if the demand has reached maxTasks in every iteration, we can avoid redundant work, at the expense of one condition check every iteration.

        Attachments

        1. YARN-23.patch
          5 kB
          Karthik Kambatla
        2. YARN-23.patch
          5 kB
          Karthik Kambatla
        3. trunk-MR-4518.patch
          5 kB
          Karthik Kambatla
        4. trunk-MR-4518.patch
          2 kB
          Karthik Kambatla

          Issue Links

            Activity

              People

              • Assignee:
                kasha Karthik Kambatla
                Reporter:
                kasha Karthik Kambatla
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: