Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-6772

Several ways to improve fair scheduler schedule performance

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 2.7.2
    • Fix Version/s: 2.7.2
    • Component/s: fairscheduler
    • Labels:
      None
    • Target Version/s:

      Description

      There are several ways to improve fair scheduler schedule performance, and it improve a lot performance in my test environment.
      We have run it in our production cluster, and the scheduler is pretty stable and faster.
      It can assign over 5000 containers per second, and sometimes over 10000 containers.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              daemon YunFan Zhou
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated: