Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-6772

Several ways to improve fair scheduler schedule performance

Log workAgile BoardRank to TopRank to BottomAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsAdd voteVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 2.7.2
    • 2.7.2
    • fairscheduler
    • None

    Description

      There are several ways to improve fair scheduler schedule performance, and it improve a lot performance in my test environment.
      We have run it in our production cluster, and the scheduler is pretty stable and faster.
      It can assign over 5000 containers per second, and sometimes over 10000 containers.

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned Assign to me
            daemon YunFan Zhou

            Dates

              Created:
              Updated:

              Slack

                Issue deployment