[YARN-6772] Several ways to improve fair scheduler schedule performance

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 2.7.2
• Fix Version/s: 2.7.2
• Component/s: fairscheduler
• Target Version/s: 2.7.2
• Assignee: Unassigned
• Reporter: YunFan Zhou
• Created: 07/Jul/17 08:05
• Updated: 07/Jul/17 08:10

Description

There are several ways to improve fair scheduler schedule performance, and it improve a lot performance in my test environment.
We have run it in our production cluster, and the scheduler is pretty stable and faster.
It can assign over 5000 containers per second, and sometimes over 10000 containers.