[YARN-5046] [Umbrella] De-duplicate scheduler code

• Type: Task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.0.0-alpha1
• Component/s: capacity scheduler, fairscheduler, resourcemanager, scheduler
• Labels: technical_debt
• Assignee: Ray Chiang
• Reporter: Ray Chiang
• Created: 05/May/16 16:57
• Updated: 01/Jun/16 06:21

Description

At this point in time, there are several places where code common to the schedulers can be moved from one or more of the schedulers into AbstractYARNScheduler or a related interface.

Creating this umbrella JIRA to track this refactoring. In general, it is preferable to create a subtask JIRA on a per-method basis.

This may need some coordination with YARN-3091 [Umbrella] Improve and fix locks of RM scheduler.

Sub-Tasks

• Merge common killContainer logic of Fair/Capacity scheduler into AbstractYarnScheduler: Open
• FairScheduler code refactoring to separate out the code paths for assigning a reserved container and a non-reserved container: Open
• Revisit o.a.h.y.s.rm.scheduler.ResourceUsage: Open
• De-duplicate container completion across schedulers: Open
• Refactor nodeUpdate across schedulers: Resolved
• Refactor container assignment into AbstractYarnScheduler#assignContainers: Open
• Refactor handle across schedulers: Open
• Refactor common code in initScheduler across schedulers: Open