[YARN-9698] [Umbrella] Tools to help migration from Fair Scheduler to Capacity Scheduler

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.4.0
• Component/s: capacity scheduler
• Labels: fs2cs
• Assignee: Weiwei Yang
• Reporter: Weiwei Yang
• Created: 25/Jul/19 07:24
• Updated: 11/Feb/24 09:10
• Resolved: 06/Jul/21 11:44

Description

We see some users want to migrate from Fair Scheduler to Capacity Scheduler, this Jira is created as an umbrella to track all related efforts for the migration, the scope contains

• Bug fixes
• Add missing features
• Migration tools that help to generate CS configs based on FS, validate configs etc
• Documents

this is part of CS component, the purpose is to make the migration process smooth.

Issue Links

• incorporates: YARN-10623 Capacity scheduler should support refresh queue automatically by a thread policy.
• is a parent of: YARN-9748 Allow capacity-scheduler configuration on HDFS and support reload from HDFS
• is blocked by: YARN-10546 Limit application resource reservation on nodes for non-node/rack specific requests shoud be supported in CS.
• relates to: YARN-9866 u:user2:%primary_group is not working as expected
• relates to: YARN-9867 "u:%user:parentqueue.%user" is not working as expected
• relates to: YARN-9868 Validate %primary_group queue in CS queue manager
• relates to: YARN-10610 Add queuePath to RESTful API for CapacityScheduler consistent with FairScheduler queuePath