[FLINK-31757] FLIP-370: Support Balanced Tasks Scheduling

• Type: Improvement
• Status: In Progress
• Priority: Major
• Resolution: Unresolved
• Component/s: Runtime / Coordination
• Labels: pull-request-available
• Assignee: RocMarshal
• Reporter: RocMarshal
• Created: 10/Apr/23 02:56
• Updated: 30/Oct/23 15:02

Description

This is an umbrella JIRA of FLIP-370.

Issue Links

• links to: GitHub Pull Request #22750
• mentioned in: Page Loading...

Sub-Tasks

• Introduce a new configuration item 'taskmanager.load-balance.mode': Resolved
• Support tasks balancing at slot level for Default Scheduler: Resolved
• Support resource request wait mechanism at DefaultDeclarativeSlotPool side for Default Scheduler: Resolved
• Support slots wait mechanism at DeclarativeSlotPoolBridge side for Default Scheduler: Resolved
• Introduce the abstraction and the interface about loading: In Progress
• Support tasks balancing at TM level for Default Scheduler: In Progress
• Introduce the TASKS for TaskManagerLoadBalanceMode enum: In Progress
• Support tasks balancing at slot level for Adaptive Scheduler: Open
• Support slot balancing at TM level for Adaptive Scheduler: Open
• Support tasks balancing at TM level for Adaptive Scheduler: Open
• Add the documentation page for balanced tasks scheduling: Open
• Introduce a benchmark for balanced tasks scheduling: Open