[FLINK-21924] Fine Grained Resource Management Phase 1

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Resolved
• Fix Version/s: 1.14.0
• Component/s: Runtime / Coordination
• Labels: Umbrella

Release Note

Flink now supports controling the resource consumption of your workload in a finer granularity. This feature is currently only available to DataStream API.

See more: https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/deployment/finegrained_resource/

• Assignee: Unassigned
• Reporter: Xintong Song
• Created: 23/Mar/21 07:40
• Updated: 13/Sep/21 02:54
• Resolved: 13/Sep/21 02:54

Description

This ticket serves as the umbrella of remaining tasks for delivering the fine grained resource management feature to end users.

Sub-Tasks

• Support retrieving slot details via rest api: Closed
• Optimize the performance of ResourceAllocationStrategy: Closed
• FLIP-169 Support configuring fine grained resource requirements via DataStream API: Closed
• Document Fine Grained Resource Management: Closed
• Clean-up of legacy mode.: Closed
• Promote the log level of the resource declaration to INFO in FineGrainedSlotManager: Closed
• Implement SlotRequestAdapter for the FineGrainedSlotManager: Closed
• Add StreamExecutionEnvironment#registerSlotSharingGroup to PyFlink and Scala: Resolved
• Test the fine-grained resource management: Closed